Manual Tests (LTS 1.424.x)

Installation, upgrade 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Install from RPM

Install Jenkins from RPM package

Jenkins is installed without error and runs

Run on FC 15,16 and RHEL 5,6  

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK 

vjuranek
vjuranek
vjuranek
vjuranek

Install from .deb

Install Jenkins from Debian package

Jenkins is installed without error and runs

Debian 6.0 x64 and Debian Testing x86

1.424.1 / OK

markewaite

Install from war on Tomcat

Install Jenkins from war by deploying on Tomcat

Jenkins is deployed and runs

Deployed on Tomcat 6,7 (FC14, openJDK)

1.424.1 / OK
1.424.2 / OK
1.424.3 / OK  

ragesh_nair
vjuranek
vjuranek

Install from war on JBoss AS

Install Jenkins from war by deploying on JBoss AS

Jenkins is deployed and runs

Deployed on JBoss AS 6 and AS 7 (RHEL6, openJDK)

1.424.1 / OK
1.424.2 / OK
1.424.3 / OK  

vjuranek
vjuranek
vjuranek

Install plugins from update center

Install some plugins from update center

Selected plugins are installed

Tomcat/HotSpot
Winsotne/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK  

ragesh_nair
vjuranek
vjuranek
vjuranek

Reload config from disk

Make some changes directly on disk and launch "Reload Configuration from Disk"

Made changes are reflected

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK 

ragesh_nair
vjuranek

Restart after plugin upgrade

Launch "Restart when no jobs are running" after plugin upgrade/install

Jenkins restarts when no jobs are running

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK 
1.424.2 RC3 / OK
1.424.3 / OK  

ragesh_nair
vjuranek
vjuranek
vjuranek

Core functionality 

Global configuration 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

JDK auto install

Add JDK, select "Install automatically"

JDK is installed

Winstone/openJDK

1.424.1 / WARN (cannot test, Oracle System error during login) 
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / WARN  (installing jdk-7 works fine, jdk-6 fails with
ClassNotFoundException: org.apache.xml.utils.PrefixResolver,
present already in previous releases, but not spotted)

vjuranek 
vjuranek
vjuranek
vjuranek

Add ant installation

Add existing ant installation

Ant installation is added

Tomcat/HotSpot
Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK 

ragesh_nair
vjuranek
vjuranek
vjuranek

Ant auto install

Add Ant, select "Install automatically"

Ant version is installed

Winstone/openJDK

1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK 

vjuranek
vjuranek
vjuranek

Add maven installation

Add existing maven installation

Maven installation is added

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK 

ragesh_nair
vjuranek
vjuranek
vjuranek

Maven auto install

Add Maven, select "Install automatically"

Maven is installed

Winstone/openJDK

1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK 

vjuranek
vjuranek
vjuranek

Setup email notification

Setup SMTP server, admin email and send test email

SMTP is setup, test email is sent and delivered 

Tomcat/HotSpot

Winsotne/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

Copy job config

Create job by copying existing on

Job is created with config same as already existing job

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK 
1.424.2 RC3 / OK
1.424.3 / OK  

vjuranek 
vjuranek
vjuranek
vjuranek

Freestyle jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create freestyle job

Create freestyle job

Freestyle job is created

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

Build rotation

Setup "Discard Old Builds" and specify number of build to be kept

Old builds are deleted

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

Parametrized build

Setup parametrized build and check the parameter value

The appropriate variable is setup and contains right value

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK  

ragesh_nair
vjuranek
vjuranek
vjuranek

Disable build

Configure project as diabled

Project is diabled

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

Concurrent builds

Allow "Execute concurrent builds" in project config and schedule two or more builds

Builds are executed concurently

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK  

ragesh_nair
vjuranek
vjuranek
vjuranek

Tie project to a label

Tie project to a label and schedule a build

Build is executed on slave with given label

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

SVN checkout

Configure SVN repository and schedule build

Project is checkout from SVN

Winstone /HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

markewaite
vjuranek
vjuranek
vjuranek

Ant build step

Add ant build step and configure ant targets

Ant targets are executed and finish with success

Ant-1.8.2/Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Maven build step

Add maven build step and configure maven goals

Maven goals are executed and finish with success

Maven-3.0.3/Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Shell builds step

Add shell build step and setup simple shell script

Shell script is executed and finish with success

bash/Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

Archive artifacts

Setup "Archive artifacts" post-build action

Artifacts are archived

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Publish JavaDoc

Setup JavaDoc publishing

JavaDocs are published

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Publish JUnit results

Setup publishing of JUnit results

JUnit results are published

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Email notification

Setup email notification and schedule build

Notification email is sent and delivered

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

Periodical build triggers

Setup periodical triggers

Build is launched in given time

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

 

 

 

 

 

 

Maven jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create maven job

Create maven job

Maven job is created

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Build maven project

Schedule maven job

Maven build succedded

Winstone/openJDK

1.424.1 / OK
1.424.1 / OK
1.424.2 RC3 / OK
1.424.3 / OK  

vjuranek
vjuranek
vjuranek
vjuranek

Matrix jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create matrix job

Create matrix job

Matrix job is created

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Combination filter

Setup combination filter

Only jobs which pass the filter are build

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Plug-ins 

SSH slaves (1.17)

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Connect ssh slave

Connect ssh slave by providing login/passwd

Slave is connected

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

SVN (1.28) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Simple checkout

Setup SVN SCM and do checkout

Sources are checked out

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Maven (1424.1-Snapshot) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Maven2 build

Build maven2 project

Build is executed

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK  

vjuranek
vjuranek
vjuranek
vjuranek

Maven3 build

Build maven3 project

Build is executed

Winstone/HotSpot

 

 

Green balls (1.10) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Success results

Success results

Success results are marke as green

Tomcat/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

ragesh_nair
vjuranek
vjuranek
vjuranek

Git (1.1.12) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Simple checkout

Add Git SCM and chekcout project

Project is checked out

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Checkstyle (3.21) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish check-style result

Configure project to publish check-style result

Results are published

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Cobertura (1.3) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish cobertura results

Configure project to publish cobertura results

Results are published

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Findbugs (4.30) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish find-bugs results

Configure project to publish find-bugs results

Results are published

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK  

vjuranek
vjuranek
vjuranek
vjuranek

PMD (3.22) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish PDM results

Configure project to publish PDM results

Results are published

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

 

 

 

 

 

 

Warnings (3.22) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish warnings

Configure project to publish warnings

Warnings are published

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Sonar (1.7.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Sonar analysis

Setup sonar analysis

Analysis is executed and published on sonar server

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK 

vjuranek
vjuranek
vjuranek
vjuranek

Disk usage (0.14)

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Show values and graphs

Enable "Show disk usage trend graph on the project page" on global config

Disk usage number and graphs are shown on project page

Winstone/opnJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Reflect changes on disk correctly

Made some changes on disk (e.g. delete workspace) and launch disk usage

Changes on disk will be reflected in disk usage number

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Violations (0.7.10) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish violations report

Setup findbug, pmd etc reports and violations reports

Violations reports are published

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Chuck Norris (0.4) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Activate Chuck Norris

Self-describing

Chuck Norris rules

Winstone/HotSpot

1.424.1 / OK

lvotypko

Analysis collector (1.18) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Collects and show results

Setup collection of checkstyle, findbugs, pdm and warnings results collection

Results are collected and shown

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK  

vjuranek
vjuranek
vjuranek
vjuranek

Dashboard view (2.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create dashboard view

Create dashboard view and some portlets

View as well as portlets are created and shown

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK  

vjuranek
vjuranek
vjuranek
vjuranek

HTML publisher (0.7) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Record HTML report

Setup directory containing HTML report

HTML report is published

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Email-ext (2.14) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Email notification

Setup email notification and schedule build

Notification email is sent and delivered

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Batch tasks (1.14) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Execute batch task

Define batch task in project1, setup executions of this tast in project 2 and schedule a build

Batch task of project1 is executed

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK  
1.424.3 / OK 

vjuranek
vjuranek
vjuranek
vjuranek

Jira (1.29) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Update JIRA issue

Update JIRA issue which is related to changes contained in the build

JIRA is updated and on build page is a link to appropriate JIRA

Winstone/HotSpot

1.424.1 / WARN (plugin reports that server returns HTTP 500, while server is obviously running, not sure, where is the problem)
1.424.2 / OK
1.424.2 RC3 / OK  

vjuranek
vjuranek 
vjuranek

Deploy (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Deploy on Tomcat 7

Build war app and deploy it on Tomcat 7

App is successfully deployed and running

Winstone/oepnJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK 

vjuranek
vjuranek
vjuranek
vjuranek

Dry (2.21) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish DRY analysis results

Setup CPD analysis and publish analysis results

Results are published

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK  

vjuranek
vjuranek
vjuranek
vjuranek

Backup (1.6.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Backup Jenkins configuration

Setup backup dir and run Jenkins baskup

Once no builds run, backup is performed

Winstone/oepnJDK

1.424.1 / WARN (backup is executed but fails with java.io.IOException: Unable to add some/random/file)
1.424.2 / WARN (backup is executed but fails with java.io.IOException: Unable to add some/random/file
org.codehaus.plexus.archiver.ArchiverException: Failed to read filesystem attributes for: /var/lib/jenkins/ranrom/file)
1.424.2 RC3 / WARN (backup is executed but fails with java.io.IOException: Unable to add some/random/file
org.codehaus.plexus.archiver.ArchiverException: Failed to read filesystem attributes for: /var/lib/jenkins/ranrom/file)

vjuranek
vjuranek 
vjuranek

XUnit () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish testing tools

Create Test Result Trend graph

 

Winstone/HotSpot

1.424.1 / OK

lvotypko

Build timeout (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Build time out

Configure build with shorter time out that the duration of the build

Build is aborted

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK    

vjuranek
vjuranek
vjuranek
vjuranek

Scp publisher (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish artifact over scp

Setup remote destination and artifact to be archived over scp

Artifact is archived on remote machine in speficied dir

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK    

vjuranek
vjuranek
vjuranek
vjuranek

 

 

 

 

 

 

Gradle (1.12) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Gradle build step

Setup gradle build step

Gradle build step is executed

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Gradle auto install

Add Gradle, select "Install automatically"

Gradle is installed

Winstone/openJDK

1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek

Groovy (1.9) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Groovy build step

Setup Groovy build step

Groovy build step is executed

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK    

vjuranek
vjuranek
vjuranek
vjuranek

Systyem Groovy build step

Setup system Groovy build step

System Groovy build step is executed

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Groovy auto install

Add Groovy, select "Install automatically"

Groovy is installed

Winstone/openJDK

1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK  

vjuranek
vjuranek
vjuranek

Audit trail (1.7) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Log operations 

Setup audit trail plugin 

Operations like changes job config are logged in audit log

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Job config history (1.11) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Record changes

Record changes in job config

Changes are recored and shown

Winstone/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK    

vjuranek
vjuranek
vjuranek
vjuranek

Nested view (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create nested view

Create nested view

Nested view is created

Winstone (rpm)/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

IRC (2.18) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Send IRC notification

Setup IRC notification and schedule a build

Notification is send to appropriate IRC channel

Winstone (rpm)/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek

Run jenkins bot command

Run bot command on IRC channel

Command is executed

Winstone (rpm)/openJDK

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK   

vjuranek 
vjuranek
vjuranek
vjuranek

Workspace clean up (0.6) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Delete workspace before build

Setup delete workspace before build

Workspace is deleted before build

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK
1.424.3 / OK    

vjuranek
vjuranek
vjuranek
vjuranek

Delete workspace after build

Setup delete workspace after build

Workspace is deleted after build

Winstone/HotSpot

1.424.1 / OK
1.424.2 / OK
1.424.2 RC3 / OK 
1.424.3 / OK   

vjuranek
vjuranek
vjuranek
vjuranek