Manual Tests (LTS 1.409.x)

Installation, upgrade 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Install from RPM

Install Jenkins from RPM package

Jenkins is installed without error and runs

Run on FC 14 ,15 and RHEL 5,6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Install from .deb

Install Jenkins from Debian package

Jenkins is installed without error and runs

Debian 6.0 x64 and Debian Testing x86

1.409.1 / OK
1.409.2 / OK

markewaite
markewaite

Install from war on Tomcat

Install Jenkins from war by deploying on Tomcat

Jenkins is deployed and runs

Deployed on Tomcat 6,7 (FC14, openJDK)

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Install from war on JBoss AS

Install Jenkins from war by deploying on JBoss AS

Jenkins is deployed and runs

Deployed on JBoss AS 6 (FC14, openJDK)

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Install plugins from update center

Install some plugins from update center

Selected plugins are installed

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Reload config from disk

Make some changes directly on disk and launch "Reload Configuration from Disk"

Made changes are reflected

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / doesn't work for Hudson master config
1.409.2 / OK

vjuranek
vjuranek

Restart after plugin upgrade

Launch "Restart when no jobs are running" after plugin upgrade/install

Jenkins restarts when no jobs are running

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Core functionality 

Global configuration 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Add ant installation

Add existing ant installation

Ant installation is added

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Add maven installation

Add existing maven installation

Maven installation is added

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Setup email notification

Setup SMTP server, admin email and send test email

SMTP is setup, test email is sent and delivered 

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Freestyle jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create freestyle job

Create freestyle job

Freestyle job is created

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Build rotation

Setup "Discard Old Builds" and specify number of build to be kept

Old builds are deleted

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Parametrized build

Setup parametrized build and check the parameter value

The appropriate variable is setup and contains right value

Winstone (rpm)/HotSpot/RHEL6

1.400.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Disable build

Configure project as diabled

Project is diabled

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Concurrent builds

Allow "Execute concurrent builds" in project config and schedule two or more builds

Builds are executed concurently

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Tie project to a label

Tie project to a label and schedule a build

Build is executed on slave with given label

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

SVN checkout

Configure SVN repository and schedule build

Project is checkout from SVN

Winstone (rpm)/openJDK/FC14

1.409.1 / OK
1.409.2 / OK

vjuranek
lvotypkova 

Ant build step

Add ant build step and configure ant targets

Ant targets are executed and finish with success

Ant-1.8.2/Winstone (rpm)/openJDK/FC14

1.409.1 / OK
1.409.2 / OK

vjuranek
lvotypkova

Maven build step

Add maven build step and configure maven goals

Maven goals are executed and finish with success

Maven-3.0.3/Winstone (rpm)/openJDK/FC14

1.409.1 / OK
1.409.2 / OK

vjuranek
lvotypkova

Shell builds step

Add shell build step and setup simple shell script

Shell script is executed and finish with success

bash/Winstone (rpm)/openJDK/FC14

1.409.1 / OK
1.409.2 / OK

vjuranek 
lvotypkova

Archive artifacts

Setup "Archive artifacts" post-build action

Artifacts are archived

Winstone (rpm)

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Publish JavaDoc

Setup JavaDoc publishing

JavaDocs are published

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Email notification

Setup email notification and schedule build

Notification email is sent and delivered

Winstone (rpm)/HotSpot/RHEL6

1.400.1/ OK
1.409.2 / OK

vjuranek
vjuranek

Build triggers

Setup any of build triggers

 

 

1.409.1 /  ---
1.409.2 / OK


lvotypkova

Maven jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create maven job

Create maven job

Maven job is created

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
lvotypkova

 

 

 

 

 

 

Matrix jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create matrix job

Create matrix job

Matrix job is created

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
lvotypkova

Combination filter

Setup combination filter

Only jobs which pass the filter are build

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
lvotypkova

Plug-ins 

SSH slaves 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Connect ssh slave

Connect ssh slave by providing login/passwd

Slave is connected

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

SVN (1.25, 1.26) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Simple checkout

Setup SVN SCM and do checkout

Sources are checked out

Winstone (rpm)/HotSpot/RHEL5.6
Winstone (own fork based on 1.409.2 RC)
/HotsSpot 1.6.0_24/RHEL5.5

1.409.1 / OK
1.409.2 / OK

vjuranek
kutzi

Maven (1409.1-Snapshot) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Maven2 build

Build maven2 project

Build is executed

Winstone (rpm)/HotSpot/RHEL5.6
Winstone (own fork based on 1.409.2 RC)
/HotsSpot 1.6.0_24/RHEL5.5

1.409.1 / OK
1.409.2 / OK

vjuranek
kutzi

Maven3 build

Build maven2 project

Build is executed

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
lvotypkova

CVS (1.2) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

 

 

 

 

 

 

Scis-ad () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

 

 

 

 

 

 

Green balls (1.10) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Success results

Success results

Success results are marke as green

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Git (1.1.9) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Simple checkout

Add Git SCM and chekcout project

Project is checked out

Winstone (rpm)/HotSpot/RHEL5.6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Checkstyle (3.15) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish check-style result

Configure project to publish check-style result

Results are published

Winstone (rpm)/HotSpot/RHEL5.6
Winstone (own fork based on 1.409.2 RC)
/HotsSpot 1.6.0_24/RHEL5.5/Checkstyle 3.19

1.409.1 / OK
1.409.2 / OK

vjuranek
kutzi

Cobertura (1.2,1.3) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish cobertura results

Configure project to publish cobertura results

Results are published

Winstone (rpm)/HotSpot/RHEL5.6
Cobertura plugin 1.3

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Findbugs (4.23) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish find-bugs results

Configure project to publish find-bugs results

Results are published

Winstone (rpm)/HotSpot/RHEL5.6
Winstone (own fork based on 1.409.2 RC)
/HotsSpot 1.6.0_24/RHEL5.5/FindBugs 4.28

1.409.1 / OK
1.409.2 / OK

vjuranek
kutzi

PMD (3.15, 3.21) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish PDM results

Configure project to publish PDM results

Results are published

Winstone (rpm)/HotSpot/RHEL5.6
PDM 3.21

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Warnings (3.16) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish warnings

Configure project to publish warnings

Warnings are published

Winstone (rpm)/HotSpot/RHEL5.6
Winstone (own fork based on 1.409.2 RC)
/HotsSpot 1.6.0_24/RHEL5.5/Warnings 3.20

1.409.1 / OK
1.409.2 / OK

vjuranek
kutzi

Sonar (1.6.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

 

 

 

 

 

 

Disk usage (0.13)

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Show values and graphs

Enable "Show disk usage trend graph on the project page" on global config

Disk usage number and graphs are shown on project page

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Reflect changes on disk correctly

Made some changes on disk (e.g. delete workspace) and launch disk usage

Changes on disk will be reflected in disk usage number

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Violations (0.7.10) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish violations report

Setup findbug, pmd etc reports and violations reports

Violations reports are published

Winstone (rpm)/openJDK/RHEL6

1.409.1 / ---
1.409.2 / OK

---
vjuranek

Chuck Norris (0.4) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Activate Chuck Norris

Self-describing

Chuck Norris rules

Winstone (rpm)/openJDK/RHEL6

1.409.1 / ---
1.409.2 / OK

---
vjuranek

Analysis collector (1.13, 1.17) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Collects and show results

Setup collection of checkstyle, findbugs, pdm and warnings results collection

Results are collected and shown

Winstone (rpm)/HotSpot/RHEL6
 
Analysis collector 1.17

1.409.1 / FAIL
(java.lang.NoClassDefFoundError: hudson/plugins/checkstyle/CheckStyleMavenResultAction)
1.409.2 / OK

vjuranek

vjuranek

Dashboard view (2.0.2) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create dashboard view

Create dashboard view and some portlets

View as well as portlets are created and shown

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

HTML publisher (0.7) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Record HTML report

Setup directory containing HTML report

HTML report is published

Winstone (rpm)/openJDK/RHEL6

1.409.1 / ---
1.409.2 / OK

---
vjuranek

Tasks () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

 

 

 

 

 

 

Jira (1.29) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Update JIRA issue

Update JIRA issue which is related to changes contained in the build

JIRA is updated and on build page is a link to appropriate JIRA

Winstone (rpm)/openJDK/RHEL6

1.409.1 / ---
1.409.2 / OK

---
vjuranek

Active directory () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

 

 

 

 

 

 

Deploy () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

 

 

 

 

 

 

Dry (2.20) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish DRY analysis results

Setup CPD analysis and publish analysis results

Results are published

Winstone (rpm)/openJDK/RHEL6

1.409.1 / ---
1.409.2 / OK

---
vjuranek

Backup (1.6.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Backup Jenkins configuration

Setup backup dir and run Jenkins baskup

Once no builds run, backup is performed

Winstone (rpm)/openJDK/RHEL6

1.409.1 / --- 
1.409.2 / OK

---
vjuranek

XUnit () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

 

 

 

 

 

 

Build timeout (1.7,1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Build time out

Configure build with shorter time out that the duration of the build

Build is aborted

Winstone (rpm)/HotSpot/RHEL6
1.7 
1.8

1.409.1 / OK
1.409.2 / OK
1.409.2 / build continues running 

vjuranek
vjuranek
vjuranek

Scp publisher (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish artifact over scp

Setup remote destination and artifact to be archived over scp

Artifact is archived on remote machine in speficied dir

Winstone (rpm)/openJDK/RHEL6

1.409.1 / ---
1.409.2 / OK

---
vjuranek

Gradle (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Gradle build step

Setup gradle build step

Gradle build step is executed

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Groovy (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Groovy build step

Setup Groovy build step

Groovy build step is executed

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Systyem Groovy build step

Setup system Groovy build step

System Groovy build step is executed

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Job config history (1.11) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Record changes

Record changes in job config

Changes are recored and shown

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Nested view (1.7) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create nested view

Create nested view

Nested view is created

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Workspace clean up (0.4) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Delete workspace before build

Setup delete workspace before build

Workspace is deleted before build

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek

Delete workspace after build

Setup delete workspace after build

Workspace is deleted after build

Winstone (rpm)/HotSpot/RHEL6

1.409.1 / OK
1.409.2 / OK

vjuranek
vjuranek