Manual Tests (LTS 1.466.x)

Test results:

  • 1.466.1 / OK - test passed without any problem
  • 1.466.1 / WARN - there was some problem, functionality doesn't do what is expected, but it doesn't cause failure of whole Jenkins or any other significant problems
  • 1.466.1 / FAIL - cause failure of whole Jenkins or similar critical issue which affects all jobs (e.g. when plugin is installed, it's not possible to start Jenkins or save configuration of any job)

Installation, upgrade 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Install from RPM

Install Jenkins from RPM package

Jenkins is installed without error and runs

FC17, RHEL 6.2

1.466.1 / OK

vjuranek

Install from .deb

Install Jenkins from Debian package

Jenkins is installed without error and runs

Debian Wheezy x86, OpenJDK 6, Winstone
Debian Squeeze x64, OpenJDK 6, Winstone  

1.466.1 / OK

markewaite

Install from war on Tomcat

Install Jenkins from war by deploying on Tomcat

Jenkins is deployed and runs

RHEL6, OpenJDK, Tomcat7

1.466.1 / OK

vjuranek

Install from war on JBoss AS

Install Jenkins from war by deploying on JBoss AS

Jenkins is deployed and runs

RHEL6, OpenJDK, AS7

1.466.1 / OK

vjuranek

Install plugins from update center with restart

Install some plugins from update center with restart

Selected plugins are installed after restart

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Install plugins from update center without restart

Install some plugins from update center without restart

Selected plugins are installed after restart

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Restart after plugin upgrade

Launch "Restart when no jobs are running" after plugin upgrade/install

Jenkins restarts when no jobs are running

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Reload config from disk

Make some changes directly on disk and launch "Reload Configuration from Disk"

Made changes are reflected

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Core functionality 

Global configuration 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

JDK 1.6 auto install

Add JDK 1.6 , select "Install automatically" 

JDK 1.6 is installed 

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

JDK 1.7 auto install

Add JDK 1.7 , select "Install automatically"

JDK 1.7 is installed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Add ant installation

Add existing ant installation

Ant installation is added

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Ant auto install

Add Ant, select "Install automatically"

Ant version is installed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Add maven installation

Add existing maven installation

Maven installation is added

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Maven auto install

Add Maven, select "Install automatically"

Maven is installed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Setup email notification

Setup SMTP server, admin email and send test email

SMTP is setup, test email is sent and delivered 

Debian Wheezy x86, OpenJDK 6, Winstone

1.466.1 / OK

markewaite

Copy job config

Create job by copying existing on

Job is created with config same as already existing job

Oracle Linux 6, OpenJDK 6, Winstone

1.466.1 / OK

markewaite

Freestyle jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create freestyle job

Create freestyle job

Freestyle job is created

Oracle Linux 6, OpenJDK, Winstone

1.466.1 / OK

markewaite

Build rotation

Setup "Discard Old Builds" and specify number of build to be kept

Old builds are deleted

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Parametrized build

Setup parametrized build and check the parameter value

The appropriate variable is setup and contains right value

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Disable build

Configure project as disabled 

Project is disabled 

Oracle Linux 6, OpenJDK, Winstone

1.466.1 / OK

markewaite

Concurrent builds

Allow "Execute concurrent builds" in project config and schedule two or more builds

Builds are executed concurently

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Tie project to a label

Tie project to a label and schedule a build

Build is executed on slave with given label

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

SVN checkout

Configure SVN repository and schedule build

Project is checkout from SVN

Oracle Linux 6, OpenJDK, Winstone

1.466.1 / OK

markewaite

Ant build step

Add ant build step and configure ant targets

Ant targets are executed and finish with success

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Maven build step

Add maven build step and configure maven goals

Maven goals are executed and finish with success

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Shell builds step

Add shell build step and setup simple shell script

Shell script is executed and finish with success

Oracle Linux 6, OpenJDK, Winstone

1.466.1 / OK

markewaite

Archive artifacts

Setup "Archive artifacts" post-build action

Artifacts are archived

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Publish JavaDoc

Setup JavaDoc publishing

JavaDocs are published

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Publish JUnit results

Setup publishing of JUnit results

JUnit results are published

Oracle Linux 6, OpenJDK, Winstone

1.466.1 / OK

markewaite

Email notification

Setup email notification and schedule build

Notification email is sent and delivered

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Periodical build triggers

Setup periodical triggers

Build is launched in given time

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Maven jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create maven job

Create maven job

Maven job is created

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Build maven project

Schedule maven job

Maven build succedded

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Matrix jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create matrix job

Create matrix job

Matrix job is created

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Combination filter

Setup combination filter

Only jobs which pass the filter are build

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Plug-ins 

SSH slaves (0.21)

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Connect ssh slave

Connect ssh slave by providing login/passwd

Slave is connected

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

SVN (1.42) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Simple checkout

Setup SVN SCM and do checkout

Sources are checked out

Oracle Linux 6, OpenJDK, Winstone

1.466.1 / OK

markewaite

Maven (1.466.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Maven2 build

Build maven2 project

Build is executed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Maven3 build

Build maven3 project

Build is executed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Green balls (1.12) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Success results

Success results

Success results are marke as green

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Git (1.1.21) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Simple checkout

Add Git SCM and checkout project

Project is checked out

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek 

Simple checkout

Add Git SCM and checkout project

Project is checked out

Debian Wheezy x86, OpenJDK, Winstone
See Jenkins-14480

1.466.1 / WARN

markewaite

Simple checkout

Add Git SCM and checkout project

Project is checked out

Oracle Linux 6 amd64, OpenJDK, Winstone
See Jenkins-14480

1.466.1 / WARN

markewaite

Git (1.1.20) 

Test name 

Short description 

Expected result 

Notes 

LTS RC / result 

Tested by 

Simple checkout

Add Git SCM and checkout project

Project is checked out

Debian Wheezy x86, OpenJDK, Winstone

1.466.1 / OK

markewaite

Simple checkout

Add Git SCM and checkout project

Project is checked out

Oracle Linux 6 amd64, OpenJDK, Winstone

1.466.1 / OK

markewaite

Checkstyle (3.29) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish check-style result

Configure project to publish check-style result

Results are published

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Cobertura (1.5) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish cobertura results

Configure project to publish cobertura results

Results are published

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Findbugs (4.42) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish find-bugs results

Configure project to publish find-bugs results

Results are published

Oracle Linux 6, OpenJDK, Winstone

1.466.1 / OK

markewaite

PMD (3.29) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish PMD results

Configure project to publish PMD results

Results are published

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Warnings (4.12) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish warnings

Configure project to publish warnings

Warnings are published

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Sonar (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Sonar analysis

Setup sonar analysis

Analysis is executed and published on sonar server

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Disk usage (0.17)

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Show values and graphs

Enable "Show disk usage trend graph on the project page" on global config

Disk usage number and graphs are shown on project page

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Reflect changes on disk correctly

Made some changes on disk (e.g. delete workspace) and launch disk usage

Changes on disk will be reflected in disk usage number

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Violations (0.7.10) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish violations report

Setup findbug, pmd etc reports and violations reports

Violations reports are published

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Chuck Norris () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Activate Chuck Norris

Self-describing

Chuck Norris rules

 



Analysis collector (1.29) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Collects and show results

Setup collection of checkstyle, findbugs, pdm and warnings results collection

Results are collected and shown

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Dashboard view (2.3) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create dashboard view

Create dashboard view and some portlets

View as well as portlets are created and shown

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

HTML publisher (1.0) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Record HTML report

Setup directory containing HTML report

HTML report is published

Oracle Linux, OpenJDK, Winstone
Bug Jenkins-13241.
Passes if master node runs job,
Fails if slave node runs job
 

1.466.1 / WARN
 

markewaite
 

 

 

 

RHEL6, OpenJDK, Winstone

(forks fine for also on slave)

1.466.1 / OK

vjuranek

Email-ext (2.24.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Email notification

Setup email notification and schedule build

Notification email is sent and delivered

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Batch tasks (1.16) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Execute batch task

Define batch task in project1, setup executions of this tast in project 2 and schedule a build

Batch task of project1 is executed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Jira (1.34) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Update JIRA issue

Update JIRA issue which is related to changes contained in the build

JIRA is updated and on build page is a link to appropriate JIRA

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Deploy (1.9) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Deploy on Tomcat 7

Build war app and deploy it on Tomcat 7

App is successfully deployed and running

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Dry () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish DRY analysis results

Setup CPD analysis and publish analysis results

Results are published

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Backup (1.6.1) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Backup Jenkins configuration

Setup backup dir and run Jenkins baskup

Once no builds run, backup is performed

RHEL6, OpenJDK, Winstone

1.466.1 / WARN
(failed with various "Failed to read filesystem attributes for: /some/random/file")

vjuranek

XUnit () 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish testing tools

Create Test Result Trend graph

 

 

 

 

Build timeout (1.10) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Build time out

Configure build with shorter time out that the duration of the build

Build is aborted

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Scp publisher (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish artifact over scp

Setup remote destination and artifact to be archived over scp

Artifact is archived on remote machine in speficied dir

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Gradle (1.16) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Gradle build step

Setup gradle build step

Gradle build step is executed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Gradle auto install

Add Gradle, select "Install automatically"

Gradle is installed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Groovy (1.12) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Groovy build step

Setup Groovy build step

Groovy build step is executed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Systyem Groovy build step

Setup system Groovy build step

System Groovy build step is executed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Groovy auto install

Add Groovy, select "Install automatically"

Groovy is installed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Audit trail (1.7) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Log operations 

Setup audit trail plugin 

Operations like changes job config are logged in audit log

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Job config history (1.13) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Record changes

Record changes in job config

Changes are recored and shown

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Nested view (1.8) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Create nested view

Create nested view

Nested view is created

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

IRC (2.18) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Send IRC notification

Setup IRC notification and schedule a build

Notification is send to appropriate IRC channel

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Run jenkins bot command

Run bot command on IRC channel

Command is executed

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Workspace clean up (0.10) 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Delete workspace before build

Setup delete workspace before build

Workspace is deleted before build

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek

Delete workspace after build

Setup delete workspace after build

Workspace is deleted after build

RHEL6, OpenJDK, Winstone

1.466.1 / OK

vjuranek