Manual Tests (LTS 1.424.x)
Installation, upgrade
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Install from RPM |
Install Jenkins from RPM package |
Jenkins is installed without error and runs |
Run on FC 15,16 and RHEL 5,6 |
1.424.1 / OK |
vjuranek |
Install from .deb |
Install Jenkins from Debian package |
Jenkins is installed without error and runs |
Debian 6.0 x64 and Debian Testing x86 |
1.424.1 / OK |
markewaite |
Install from war on Tomcat |
Install Jenkins from war by deploying on Tomcat |
Jenkins is deployed and runs |
Deployed on Tomcat 6,7 (FC14, openJDK) |
1.424.1 / OK |
ragesh_nair |
Install from war on JBoss AS |
Install Jenkins from war by deploying on JBoss AS |
Jenkins is deployed and runs |
Deployed on JBoss AS 6 and AS 7 (RHEL6, openJDK) |
1.424.1 / OK |
vjuranek |
Install plugins from update center |
Install some plugins from update center |
Selected plugins are installed |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Reload config from disk |
Make some changes directly on disk and launch "Reload Configuration from Disk" |
Made changes are reflected |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Restart after plugin upgrade |
Launch "Restart when no jobs are running" after plugin upgrade/install |
Jenkins restarts when no jobs are running |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Core functionality
Global configuration
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
JDK auto install |
Add JDK, select "Install automatically" |
JDK is installed |
Winstone/openJDK |
1.424.1 / WARN (cannot test, Oracle System error during login) |
vjuranek |
Add ant installation |
Add existing ant installation |
Ant installation is added |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Ant auto install |
Add Ant, select "Install automatically" |
Ant version is installed |
Winstone/openJDK |
1.424.2 / OK |
vjuranek |
Add maven installation |
Add existing maven installation |
Maven installation is added |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Maven auto install |
Add Maven, select "Install automatically" |
Maven is installed |
Winstone/openJDK |
1.424.2 / OK |
vjuranek |
Setup email notification |
Setup SMTP server, admin email and send test email |
SMTP is setup, test email is sent and delivered |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Copy job config |
Create job by copying existing on |
Job is created with config same as already existing job |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Freestyle jobs
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Create freestyle job |
Create freestyle job |
Freestyle job is created |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Build rotation |
Setup "Discard Old Builds" and specify number of build to be kept |
Old builds are deleted |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Parametrized build |
Setup parametrized build and check the parameter value |
The appropriate variable is setup and contains right value |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Disable build |
Configure project as diabled |
Project is diabled |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Concurrent builds |
Allow "Execute concurrent builds" in project config and schedule two or more builds |
Builds are executed concurently |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Tie project to a label |
Tie project to a label and schedule a build |
Build is executed on slave with given label |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
SVN checkout |
Configure SVN repository and schedule build |
Project is checkout from SVN |
Winstone /HotSpot |
1.424.1 / OK |
markewaite |
Ant build step |
Add ant build step and configure ant targets |
Ant targets are executed and finish with success |
Ant-1.8.2/Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Maven build step |
Add maven build step and configure maven goals |
Maven goals are executed and finish with success |
Maven-3.0.3/Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Shell builds step |
Add shell build step and setup simple shell script |
Shell script is executed and finish with success |
bash/Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Archive artifacts |
Setup "Archive artifacts" post-build action |
Artifacts are archived |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Publish JavaDoc |
Setup JavaDoc publishing |
JavaDocs are published |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Publish JUnit results |
Setup publishing of JUnit results |
JUnit results are published |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Email notification |
Setup email notification and schedule build |
Notification email is sent and delivered |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Periodical build triggers |
Setup periodical triggers |
Build is launched in given time |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
|
|
|
|
|
|
Maven jobs
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Create maven job |
Create maven job |
Maven job is created |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Build maven project |
Schedule maven job |
Maven build succedded |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Matrix jobs
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Create matrix job |
Create matrix job |
Matrix job is created |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Combination filter |
Setup combination filter |
Only jobs which pass the filter are build |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Plug-ins
SSH slaves (1.17)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Connect ssh slave |
Connect ssh slave by providing login/passwd |
Slave is connected |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
SVN (1.28)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Simple checkout |
Setup SVN SCM and do checkout |
Sources are checked out |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Maven (1424.1-Snapshot)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Maven2 build |
Build maven2 project |
Build is executed |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Maven3 build |
Build maven3 project |
Build is executed |
Winstone/HotSpot |
|
|
Green balls (1.10)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Success results |
Success results |
Success results are marke as green |
Tomcat/HotSpot |
1.424.1 / OK |
ragesh_nair |
Git (1.1.12)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Simple checkout |
Add Git SCM and chekcout project |
Project is checked out |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Checkstyle (3.21)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish check-style result |
Configure project to publish check-style result |
Results are published |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Cobertura (1.3)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish cobertura results |
Configure project to publish cobertura results |
Results are published |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Findbugs (4.30)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish find-bugs results |
Configure project to publish find-bugs results |
Results are published |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
PMD (3.22)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish PDM results |
Configure project to publish PDM results |
Results are published |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
|
|
|
|
|
|
Warnings (3.22)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish warnings |
Configure project to publish warnings |
Warnings are published |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Sonar (1.7.1)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Sonar analysis |
Setup sonar analysis |
Analysis is executed and published on sonar server |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Disk usage (0.14)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Show values and graphs |
Enable "Show disk usage trend graph on the project page" on global config |
Disk usage number and graphs are shown on project page |
Winstone/opnJDK |
1.424.1 / OK |
vjuranek |
Reflect changes on disk correctly |
Made some changes on disk (e.g. delete workspace) and launch disk usage |
Changes on disk will be reflected in disk usage number |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Violations (0.7.10)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish violations report |
Setup findbug, pmd etc reports and violations reports |
Violations reports are published |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Chuck Norris (0.4)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Activate Chuck Norris |
Self-describing |
Chuck Norris rules |
Winstone/HotSpot |
1.424.1 / OK |
lvotypko |
Analysis collector (1.18)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Collects and show results |
Setup collection of checkstyle, findbugs, pdm and warnings results collection |
Results are collected and shown |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Dashboard view (2.1)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Create dashboard view |
Create dashboard view and some portlets |
View as well as portlets are created and shown |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
HTML publisher (0.7)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Record HTML report |
Setup directory containing HTML report |
HTML report is published |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Email-ext (2.14)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Email notification |
Setup email notification and schedule build |
Notification email is sent and delivered |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Batch tasks (1.14)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Execute batch task |
Define batch task in project1, setup executions of this tast in project 2 and schedule a build |
Batch task of project1 is executed |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Jira (1.29)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Update JIRA issue |
Update JIRA issue which is related to changes contained in the build |
JIRA is updated and on build page is a link to appropriate JIRA |
Winstone/HotSpot |
1.424.1 / WARN (plugin reports that server returns HTTP 500, while server is obviously running, not sure, where is the problem) |
vjuranek |
Deploy (1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Deploy on Tomcat 7 |
Build war app and deploy it on Tomcat 7 |
App is successfully deployed and running |
Winstone/oepnJDK |
1.424.1 / OK |
vjuranek |
Dry (2.21)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish DRY analysis results |
Setup CPD analysis and publish analysis results |
Results are published |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Backup (1.6.1)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Backup Jenkins configuration |
Setup backup dir and run Jenkins baskup |
Once no builds run, backup is performed |
Winstone/oepnJDK |
1.424.1 / WARN (backup is executed but fails with java.io.IOException: Unable to add some/random/file) |
vjuranek |
XUnit ()
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish testing tools |
Create Test Result Trend graph |
|
Winstone/HotSpot |
1.424.1 / OK |
lvotypko |
Build timeout (1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Build time out |
Configure build with shorter time out that the duration of the build |
Build is aborted |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Scp publisher (1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Publish artifact over scp |
Setup remote destination and artifact to be archived over scp |
Artifact is archived on remote machine in speficied dir |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
|
|
|
|
|
|
Gradle (1.12)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Gradle build step |
Setup gradle build step |
Gradle build step is executed |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Gradle auto install |
Add Gradle, select "Install automatically" |
Gradle is installed |
Winstone/openJDK |
1.424.2 / OK |
vjuranek |
Groovy (1.9)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Groovy build step |
Setup Groovy build step |
Groovy build step is executed |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Systyem Groovy build step |
Setup system Groovy build step |
System Groovy build step is executed |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Groovy auto install |
Add Groovy, select "Install automatically" |
Groovy is installed |
Winstone/openJDK |
1.424.2 / OK |
vjuranek |
Audit trail (1.7)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Log operations |
Setup audit trail plugin |
Operations like changes job config are logged in audit log |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Job config history (1.11)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Record changes |
Record changes in job config |
Changes are recored and shown |
Winstone/openJDK |
1.424.1 / OK |
vjuranek |
Nested view (1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Create nested view |
Create nested view |
Nested view is created |
Winstone (rpm)/openJDK |
1.424.1 / OK |
vjuranek |
IRC (2.18)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Send IRC notification |
Setup IRC notification and schedule a build |
Notification is send to appropriate IRC channel |
Winstone (rpm)/openJDK |
1.424.1 / OK |
vjuranek |
Run jenkins bot command |
Run bot command on IRC channel |
Command is executed |
Winstone (rpm)/openJDK |
1.424.1 / OK |
vjuranek |
Workspace clean up (0.6)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
|---|---|---|---|---|---|
Delete workspace before build |
Setup delete workspace before build |
Workspace is deleted before build |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |
Delete workspace after build |
Setup delete workspace after build |
Workspace is deleted after build |
Winstone/HotSpot |
1.424.1 / OK |
vjuranek |