Manual Tests (LTS 1.409.x)
Installation, upgrade
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Install from RPM |
Install Jenkins from RPM package |
Jenkins is installed without error and runs |
Run on FC 14 ,15 and RHEL 5,6 |
1.409.1 / OK |
vjuranek |
Install from .deb |
Install Jenkins from Debian package |
Jenkins is installed without error and runs |
Debian 6.0 x64 and Debian Testing x86 |
1.409.1 / OK |
markewaite |
Install from war on Tomcat |
Install Jenkins from war by deploying on Tomcat |
Jenkins is deployed and runs |
Deployed on Tomcat 6,7 (FC14, openJDK) |
1.409.1 / OK |
vjuranek |
Install from war on JBoss AS |
Install Jenkins from war by deploying on JBoss AS |
Jenkins is deployed and runs |
Deployed on JBoss AS 6 (FC14, openJDK) |
1.409.1 / OK |
vjuranek |
Install plugins from update center |
Install some plugins from update center |
Selected plugins are installed |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Reload config from disk |
Make some changes directly on disk and launch "Reload Configuration from Disk" |
Made changes are reflected |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / doesn't work for Hudson master config |
vjuranek |
Restart after plugin upgrade |
Launch "Restart when no jobs are running" after plugin upgrade/install |
Jenkins restarts when no jobs are running |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Core functionality
Global configuration
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Add ant installation |
Add existing ant installation |
Ant installation is added |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Add maven installation |
Add existing maven installation |
Maven installation is added |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Setup email notification |
Setup SMTP server, admin email and send test email |
SMTP is setup, test email is sent and delivered |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Freestyle jobs
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Create freestyle job |
Create freestyle job |
Freestyle job is created |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Build rotation |
Setup "Discard Old Builds" and specify number of build to be kept |
Old builds are deleted |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Parametrized build |
Setup parametrized build and check the parameter value |
The appropriate variable is setup and contains right value |
Winstone (rpm)/HotSpot/RHEL6 |
1.400.1 / OK |
vjuranek |
Disable build |
Configure project as diabled |
Project is diabled |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Concurrent builds |
Allow "Execute concurrent builds" in project config and schedule two or more builds |
Builds are executed concurently |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Tie project to a label |
Tie project to a label and schedule a build |
Build is executed on slave with given label |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
SVN checkout |
Configure SVN repository and schedule build |
Project is checkout from SVN |
Winstone (rpm)/openJDK/FC14 |
1.409.1 / OK |
vjuranek |
Ant build step |
Add ant build step and configure ant targets |
Ant targets are executed and finish with success |
Ant-1.8.2/Winstone (rpm)/openJDK/FC14 |
1.409.1 / OK |
vjuranek |
Maven build step |
Add maven build step and configure maven goals |
Maven goals are executed and finish with success |
Maven-3.0.3/Winstone (rpm)/openJDK/FC14 |
1.409.1 / OK |
vjuranek |
Shell builds step |
Add shell build step and setup simple shell script |
Shell script is executed and finish with success |
bash/Winstone (rpm)/openJDK/FC14 |
1.409.1 / OK |
vjuranek |
Archive artifacts |
Setup "Archive artifacts" post-build action |
Artifacts are archived |
Winstone (rpm) |
1.409.1 / OK |
vjuranek |
Publish JavaDoc |
Setup JavaDoc publishing |
JavaDocs are published |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Email notification |
Setup email notification and schedule build |
Notification email is sent and delivered |
Winstone (rpm)/HotSpot/RHEL6 |
1.400.1/ OK |
vjuranek |
Build triggers |
Setup any of build triggers |
|
|
1.409.1 / --- |
— |
Maven jobs
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Create maven job |
Create maven job |
Maven job is created |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
|
|
|
|
|
|
Matrix jobs
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Create matrix job |
Create matrix job |
Matrix job is created |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Combination filter |
Setup combination filter |
Only jobs which pass the filter are build |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Plug-ins
SSH slaves
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Connect ssh slave |
Connect ssh slave by providing login/passwd |
Slave is connected |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
SVN (1.25, 1.26)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Simple checkout |
Setup SVN SCM and do checkout |
Sources are checked out |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Maven (1409.1-Snapshot)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Maven2 build |
Build maven2 project |
Build is executed |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Maven3 build |
Build maven2 project |
Build is executed |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
CVS (1.2)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
|
|
|
|
|
|
Scis-ad ()
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
|
|
|
|
|
|
Green balls (1.10)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Success results |
Success results |
Success results are marke as green |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Git (1.1.9)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Simple checkout |
Add Git SCM and chekcout project |
Project is checked out |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Checkstyle (3.15)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish check-style result |
Configure project to publish check-style result |
Results are published |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Cobertura (1.2,1.3)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish cobertura results |
Configure project to publish cobertura results |
Results are published |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Findbugs (4.23)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish find-bugs results |
Configure project to publish find-bugs results |
Results are published |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
PMD (3.15, 3.21)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish PDM results |
Configure project to publish PDM results |
Results are published |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Warnings (3.16)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish warnings |
Configure project to publish warnings |
Warnings are published |
Winstone (rpm)/HotSpot/RHEL5.6 |
1.409.1 / OK |
vjuranek |
Sonar (1.6.1)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
|
|
|
|
|
|
Disk usage (0.13)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Show values and graphs |
Enable "Show disk usage trend graph on the project page" on global config |
Disk usage number and graphs are shown on project page |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Reflect changes on disk correctly |
Made some changes on disk (e.g. delete workspace) and launch disk usage |
Changes on disk will be reflected in disk usage number |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Violations (0.7.10)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish violations report |
Setup findbug, pmd etc reports and violations reports |
Violations reports are published |
Winstone (rpm)/openJDK/RHEL6 |
1.409.1 / --- |
--- |
Chuck Norris (0.4)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Activate Chuck Norris |
Self-describing |
Chuck Norris rules |
Winstone (rpm)/openJDK/RHEL6 |
1.409.1 / --- |
--- |
Analysis collector (1.13, 1.17)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Collects and show results |
Setup collection of checkstyle, findbugs, pdm and warnings results collection |
Results are collected and shown |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / FAIL |
vjuranek |
Dashboard view (2.0.2)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Create dashboard view |
Create dashboard view and some portlets |
View as well as portlets are created and shown |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
HTML publisher (0.7)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Record HTML report |
Setup directory containing HTML report |
HTML report is published |
Winstone (rpm)/openJDK/RHEL6 |
1.409.1 / --- |
--- |
Tasks ()
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
|
|
|
|
|
|
Jira (1.29)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Update JIRA issue |
Update JIRA issue which is related to changes contained in the build |
JIRA is updated and on build page is a link to appropriate JIRA |
Winstone (rpm)/openJDK/RHEL6 |
1.409.1 / --- |
--- |
Active directory ()
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
|
|
|
|
|
|
Deploy ()
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
|
|
|
|
|
|
Dry (2.20)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish DRY analysis results |
Setup CPD analysis and publish analysis results |
Results are published |
Winstone (rpm)/openJDK/RHEL6 |
1.409.1 / --- |
--- |
Backup (1.6.1)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Backup Jenkins configuration |
Setup backup dir and run Jenkins baskup |
Once no builds run, backup is performed |
Winstone (rpm)/openJDK/RHEL6 |
1.409.1 / --- |
--- |
XUnit ()
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
|
|
|
|
|
|
Build timeout (1.7,1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Build time out |
Configure build with shorter time out that the duration of the build |
Build is aborted |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Scp publisher (1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Publish artifact over scp |
Setup remote destination and artifact to be archived over scp |
Artifact is archived on remote machine in speficied dir |
Winstone (rpm)/openJDK/RHEL6 |
1.409.1 / --- |
--- |
Gradle (1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Gradle build step |
Setup gradle build step |
Gradle build step is executed |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Groovy (1.8)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Groovy build step |
Setup Groovy build step |
Groovy build step is executed |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Systyem Groovy build step |
Setup system Groovy build step |
System Groovy build step is executed |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Job config history (1.11)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Record changes |
Record changes in job config |
Changes are recored and shown |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Nested view (1.7)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Create nested view |
Create nested view |
Nested view is created |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Workspace clean up (0.4)
Test name |
Short description |
Expected result |
Notes |
LTS RC / result |
Tested by |
---|---|---|---|---|---|
Delete workspace before build |
Setup delete workspace before build |
Workspace is deleted before build |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |
Delete workspace after build |
Setup delete workspace after build |
Workspace is deleted after build |
Winstone (rpm)/HotSpot/RHEL6 |
1.409.1 / OK |
vjuranek |