Created by Unknown User (olivergondza), last modified on Aug 03, 2016

 Test results

  • OK - test passed without any problem
  • WARN - there was some problem, functionality doesn't do what is expected, but it doesn't cause failure of whole Jenkins or any other significant problems
  • FAIL - cause failure of whole Jenkins or similar critical issue which affects all jobs (e.g. when plugin is installed, it's not possible to start Jenkins or save configuration of any job)

Acceptance tests

Most of the test has been automated as acceptance tests. Instead of retesting manually, feel free to run the suite and report the results here.

Environment

LTS RC / result

Tested by

 

 

 

Installation, upgrade

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Install from RPM

Install Jenkins from RPM package

Jenkins is installed without error and runs

FC 19, RHEL 6.4, openJDK7


 

Install from .deb

Install Jenkins from Debian package

Jenkins is installed without error and runs

Ubuntu 14.04, OpenJDK 7
Ubuntu 14.04, Oracle JDK 8
Debian Testing x64, Oracle JDK 8
Debian 7 x64, Oracle JDK 7





 

Install from war on Tomcat

Install Jenkins from war by deploying on Tomcat

Jenkins is deployed and runs

Arch, openJDK7, Tomcat 7
Arch, openJDK7, Tomcat 6
AIX, IBM J9 VM 7 SR 7, Tomcat 7



JBoss AS

Install Jenkins from war by deploying on JBoss AS

Jenkins is deployed and runs

Arch, openJDK7, JBoss AS 7

 

 

Core functionality 

Freestyle jobs 

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Batch build step

Add a Windows batch file build step

Batch build steps are executed successfully

 

2.7.2 OK

MarkEWaite

Plug-ins
Jira

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Update JIRA issue

Update JIRA issue which is related to changes contained in the build

JIRA is updated and on build page is a link to appropriate JIRA

 automated - run manually

 

 
Deploy

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Deploy on Tomcat 7

Build war app and deploy it on Tomcat 7

App is successfully deployed and running

automated - run manually

2.7.1 OK
2.7.2 OK

ogondza
ogondza

Xvnc

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Build with xvnc

Tests should correctly use xvnc

Tests are passing

automated - run manually

2.7.2 OK

ogondza

Scp publisher

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Publish artifact over scp

Setup remote destination and artifact to be archived over scp

Artifact is archived on remote machine in speficied dir

automated - run manually

2.7.1 OK
2.7.2 OK

ogondza
ogondza

LDAP

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

LDAP test

LdapPluginTest in test-harness

All tests succeed

automated - run manually

 


LDAP NoDocker Test

LdapPluginNoDockerTest in test-harness

All tests succeed

automated

 

 
Publish Over FTP

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Ftp test

Ftp testin test-harness

All tests succeed

automated - run manually

2.7.2 OK

ogondza

Subversion

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Subversion test

SubversionPluginTest && Subversion_Version154_PluginTest in test-harness

All tests succeed

automated - run manually

 

 
Exploratory Tests

Test name

Short description

Expected result

Notes

LTS RC / result

Tested by

Git plugin

Explore multiple configurations of the Git plugin, including JGit and CliGit implementations, using ssh, https, and git protocol repositories.
Run tests with multiple platforms (Windows, Linux) and multiple git versions (1.7.1, 1.8,1.9, etc.), multiple git configurations (CLI, JGit), multiple providers (GitHub, BitBucket, Assembla, Gitlab, local git repository), and multiple permissions (private repositories, public repositories).

Reasonable behavior, no detected Jenkins related regressions.

 

2.7.1 OK
2.7.2 OK

MarkEWaite
MarkEWaite