Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

The Testopia plug-in integrates Jenkins with Testopia. Testopia plug-in uses testopia-java-apidriver to access Testopia XML-RPC API. With the information that you provide in the build step configuration the plug-in retrieves automated tests from Testopia. With the plug-in, you are able to execute build steps that call testing tools. It reads TestNGJUnit and TAP test report formats, used to update Testopia test cases' executions.

Testopia configuration section

Image RemovedImage Added

Test Execution section

Image RemovedImage Added

Result Seeking Strategy section

Image RemovedImage Added

Tip

You can use environment variables.
Note that the $TESTOPIA_TESTCASE_ALIAS variable is used for naming the .tap file. 

How does the plug-in execute my automated tests?

...

List of environment variables available during Testopia Plug-in execution:

Already implemented:

...

Test run info

...

  • TESTOPIA_TESTRUN_ID
  • TESTOPIA_TESTRUN_BUILD
  • TESTOPIA_TESTRUN_ENVIRONMENT
  • TESTOPIA_TESTRUN_MANAGER
  • TESTOPIA_TESTRUN_NOTES
  • TESTOPIA_TESTRUN_PRODUCT_VERSION
  • TESTOPIA_TESTRUN_SUMMARY
  • TESTOPIA_TESTRUN_CASES
  • TESTOPIA_TESTRUN_PLAN_ID
  • TESTOPIA_TESTRUN_PLAN_TEXT_VERSION
  • TESTOPIA_TESTRUN_RUN_ID
  • TESTOPIA_TESTRUN_STATUS
  • TESTOPIA_TESTRUN_TARGET_COMPLETION
  • TESTOPIA_TESTRUN_PLAN_TARGET_PASS

...

Test case info

...

  • TESTOPIA_TESTCASE_ID
  • TESTOPIA_TESTCASE_RUN_ID
  • TESTOPIA_TESTCASE_BUILD_ID
  • TESTOPIA_TESTCASE_SCRIPT
  • TESTOPIA_TESTCASE_ALIAS

...

  • TESTOPIA_TESTCASE_ARGUMENTS
  • TESTOPIA_TESTCASE_AUTHORREQUIREMENT
  • TESTOPIA_TESTCASE_SORT_KEY
  • TESTOPIA_TESTCASE_SUMMARY
  • TESTOPIA_BUILDTESTCASE_AUTHOR_ID
  • TESTOPIA_TESTPLANTESTCASE_CATEGORY_ID
  • TESTOPIA_ENVIRONMENTTESTCASE_DEFAULT_TESTER_ID
  • TESTOPIA_TESTCASE_PRIORITY_ID
  • TESTOPIA_TESTCASE_STATUS_ID
  • TESTOPIA_TESTCASE_AUTOMATED
  • TESTOPIA_TESTCASE_CREATION_DATE
  • TESTOPIA_TESTCASE_ESTIMATED_TIME
  • TESTOPIA_TESTCASE_ESTIMATED_ENV_ID

How does the plug-in know if a test passed or failed?

You can choose among different result seeking strategies in your job configuration. The plug-in will support three result formatsTestNGJUnit and TAP

Already implemented:

TAP result seeking strategies

TAP file name: The plug-in matches the TAP file name (e.g.: testFtpProtocol.tap) and the key custom field value.

...

Other result seeking strategies

...

TestNG and JUNit strategies will be implemented in a future release.

Does the plugin record the

...

test results in Testopia?

Yes, the plugin will update the testcase in Testopia and set the status according to the result of the testcase.

...

Note

We don't maintain the plug-in for Hudson. Issues happening in Hudson may not be fixed here.

Plugin

1.0

1.1

 

 

 

1.2

1.3 

Testopia

2.5+

 

 

  2.5+

2.5+

2.5+

Jenkins

1.7424+

 

 

 

 

 

 

 

 

1.424+

1.424+

1.424+

Issues

Jira Issues
cacheoff
width850px
anonymoustrue
titleJIRA Issues
urlhttp://issues.jenkins-ci.org/sr/jira.issueviews:searchrequest-xml/temp/SearchRequest.xml?jqlQuery=project+%3D+JENKINS+AND+status+in+%28Open%2C+%22In+Progress%22%2C+Reopened%29+AND+component+%3D+

...

%27testopia-plugin%27&tempMax=1000
height300px

Resources

Testopia Plug-in used TestLink Plug-in as basis. Below you will find resources for Testopia and TestLink plug-ins, as the concept in both plug-ins is very similar.

  1. Article published in Testing Experience magazine issue number 12 (Open Source Tools) written by Bruno P. Kinoshita and Anderson dos Santos. 2010.
  2. Slides used in the lighting talk presented at Encontro Ágil 2010 in IME-USP (Portuguese Only). 2010.
  3. Article published in Automated Software Testing Magazine, volume 3, issue 1. March, 2011.
  4. Slides used in the presentation done in Belgium Testing Days 2011.
  5. Lighting talk for Encontro Ágil 2010, at IME-USP.
  6. More articles and tips on Bruno P. Kinoshita's website.
  7. Presentation at STPCon Spring March 2012 in New Orleans - USA.
  8. Automated Testing Environment by Bugzilla, Testopia and Jenkins by Chin Pin Chang. July, 2014.

Documentation

  1. Various Testopia documentation assembled on Storify
  2. How to handle self signed certificates on Jenkins Server (TestLink Plugin SSL support)

Sponsors

Release Notes

Release 1.3
  1. JUnit and TestNG result seeking strategies
Release 1.0
  1. First version of the plug-in (the development was guided based on the source code of the following plug-ins: TestLink  CCM , Sonar (how to ref maven installations)).

Roadmap

Release 1.1
  1. Keep compatibility with latest versions of Jenkins and Testopia.
  2. Execute Test Suites.
  3. TestNG and JUnit result seeking strategies.

Troubleshooting

  • A test case without a tester assigned doesn't execute.