Python在jenkinstesting?

你怎么让jenkins执行Pythonunit testing案例? 是否有可能从内置unittest包的JUnit样式的XML输出?

样品testing:

tests.py:

 # tests.py import random try: import unittest2 as unittest except ImportError: import unittest class SimpleTest(unittest.TestCase): @unittest.skip("demonstrating skipping") def test_skipped(self): self.fail("shouldn't happen") def test_pass(self): self.assertEqual(10, 7 + 3) def test_fail(self): self.assertEqual(11, 7 + 3) 

JUnit与pytest

运行testing:

 py.test --junitxml results.xml tests.py 

results.xml:

 <?xml version="1.0" encoding="utf-8"?> <testsuite errors="0" failures="1" name="pytest" skips="1" tests="2" time="0.097"> <testcase classname="tests.SimpleTest" name="test_fail" time="0.000301837921143"> <failure message="test failure">self = &lt;tests.SimpleTest testMethod=test_fail&gt; def test_fail(self): &gt; self.assertEqual(11, 7 + 3) E AssertionError: 11 != 10 tests.py:16: AssertionError</failure> </testcase> <testcase classname="tests.SimpleTest" name="test_pass" time="0.000109910964966"/> <testcase classname="tests.SimpleTest" name="test_skipped" time="0.000164031982422"> <skipped message="demonstrating skipping" type="pytest.skip">/home/damien/test-env/lib/python2.6/site-packages/_pytest/unittest.py:119: Skipped: demonstrating skipping</skipped> </testcase> </testsuite> 

JUnit与鼻子

运行testing:

 nosetests --with-xunit 

nosetests.xml:

 <?xml version="1.0" encoding="UTF-8"?> <testsuite name="nosetests" tests="3" errors="0" failures="1" skip="1"> <testcase classname="tests.SimpleTest" name="test_fail" time="0.000"> <failure type="exceptions.AssertionError" message="11 != 10"> <![CDATA[Traceback (most recent call last): File "/opt/python-2.6.1/lib/python2.6/site-packages/unittest2-0.5.1-py2.6.egg/unittest2/case.py", line 340, in run testMethod() File "/home/damien/tests.py", line 16, in test_fail self.assertEqual(11, 7 + 3) File "/opt/python-2.6.1/lib/python2.6/site-packages/unittest2-0.5.1-py2.6.egg/unittest2/case.py", line 521, in assertEqual assertion_func(first, second, msg=msg) File "/opt/python-2.6.1/lib/python2.6/site-packages/unittest2-0.5.1-py2.6.egg/unittest2/case.py", line 514, in _baseAssertEqual raise self.failureException(msg) AssertionError: 11 != 10 ]]> </failure> </testcase> <testcase classname="tests.SimpleTest" name="test_pass" time="0.000"></testcase> <testcase classname="tests.SimpleTest" name="test_skipped" time="0.000"> <skipped type="nose.plugins.skip.SkipTest" message="demonstrating skipping"> <![CDATA[SkipTest: demonstrating skipping ]]> </skipped> </testcase> </testsuite> 

JUnit与nose2

你将需要使用nose2.plugins.junitxml插件。 您可以使用像通常那样的configuration文件来configurationnose2 ,或使用--plugin命令行选项来configuration。

运行testing:

 nose2 --plugin nose2.plugins.junitxml --junit-xml tests 

nose2-junit.xml:

 <testsuite errors="0" failures="1" name="nose2-junit" skips="1" tests="3" time="0.001"> <testcase classname="tests.SimpleTest" name="test_fail" time="0.000126"> <failure message="test failure">Traceback (most recent call last): File "/Users/damien/Work/test2/tests.py", line 18, in test_fail self.assertEqual(11, 7 + 3) AssertionError: 11 != 10 </failure> </testcase> <testcase classname="tests.SimpleTest" name="test_pass" time="0.000095" /> <testcase classname="tests.SimpleTest" name="test_skipped" time="0.000058"> <skipped /> </testcase> </testsuite> 

JUnit和unittest-xml-reporting

将以下内容附加到tests.py

 if __name__ == '__main__': import xmlrunner unittest.main(testRunner=xmlrunner.XMLTestRunner(output='test-reports')) 

运行testing:

 python tests.py 

testing报告/ TEST-SimpleTest的-20131001140629.xml:

 <?xml version="1.0" ?> <testsuite errors="1" failures="0" name="SimpleTest-20131001140629" tests="3" time="0.000"> <testcase classname="SimpleTest" name="test_pass" time="0.000"/> <testcase classname="SimpleTest" name="test_fail" time="0.000"> <error message="11 != 10" type="AssertionError"> <![CDATA[Traceback (most recent call last): File "tests.py", line 16, in test_fail self.assertEqual(11, 7 + 3) AssertionError: 11 != 10 ]]> </error> </testcase> <testcase classname="SimpleTest" name="test_skipped" time="0.000"> <skipped message="demonstrating skipping" type="skip"/> </testcase> <system-out> <![CDATA[]]> </system-out> <system-err> <![CDATA[]]> </system-err> </testsuite> 

我会第二次使用鼻子。 现在内置基本的XML报告。只需使用–with-xunit命令行选项,它将生成一个nosetests.xml文件。 例如:

nosetests –with-xunit

然后添加“发布JUnittesting结果报告”后构build操作,并使用nosetests.xml填充“testing报告XML”字段(假设您在$ WORKSPACE中运行了鼻testing)。

您可以安装unittest-xml-reporting包来添加一个生成XML的testing运行器到内置的unittest

我们使用pytest ,它具有内置的XML输出(这是一个命令行选项)。

无论哪种方式,执行unit testing可以通过运行一个shell命令来完成。

我用nosetests。 有附件可以输出Jenkins的XML

当使用buildout时,我们使用collective.xmltestreport来生成JUnit风格的XML输出,也许它是源代码,或者模块本身可以提供帮助。

 python -m pytest --junit-xml=pytest_unit.xml source_directory/test/unit || true # tests may fail 

从jenkins运行这个shell,你可以把pytest_unit.xml中的报告作为工件。