Python Testing Tools Taxonomy - Python Wiki
Python Wiki Python Wiki / Python Wiki / Archive / Python Testing Tools Taxonomy View as Markdown Python Testing Tools Taxonomy ¶ Legacy Wiki Page This page was migrated from the old MoinMoin-based wiki. Information may be outdated or no longer applicable. For current documentation, see python.org . Join the Testing In Python (TIP) mailing list for Python testing tools discussions! 💡 This wiki page is originated from PyCheeseCake and it was originally created by Grig Gheorghiu Unit Testing Tools ¶ Tool Category Author Part of Claim to fame unittest unit testing Steve Purcell Python standard lib first unit test framework to be included in Python standard library; easy to use by people familiar with the xUnit frameworks; strong support for test organization and reuse via test suites doctest unit testing Tim Peters Python standard lib copy and paste output from shell session; Agile Documentation : unit tests themselves can serve as documentation when combined with epydoc; also see Django’s approach pytest unit testing Holger Krekel It used to be named py.test which was part of the pylib .
Standalone now. no API!;automatic collection of tests; simple asserts; strong support for test fixture/state management via setup/teardown hooks; strong debugging support via customized traceback nose unittest extensions Jason Pellerin unit test framework, used most notably by TurboGears and Pylons ; provides an alternate test discovery and running process for unittest, one that is intended to mimic the behavior of py.test as much as is reasonably possible without resorting to too much magic.
More friendly with unittest. TestCase -based tests than py.test. There are also many plugins available. testify unittest extensions Yelp team unit test framework, provides Enhanced test fixture setup, Split test suites into buckets for easy parallelization, PEP8 naming conventions & Fancy color test runner with lots of logging / reporting option. Trial unittest extensions Jonathan Lange Twisted Extension of unittest to support writing asynchronous unit tests using Deferreds and new result types (‘skip’ and ‘todo’).
Includes a command-line program that does test discovery and integrates with doctest and coverage. subunit unittest extensions Robert Collins Transparently adds support for running unittest test cases/suites in a separate process : prevents system wide changes by a test destabilising the test runner. It also allows reporting from tests in another process into the unittest framework, giving a single integrated test environment. testresources unittest extensions Robert Collins Provides a mechanism for managing ‘resources’ - expensive bits of infrastructure - that are needed by multiple tests.
Resources are constructed and free on demand, but with an optional TestSuite? , the test run order is optimised to reduce the number of resource constructions and releases needed. Compatible with unittest. reahl.tofu unit testing Iwan Vosloo Provides class based test Fixtures, in which several (usually interrelated) objects that need to be set up for tests are lumped together on a single object, called a Fixture. Fixtures are reusable and can depend on other Fixtures in turn.
Fixtures can be used with any test framework, but easy integration is provided for pytest. A few other test utilities are included as well. testtools unittest extensions Jonathan Lange Useful extensions to unittest derived from custom extensions by projects such as Twisted and Bazaar. Sancho unit testing MEMS and Nanotechnology Exchange MEMS Exchange tools Sancho 2.1 runs tests, and provides output for tests that fail; Sancho 2.1 does not count tests passed or failed; targets projects that do not maintain failing tests zope.testing unit testing Zope3 community Powerful test runner that includes support for post-mortem debugging of test failures.
Also includes profiling and coverage reporting. This is a standalone package that has no dependencies on Zope and works just fine with projects that don’t use Zope. pry unit testing Aldo Cortesi Elegant unit testing framework with built-in coverage analysis, profiling, micro-benchmarking and a powerful command-line interface. pythoscope unit testing Michal Kwiatkowski Tool that will automatically, or semi-automatically, generate unit tests for legacy systems written in Python. testlib unittest extensions Logilab logilab-common Gives more power to standard unittest.
More assert* methods; support for module level setup/teardown; skip test feature… pytest tests runner Logilab logilab-common Tests finder / runner. Selectivly run tests; Stop on first failure; Run pdb on failed tests; Colorized reports; Run tests with coverage / profile enabled… dutest unittest extensions Olemis Lang PyOOP package (distributed separately too) An object oriented interface to retrieve unittest test cases out of doctests.
Hides initialization from doctests by allowing setUp and tearDown for each interactive example. Allows control over all the options provided by doctest. Specialized classes allow selective test discovery across a package hierarchy. The following tools are not currently being developed or maintained as far as we can see. They are here for completeness, with last activity date and an indication of what documentation there is.
If you know better, please edit. Tool Last Activity Category Author Claim to fame TestOOB 2009 unittest extensions Ori Peleg unittest enhancements; test filtering via regex/glob patterns; reporting in XML/HTML; colorized output; runs pdb on failing tests; run in parallel in threads/processes; verbose asserts; report failures immediately; and a little more; pyUnitPerf 2009 performance-based unit testing Grig Gheorghiu port of JUnitPerf ; transparently adds performance testing capabilities to existing unitttest-based test suites Peckcheck 2008 specification-based unit testing Darius Bacon like the unittest module, except that test methods may take arguments; you declare each argument with a default value which names a test-data generator and the peckcheck module will peck at your test methods with a bunch of generated values testosterone 2008 unit testing Chad Whitacre A manly test runner; command-line and curses(3) interfaces; the iPod of test runners. (More seriously, makes it easier to browse and inspect your test failures) qunittest 2004 unit testing Edgewall Easy-to-use ( PyQt ) GUI framework and application for use with the Python unit testing framework.
It can be used to conveniently execute unit tests and suites, and then display the results in a useful fashion. Mock Testing Tools ¶ See also here for a side-by-side syntax comparison between some of the more popular tools in this space. Tool Category Author Claim to fame Ludibrio mocks, stubs, spy, and dummies Gustavo Rezende Elegant test doubles framework in Python (mocks, stubs, spy, and dummies) Python Mock mock testing Dave Kirby Python Mock enables the easy creation of mock objects that can be used to emulate the behaviour of any class that the code under test depends on.
You can set up expectations about the calls that are made to the mock object, and examine the history of calls made. This makes it easier to unit test classes in isolation. Download it here. PyMock mock testing Jeff Younker PyMock is based on the Java easymock package. It uses a recording and replay model rather than using a specification language. Easymock lives up to its name compared to other mocking packages. PyMock takes advantage of python’s dynamic nature for futher improvements. mock mock testing Michael Foord aka Fuzzyman Provides “action -> assertion” mocking patter, instead of standard “record -> replay” pattern pMock mock testing Graham Carlyle Inspired by the Java jMock library, pMock makes the writing of unit tests using mock object techniques easier.
Development of pmock has long since stopped and so it can be considered dead. minimock mock testing Ian Bicking Embeds mock testing
The rest of this page is on the live site.