[TIP] runTest?

[Chris Jerdonek]

In my experience, I've never needed to add a runTest() method to TestCase
classes, and if a TestCase class lacks any test methods, it will simply run
no tests -- not try to run "runTest." If you look at unittest's source
code, you'll see that "runTest" is the default test name if no method name
is passed to TestCase's constructor. I'm guessing the behavior you're
experiencing is due to a custom test runner or discovery or some other
customization under your control. I've never seen this behavior from
out-of-the-box uses of unittest.

--Chris


On Tue, Aug 27, 2019 at 1:40 PM Dan Stromberg <drsalists at gmail.com> wrote:

>
> It calls each "important" test in turn.  It's like a poor-person's
> discovery. If a test is left out of runTest by accident, it gets ignored.
>
> Like:
>     def runTest(self):
>         assert self.test_red()
>         assert self.test_green()
>         assert self.test_blue()
>
> Or:
>         def runTest(self):
>             self.test_anomaly_post()
>             self.test_feature_get()
>             self.test_feature_put()
>
> Thanks for asking.
>
>
> On Tue, Aug 27, 2019 at 1:34 PM Chris Jerdonek <chris.jerdonek at gmail.com>
> wrote:
>
>> Why does each of your classes have a runTest method in the first place?
>> What is its purpose —- what does it do?
>>
>> —Chris
>>
>> On Tue, Aug 27, 2019 at 12:51 PM Dan Stromberg <drsalists at gmail.com>
>> wrote:
>>
>>>
>>> Hi folks.
>>>
>>> I'm working on a large Python 3/Python 2 codebase that has several
>>> automated test cases and test classes.  I know Python 2 is going away soon.
>>>
>>> We have lots of test* methods in classes that inherit
>>> from unittest.TestCase. Each of those classes also provides a runTest
>>> method.
>>>
>>> It's bugging me that the runTest method is getting used, and the test*
>>> methods are getting ignored, unless we call the test* methods from the
>>> runTest method.
>>>
>>> In fact, if I rename the runTest method from a test class to something
>>> unused, I get a traceback:
>>> runTest (tests.test_disposable_locks.TestDisposableLocks)
>>> No test ... Traceback (most recent call last):
>>>   File "test_runner.py", line 98, in <module>
>>>     sys.exit(main())
>>>   File "test_runner.py", line 90, in main
>>>     result = runner.run(test_suite)
>>>   File "/usr/lib/python3.6/unittest/runner.py", line 176, in run
>>>     test(result)
>>>   File "/usr/lib/python3.6/unittest/suite.py", line 84, in __call__
>>>     return self.run(*args, **kwds)
>>>   File "/usr/lib/python3.6/unittest/suite.py", line 122, in run
>>>     test(result)
>>>   File "/usr/lib/python3.6/unittest/case.py", line 653, in __call__
>>>     return self.run(*args, **kwds)
>>>   File "/usr/lib/python3.6/unittest/case.py", line 580, in run
>>>     testMethod = getattr(self, self._testMethodName)
>>> AttributeError: 'TestDisposableLocks' object has no attribute 'runTest'
>>>
>>> I've been pulling my hair out trying to figure out why unittest is
>>> preferring runTest over test*.  Isn't unittest supposed to fall back on
>>> runTest only if there are no test* methods?
>>>
>>> Or do I need something like:
>>> suite = unittest.TestLoader().loadTestsFromTestCase(WidgetTestCase)
>>> (from https://docs.python.org/2/library/unittest.html)
>>> ?  I tried getting this going with pytest a while back, but eventually
>>> set the project aside a while - maybe that was where I got the idea that
>>> runTest should be ignored if test* methods are present....
>>>
>>> I still hope to use pytest with this code at some point, but for now I'd
>>> be happy if the unittest test discovery just worked the way I expect.  My
>>> main goals for switching to pytest is to parallelise the tests, and to stop
>>> having to list "important" tests in a runTest method lest they be ignored.
>>>
>>> Also, I'm finding that sometimes raising an exception terminates the
>>> testing for the entire suite, rather than leading to a failed/errored test
>>> and continuing, presumably because "runTest" is "the test", so if it errors
>>> out anywhere, that's it for "that test".  If pytest can help with that,
>>> that'd be awesome.
>>>
>>> What can I do to get runTest out of the mix when test* methods are
>>> present?
>>>
>>> Thanks!
>>>
>>> _______________________________________________
>>> testing-in-python mailing list
>>> testing-in-python at lists.idyll.org
>>> http://lists.idyll.org/listinfo/testing-in-python
>>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.idyll.org/pipermail/testing-in-python/attachments/20190827/88bdd649/attachment-0001.htm>