[TIP] Getting Weird Coverage Reports

[meme dough]

yes, funcarg test fixtures support session scope which was the second
suggestion.

but, xunit style test fixtures don't support session scope.  Should it
be added with something along the lines of setup_session,
teardown_session in addition to setup_module, teardown_module,
setup_class, teardown_class etc

That keeps test fixture code in test fixture functions (either funcarg
style or xunit style).

Hooks are kept for extending or altering pytest by plugins
(pytest-xdist, pytest-cov) or projects (conftest).

All test fixture functions (either funcarg or xunit style) are invoked
after pytest_sessionstart and before pytest_sessionfinish.

On 26 November 2011 23:34, holger krekel <holger at merlinux.eu> wrote:
> On Sat, Nov 26, 2011 at 21:33 +1100, meme dough wrote:
>> I will consider the implications of moving coverage start earlier, it
>> could be problematic.
>>
>> However, in the first instance pytest_configure is very early and
>> there are 2 approaches you could take immediately.
>>
>> First use pytest_sessionstart instead of pytest_configure for your
>> setup doing a multicall so that cov is called before your setup.
>> Without checking something along the lines of:
>>
>>     def pytest_sessionstart(self,__multicall__, session):
>>         __multicall__.execute()
>>         # your setup here now that coverage is active
>
> In fact, using "__multicall__" is still somewhat of an internal API and
> nowadays it's better to write:
>
>    @pytest.mark.trylast
>    def pytest_sessionstart(self, session):
>
> which should take care to execute this function as late as possible in
> the chain of hook implementations.
>
>> Second, use pytest funcargs for test fixtures.  So have a funcarg
>> which only once per session (cached_setup with session scope) does the
>> setup and teardown that you want.  IMHO funcargs are much better than
>> xunit style test fixtures.
>
> agreed.
>
>> Finally, I don't see any session scope xunit style test fixture.
>> Would it be worth considering adding one?  Some may point out that
>> hooks like pytest_configure or pytest_sessionstart could be used for
>> this purpose, but I think the purpose is actually different.  Having
>> session scope test fixture (funcarg or xunit style) gives a clear
>> place for test fixture code.
>
> not sure what you mean -- funcargs allow a per-session scope, see
> http://pytest.org/latest/funcargs.html?highlight=cached_setup#_pytest.python.FuncargRequest.cached_setup
>
> cheers,
> holger
>