[TIP] massive parallel testing in python

Paul Dubois pfdubois at gmail.com
Mon Dec 3 23:54:31 PST 2007

On my web page pfdubois.com is a link to a tar file containing a testing
system ("ATS")  that works distributed / parallel. Unfortunately the
idiosyncratic nature of parallel computing centers in particular means that
it has to be localized to that system. While some provision was made for
this, I retired before I could spend enough time to 'productize it'. But,
LLNL did release it open source so of course you can do that, right? (:->

ATS will test any code or set of codes but it is best at codes where the
input to them is in Python. And of course it is just for codes that take
input args and files and produce a success / fail as indicated by the end
status of the run.

The good news is it definitely shortens the execution wall time, depending
on how many resources you let it have.

On Dec 3, 2007 11:36 AM, Kumar McMillan <kumar.mcmillan at gmail.com> wrote:

> On Nov 21, 2007 10:55 AM, Noah Gift <noah.gift at gmail.com> wrote:
> > I have another "thing" I am working on where I am interesting in doing
> > massive parallel testing as a current series of thousands of tests
> > takes over 24 hours.  I am extremely ignorant of open source tools in
> > Python that do this already, but one Idea I had was to use parallel
> > python and to setup a bunch of testing nodes:
> >
> > http://www.parallelpython.com/
> >
> > Is there anything pre-built that someone could recommend?
> Hi Noah.
> This is a very important "thing" you are working on ;)  As all of our
> test suites start to grow, the idea of running tests in parallel
> becomes more appealing [1].  I have looked at parallel python and
> decided it wasn't a good fit as it is designed to optimize a single
> function.  However, I was looking at it from the perspective of
> building a plugin with it for nose that can run tests in parallel.  I
> would urge you to check out the threads on the parallel testing plugin
> for nose idea:
> http://code.google.com/p/python-nose/issues/detail?id=93
> ...and it would be great if you could try out an implementation.
> There are a lot of people interested in using a plugin to run
> nosetests in parallel.
> Alternatively you could look at testoob
> (http://testoob.sourceforge.net/), I'd be curious to see a report from
> someone who tried to use its parallel testing features.  Also, maybe
> someone on the list can speak about what kind of parallel testing
> features py.test offers, as I vaguely recall hearing it supports some,
> but I could be making that up.
> -Kumar
> [1] tests that automate a browser are the slowest and benefit the most
> from running in parallel.  At my company we have begun experimenting
> with Selenium Grid
> (http://www.infoq.com/news/2007/09/selenium-grid-parallel-testing) for
> this.
> > The Pyvix
> > buildbot stuff seems interesting, but I am not sure if that directly
> > applies for me.
> >
> > Noah
> >
> > _______________________________________________
> > testing-in-python mailing list
> > testing-in-python at lists.idyll.org
> > http://lists.idyll.org/listinfo/testing-in-python
> >
> _______________________________________________
> testing-in-python mailing list
> testing-in-python at lists.idyll.org
> http://lists.idyll.org/listinfo/testing-in-python
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.idyll.org/pipermail/testing-in-python/attachments/20071203/5785f342/attachment.htm 

More information about the testing-in-python mailing list