On my web page <a href="http://pfdubois.com">pfdubois.com</a> is a link to a tar file containing a testing system ("ATS") that works distributed / parallel. Unfortunately the idiosyncratic nature of parallel computing centers in particular means that it has to be localized to that system. While some provision was made for this, I retired before I could spend enough time to 'productize it'. But, LLNL did release it open source so of course you can do that, right? (:->
<br><br>ATS will test any code or set of codes but it is best at codes where the input to them is in Python. And of course it is just for codes that take input args and files and produce a success / fail as indicated by the end status of the run.
<br><br>The good news is it definitely shortens the execution wall time, depending on how many resources you let it have.<br><br><div class="gmail_quote">On Dec 3, 2007 11:36 AM, Kumar McMillan <<a href="mailto:kumar.mcmillan@gmail.com">
kumar.mcmillan@gmail.com</a>> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">On Nov 21, 2007 10:55 AM, Noah Gift <<a href="mailto:noah.gift@gmail.com">
noah.gift@gmail.com</a>> wrote:<br>> I have another "thing" I am working on where I am interesting in doing<br>> massive parallel testing as a current series of thousands of tests<br>> takes over 24 hours. I am extremely ignorant of open source tools in
<br>> Python that do this already, but one Idea I had was to use parallel<br>> python and to setup a bunch of testing nodes:<br>><br>> <a href="http://www.parallelpython.com/" target="_blank">http://www.parallelpython.com/
</a><br>><br>> Is there anything pre-built that someone could recommend?<br><br>Hi Noah.<br><br>This is a very important "thing" you are working on ;) As all of our<br>test suites start to grow, the idea of running tests in parallel
<br>becomes more appealing [1]. I have looked at parallel python and<br>decided it wasn't a good fit as it is designed to optimize a single<br>function. However, I was looking at it from the perspective of<br>building a plugin with it for nose that can run tests in parallel. I
<br>would urge you to check out the threads on the parallel testing plugin<br>for nose idea:<br><a href="http://code.google.com/p/python-nose/issues/detail?id=93" target="_blank">http://code.google.com/p/python-nose/issues/detail?id=93
</a><br><br>...and it would be great if you could try out an implementation.<br>There are a lot of people interested in using a plugin to run<br>nosetests in parallel.<br><br>Alternatively you could look at testoob<br>(<a href="http://testoob.sourceforge.net/" target="_blank">
http://testoob.sourceforge.net/</a>), I'd be curious to see a report from<br>someone who tried to use its parallel testing features. Also, maybe<br>someone on the list can speak about what kind of parallel testing<br>
features py.test offers, as I vaguely recall hearing it supports some,<br>but I could be making that up.<br><br>-Kumar<br><br>[1] tests that automate a browser are the slowest and benefit the most<br>from running in parallel. At my company we have begun experimenting
<br>with Selenium Grid<br>(<a href="http://www.infoq.com/news/2007/09/selenium-grid-parallel-testing" target="_blank">http://www.infoq.com/news/2007/09/selenium-grid-parallel-testing</a>) for<br>this.<br><br>> The Pyvix
<br>> buildbot stuff seems interesting, but I am not sure if that directly<br>> applies for me.<br>><br>> Noah<br>><br>> _______________________________________________<br>> testing-in-python mailing list
<br>> <a href="mailto:testing-in-python@lists.idyll.org">testing-in-python@lists.idyll.org</a><br>> <a href="http://lists.idyll.org/listinfo/testing-in-python" target="_blank">http://lists.idyll.org/listinfo/testing-in-python
</a><br>><br><br>_______________________________________________<br>testing-in-python mailing list<br><a href="mailto:testing-in-python@lists.idyll.org">testing-in-python@lists.idyll.org</a><br><a href="http://lists.idyll.org/listinfo/testing-in-python" target="_blank">
http://lists.idyll.org/listinfo/testing-in-python</a><br></blockquote></div><br>