[bip] Bioinformatics Programming Language Shootout, Python performance poopoo'd

[Paulo Nuin]

Titus Brown wrote:

> -> I don't think they would accept to withdraw the paper, especially after 
> -> being reviewed and accepted by the editor. I guess the main problem is 
> -> the reproducibility of the results. We have no idea, except for the 
> -> alignment, what files were used as input. The directions given to get 
> -> similar files are not correct or were not explained adequately in the 
> -> paper. This is where I think the peer review process is at blame, for 
> -> not checking the code (at least testing it to see if it works) and the 
> -> methodology used in obtaining input files. I believe not testing 
> -> programs is quite common in peer-reviewing as I had papers rejected that 
> -> the reviewers never touched the software/code.
> -> 
> -> Apart from blogging about it, one idea would be to submit a response 
> -> article, if not in BMC Bioinformatics, somewhere else.
>
> Have you or Andrew contacted the authors to ask for the raw data?
>
> --titus
>   
I didn't, but I was intending after failing to get the data as described.

Paulo