Dashboard for collaborative science / data processing projects

Posted by rescdsk on Stack Overflow See other posts from Stack Overflow or by rescdsk
Published on 2010-03-19T20:40:23Z Indexed on 2010/03/19 23:51 UTC
Read the original article Hit count: 531

Hi,

Continuous Integration servers like Hudson are a pretty amazing addition to software development. I work in an academic research lab, and I'd love to apply similar principles to scientific data analysis. I want a dashboard-like view of which collections of data are fine, which ones are failing their tests (simple shell scripts, mostly), and so on. A lot like the Chromium dashboard (WARNING: page takes a long time to load).

It takes work from at least 4 people, and maybe 10 or 12 hours of computer time, to bring our data (from behavioral studies) from its raw form to its final, easily-analyzed form. I've tried Hudson and buildbot, but neither is really appropriate to our workflow. We just want to run a bunch of tests on maybe fifty independent collections of subject data, and display the results nicely.

SO! Does anyone have a recommendation of a way to generate this kind of report easily? Or, can you think of a good way to shoehorn this kind of workflow into a continuous integration server? Or, can you recommend a unit testing dashboard that could deal with tests that are little shell scripts rather than little functions?

Thank you!

© Stack Overflow or respective owner

Related posts about continuous-integration

Related posts about scientific-computing