I have written a few scientific applications that required many hours to complete, and spent a lot of time debugging these typical scientific computing problems.

I will talk about architecture for such big data analysis tasks, and how to debug them quickly even if runs take at least overnight to complete, and generate thousands of special cases and exceptions.

I will:

1. Describe standard problems of "application fusion" scripting used in Bioinformatics data analysis.

2. Consider the architectural requirements of open data analyses with software that may be only partially open, and only barely supported by its mother scientific institution.

3. State typical problems solved in this environment, with large multigigabyte datasets and many hours or days of aggregate runtime over the cluster.

4. Show how to address these challenges best with Python and its advanced programming language features.