Simsala Script Collection

A collection of scripts to execute benchmarking jobs on slurm clusters or locally.

Open-source MIT Licensed. GitLab

Benchmark on slurm clusters

Generate tasks which can be run by slurm to be automatically distributed on clusters.

Benchmark on individual hosts

Seamlessly use GNU Parallel to run benchmarks on hosts without other management.

Limit resources

Use any tool for resource limitation, e.g. RunLim or BenchExec, as long as it outputs it's data somewhere in a parseable log format.

Extract structured data from logs

Use SQLite to extract information from logs into a database.

Generate tables

Use self- and or pre-written SQL queries to extract tabular data from benchmark runs. Compare different configurations without programming ad-hoc pipelines.

Generate charts

Use already finished or specifically crafted scripts or directly use Gnuplot yourself, to convert the data into meaningful graphs.