DataMill: Rigorous Empirical Performance Evaluation Made Easy, Prof. Sebastian Fischmeister

Description

Empirical systems research is facing a dilemma. Minor aspects of an experimental setup can have a significant impact on its associated performance measurements and potentially invalidate conclusions drawn from them. The growth in complexity and size of modern systems will further aggravate this dilemma, especially with the given time pressure of producing results. So how can one trust any reported empirical analysis of a new idea or concept in computer science? This talk introduces DataMill, a community-based easy-to-use services-oriented open benchmarking infrastructure for performance evaluation of single computer experiments. DataMill facilitates producing robust, reliable, and reproducible results.

Period	17 Dec 2014
Event type	Guest talk
Location	AustriaShow on map