P-RECS 2018 – June 11, 2018

First International Workshop on Practical Reproducible Evaluation of Computer Systems

June 11, 2018

This workshop will focus heavily on practical, actionable aspects of reproducibility in broad areas of computational science and data exploration, with special emphasis on issues in which community collaboration can be essential for adopting novel methodologies, techniques and frameworks aimed at addressing some of the challenges we face today. The workshop will bring together researchers and experts to share experiences and advance the state of the art in the reproducible evaluation of computer systems, featuring contributed papers and invited talks.

Topics

We expect submissions from topics such as, but not limited to:

  • Experiment dependency management.
  • Software citation and persistence.
  • Data versioning and preservation.
  • Provenance of data-intensive experiments.
  • Tools and techniques for incorporating provenance into publications.
  • Automated experiment execution and validation.
  • Experiment portability for code, performance, and related metrics.
  • Experiment discoverability for re-use.
  • Cost-benefit analysis frameworks for reproducibility.
  • Usability and adaptability of reproducibility frameworks into already-established domain-specific tools.
  • Long-term artifact archiving for future reproducibility.
  • Frameworks for sociological constructs to incentivize paradigm shifts.
  • Policies around publication of articles/software.
  • Blinding and selecting artifacts for review while maintaining history.
  • Reproducibility-aware computational infrastructure.

 

Organizers

 

Important Dates

  • Submissions due: April 2, 2018
  • Acceptance notification: April 30, 2018
  • Camera-ready paper submission: May 6, 2018
  • Workshop: June 11, 2018

 

For Submission and other information please see link below:

Leave a Reply

Your email address will not be published. Required fields are marked *