BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:America/Chicago
X-LIC-LOCATION:America/Chicago
BEGIN:DAYLIGHT
TZOFFSETFROM:-0600
TZOFFSETTO:-0500
TZNAME:CDT
DTSTART:19700308T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0500
TZOFFSETTO:-0600
TZNAME:CST
DTSTART:19701101T020000
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20181221T160725Z
LOCATION:D172
DTSTART;TZID=America/Chicago:20181111T103000
DTEND;TZID=America/Chicago:20181111T111000
UID:submissions.supercomputing.org_SC18_sess148_pec301@linklings.com
SUMMARY:ReFrame: A Regression Testing and Continuous Integration Framework
  for HPC systems
DESCRIPTION:Workshop\nCollaborative Environments, Reproducibility, System 
 Administration, System Software, Tools, Workshop Reg Pass, HPC\n\nReFrame:
  A Regression Testing and Continuous Integration Framework for HPC systems
 \n\nKarakasis\n\nRegression testing of HPC systems is of crucial importanc
 e when it comes to ensure the quality of service offered to the end users.
  At the same time, it poses a great challenge to the systems and applicati
 on engineers to continuously maintain regression tests that cover as many 
 aspects as possible of the user experience. In this presentation, we intro
 duce ReFrame, a new framework for writing regression tests for HPC systems
 . ReFrame is designed to abstract away the complexity of the interactions 
 with the system and separate the logic of a regression test from the low-l
 evel details, which pertain to the system configuration and setup. Regress
 ion tests in ReFrame are simple Python classes that specify the basic para
 meters of the test plus any additional logic. The framework will load the 
 test and send it down a well-defined pipeline which will take care of its 
 execution. All the system interaction details, such as programming environ
 ment switching, compilation, job submission, job status query, sanity chec
 king and performance assessment, are performed by the different pipeline s
 tages. Thanks to its high-level abstractions and modular design, ReFrame c
 an also serve as a tool for continuous integration (CI) of scientific soft
 ware, complementary to other well-known CI solutions. Finally, we present 
 the use cases of two large HPC centers that have adopted or are now adopti
 ng ReFrame for regression testing of their computing facilities.
URL:https://sc18.supercomputing.org/presentation/?id=pec301&sess=sess148
END:VEVENT
END:VCALENDAR