Authors: Michael Heroux (Sandia National Laboratories, St. John’s University), Pavan Balaji (Argonne National Laboratory), Michelle Mills Strout (University of Arizona), Scott Pakin (Los Alamos National Laboratory)
Abstract: The Supercomputing Conference series has introduced a variety of changes to the technical program in the past few year, to increase inclusivity and quality. Double-blind reviews, a two-phase review process and reproducibility appendices are most notable, along with the schedule adjustments needed to accommodate these additions. In this BoF, four SC19 technical program members will give an overview of the anticipated process for SC19, describing strategies and challenges of authors in previous years and suggesting approaches for future authors. We will also spend a substantial portion of the BoF taking feedback and input from the community for improvements.
Long Description: The Supercomputing Conference series has introduced a variety of changes to the technical program in recent years. All of the changes have been intended to improve inclusivity and promote increased rigor and quality of published papers.
In 2016, a double-blind review process was introduced, where the identity of both the author and reviewer are removed from the review process. Also introduced in 2016 was an artifact description (AD) appendix, which provides a way for authors to describe the computing environment used to produce the computational results of the submission. In 2017, the AD appendix was made mandatory for a paper to be considered for Best Paper or Best Student Paper awards. Also, the Artifact Evaluation (AE) appendix was introduced as an optional section where authors could describe their use of meta-computations to better assure the trustworthiness of their computational results. In 2018, double-blind continued, as did the AD and AE appendices. New to 2018 was the two-phase review with "feather-weight" revision and an opportunity for authors to address reviewer comments with a revised submission that could be further considered for acceptance. Also, the poster and workshop elements of the SC18 Technical Program permitted optional AD appendices.
For 2019, we will continue the double-blind and two-phase review elements. The AD appendix will remain optional for posters and workshops but will become mandatory for all technical papers in 2019 while the AE appendix will remain optional.
In this BOF, four SC19 committee members (Michael Heroux - special advisor on reproducibility to the general conference chair, Pavan Balaji - Technical Program chair, and Scott Pakin and Michelle Mills Strout - technical papers co-chairs) will give an overview of the anticipated process for SC19, describing strategies and challenges of authors in previous years and suggesting approaches for future authors. We will also spend a substantial portion of the BOF taking feedback and input from the community for improvements. We hope attendees will leave the BOF better informed about the SC Technical Program and will help the SC19 Technical Program committees be effective in providing authors the support needed for successful submissions.
Back to Birds of a Feather Archive Listing