<span class="var-sub_title">Big Data and Exascale Computing (BDEC2) Application Roundtable</span> SC18 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Big Data and Exascale Computing (BDEC2) Application Roundtable

Authors: Geoffrey Fox (Indiana University), Rosa Badia (Barcelona Supercomputing Center), Jack Dongarra (University of Tennessee)

Abstract: The emergence of large scale data analytics in science and engineering, and the explosive growth of data generated by new instruments and IoT in edge environments, has disrupted the landscape for exascale computing. The international Big Data and Extreme-Scale Computing (BDEC) initiative is starting a new workshop series, BDEC2, beginning with a comprehensive study of application requirements. This BoF will review the Pathways to Convergence already identified and preview the application requirements to be discussed at the first BDEC2 meeting in November 2018. We will seek input from the SC community on the importance of HPC to such data-intensive applications.

Long Description: The international Big Data and Extreme-scale Computing (BDEC) initiative aims to identify the requirements and needed platform to support scientific research in the emerging world of pervasive computing and Big Data from large and small instruments and the need for linked data analytics and simulations (digital twins) to gain scientific insight. Building on its successful first set of workshops it is following the pathways to convergence identified in the comprehensive summary http://www.exascale.org/bdec/sites/www.exascale.org.bdec/files/whitepapers/bdec_pathways.pdf of these events. BDEC2 plans six further international workshops (over a compressed 2 year period) to enable transnational research communities in a wide range of disciplines to converge on a common approach to supporting big data scientific research consistent with exascale initiatives. More specifically, the BDEC workshop series has three concrete objectives: firstly to draft a design for a distributed services platform for science; secondly to organize and develop a international demonstration of the feasibility and potential of this platform based on a prototype implementation of this design; thirdly to develop a corresponding “shaping strategy” that addresses all the relevant stakeholders and that moves the community as a whole toward convergence on a final, standard specification. Although BDEC/BDEC2 is aimed at scientific research, it must also look at the important commercial cloud/edge computing approaches and commercial use cases that give us critical ideas and technologies.

The BDEC2 workshops are kicked off in October with a meeting devoted to application requirements that will drive the platform and demonstration. The proposed BDEC2 application roundtable at SC18 is aimed at gaining important community input on the work done in our October workshop and the overall Pathway to Convergence identified by the first set of BDEC meetings. The format will be two presentations from BDEC leadership on these two topics followed by community discussions and presentations. The latter will be open to BOF participants but primed by a few selected invited expert presentations. We have developed with NIST a use-case template for capturing both the science and requirements of applications; we will present initial work with this and ask for improvements for the template and further use-case contributions.

With contributions from the US, the EU and Asia, the themes of the BDEC effort intersect with an extremely broad cross section of interests of the SC’18 community.

URL: http://www.exascale.org/bdec/

Back to Birds of a Feather Archive Listing