Script of Scripts Polyglot Notebook and Workflow System

Authors: Gao Wang (University of Chicago), Man Chong Leong (Rice University), Bo Peng (University of Texas, MD Anderson Cancer Center)

Abstract: Computationally intensive disciplines such as computational biology often use tools implemented in different languages and analyze data on high-performance computing systems. Although scientific workflow systems can powerfully execute large-scale data-processing, they are not suitable for ad hoc data analysis. Interactive tools such as Jupyter Notebook can be used for data exploration, but it remains difficult to work with multiple scripting languages and to streamline analysis for batch data processing. To bridge the gap between interactive and workflow systems we developed Script of Scripts (SoS), which consists of a polyglot notebook that supports multiple languages in a single notebook and a workflow engine that provides an intuitive syntax for multi-style workflows and a unified interface for executing tasks on a variety of computing platforms. By allowing the use of SoS workflow engine in a polyglot notebook environment, SoS provides a unified environment for both interactive data analysis and batch data processing.

Best Poster Finalist (BP): no

Poster: pdf
Poster summary: PDF


Back to Poster Archive Listing