Script of Scripts Polyglot Notebook and Workflow System
TimeThursday, November 15th8:30am - 5pm
DescriptionComputationally intensive disciplines such as computational biology often use tools implemented in different languages and analyze data on high-performance computing systems. Although scientific workflow systems can powerfully execute large-scale data-processing, they are not suitable for ad hoc data analysis. Interactive tools such as Jupyter Notebook can be used for data exploration, but it remains difficult to work with multiple scripting languages and to streamline analysis for batch data processing. To bridge the gap between interactive and workflow systems we developed Script of Scripts (SoS), which consists of a polyglot notebook that supports multiple languages in a single notebook and a workflow engine that provides an intuitive syntax for multi-style workflows and a unified interface for executing tasks on a variety of computing platforms. By allowing the use of SoS workflow engine in a polyglot notebook environment, SoS provides a unified environment for both interactive data analysis and batch data processing.