<span class="var-sub_title">INDIS Afternoon Keynote</span> SC18 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Innovating the Network for Data Intensive Science (INDIS)

INDIS Afternoon Keynote

Authors: Kate Keahey (Argonne National Laboratory)

Abstract: Kate Keahey will give the second keynote on "Chameleon: New Capabilities for Experimental Computer Science". Chameleon is a large-scale, deeply reconfigurable testbed built specifically to explore a broad range of different state-of-the-art hardware options, assess scalability of systems, and provide conditions that allow deep reconfigurability and isolation so that one user does not impact the experiments of another. It currently consists of almost 20,000 cores, over 5PBs of total disk space hosted at the University of Chicago and TACC, and leverages 100 Gbps connection between the sites. The hardware includes a large-scale homogenous compute partition, as well a diversity of configurations and architectures including Infiniband, GPUs, FPGAs, storage hierarchies with a mix of HDDs, SDDs, NVRAM, and high memory as well as non-x86 architectures such as ARMs and Atoms. To support systems experiments, Chameleon provides a configuration system giving users full control of the software stack including root privileges, kernel customization, and console access. To date, Chameleon has supported 2,700+ users working on over 350+ projects.

This talk will describe the evolution of the testbed as well as the current work towards broadening the range of supported experiments. In particular, I will discuss recently deployed hardware and new networking capabilities allowing experimenters to deploy their own switch controllers and experiment with Software Defined Networking (SDN). I will also describe new capabilities targeted at improving experiment management, monitoring, and analysis as well as tying together testbed features to improve experiment repeatability. Finally, I will outline our plans for packaging the Chameleon infrastructure to allow others to reproduce its configuration easily and thereby making the process of configuring a CS testbed more sustainable.

Back to Innovating the Network for Data Intensive Science (INDIS) Archive Listing

Back to Full Workshop Archive Listing