ACM Student Research Competition
Monitoring Parsl Workflows
Event Type
ACM Student Research Competition
Registration Categories
TimeTuesday, November 13th8:30am - 5pm
DescriptionAs a Python library that enables workflows, Parsl gives users the ability to define complex workflows in Python and run them in parallel on any computer system. This poster describe the process of adding monitoring to Parsl. Simple and comprehensive monitoring of a workflow’s state and resource usage lets users audit, debug, and confirm workflow execution. The poster discusses how Parsl monitors workflow components, what data it captures (task status and resource usage), and the tools it used to do so (Elasticsearch) and to display the information (Kibana). A Kibana dashboard visualizes the collected logs in a real time, with an interactive user interface. This enhanced Parsl allows users the option to monitor the status and resource usage of their workflows via an Elasticsearch database and Kibana dashboard.
Back To Top Button