Nov. 17-22, 2024, Atlanta, Georgia

JUmPER: Performance Data Monitoring, Instrumentation and Visualization for Jupyter Notebooks

Date: Friday, November 22, 2024, 11:00 AM - 11:30 AM

Room: B315

Type: Workshop

Description: Computational performance, e.g. CPU or GPU utilization, is crucial for analyzing machine learning (ML) applications and their resource- efficient deployment. However, the ML community often lacks accessible tools for holistic performance engineering, especially during exploratory programming such as implemented by Jupyter. Therefore, we present JUmPER, a Jupyter kernel that supports coarse- grained performance monitoring and fine-grained analysis tasks of user code in Jupyter. JUmPER collects system metrics and stores them alongside executed user code. Built-in Jupyter magic commands provide visualizations of the monitored performance data directly in Jupyter. Additionally, code instrumentation can be enabled to collect performance events using Score-P. JUmPER preserves the exploratory programming experience by seamlessly integrating with Jupyter and reducing kernel runtime overhead through in-memory (pipe) communication and parallel marshalling of Python's interpreter state for the Score-P execution. JUmPER thus provides a low-hurdle infrastructure for performance engineering in Jupyter and supports resource-efficient ML applications.

Links: Official link from SC24

Back to overviewPrev