There will be multiple opportunities to interact with IRI committee members, learn about the IRI program, and see demonstrations of IRI capabilities at the SC24 conference.

IRI Activities at SC24

Monday, November 18, 2024

Time Location Event
9:10am Room B305 INDIS workshop — Keynote, Ben Brown (DOE): DOE's Integrated Research Infrastructure in the AI Era
7:00pm DOE Booth 3401 The Plasma Physics and Fusion Energy Pathfinder demonstration at the Grand Opening Gala Reception

Tuesday, November 19, 2024

Time Location Event
11:00am DOE Booth 3401 EJFAT Demonstration — ESnet-JLab FPGA Accelerated Transport (EJFAT) Load Balancer is a collaboration between staff at ESnet and Jefferson Lab, designed to seamlessly integrate edge and cluster computing. It will show real time streaming from JLab to NERSC, ORNL and FABRIC. EJFAT is an IRI Testbed project.
1:00pm DOE Booth 3401 IRI Early Technologies and Applications Demos — The DOE’s Integrated Research Infrastructure aims to empower researchers to meld DOE’s world-class research tools, infrastructure, and user facilities seamlessly and securely in novel ways to radically accelerate discovery and innovation. The tools and technology emerging from this effort are already beginning to open up new avenues to how we use experimental and computational scientific instruments together. This session will show video demos of technologies and applications that define the current state of practice for time-sensitive, data integration-intensive, and long-term campaign patterns. As entry points into this new design space, they show a glimpse of what could be achieved if we coordinate to meet the difficult challenges of deploying IRI.
2:00pm DOE Booth 3401 IRI Office Hours — National Laboratory staff working on IRI will be available to answer questions about the IRI program
5:15pm Room B212 BoF: Workflows Community: Collaborative Pathways for Designing an Integrated Infrastructure for Research Excellence — Speaker, Ben Brown (DOE): Advancing DOE's Integrated Research Infrastructure

Wednesday, November 20, 2024

Time Location Event
10:00am DOE Booth 3401 IRI Early Technologies and Applications Demos — The DOE’s Integrated Research Infrastructure aims to empower researchers to meld DOE’s world-class research tools, infrastructure, and user facilities seamlessly and securely in novel ways to radically accelerate discovery and innovation. The tools and technology emerging from this effort are already beginning to open up new avenues to how we use experimental and computational scientific instruments together. This session will show video demos of technologies and applications that define the current state of practice for time-sensitive, data integration-intensive, and long-term campaign patterns. As entry points into this new design space, they show a glimpse of what could be achieved if we coordinate to meet the difficult challenges of deploying IRI.
2:00pm DOE Booth 3401 EJFAT Demonstration — ESnet-JLab FPGA Accelerated Transport (EJFAT) Load Balancer is a collaboration between staff at ESnet and Jefferson Lab, designed to seamlessly integrate edge and cluster computing. It will show real time streaming from JLab to NERSC, ORNL and FABRIC. EJFAT is an IRI Testbed project.
2:00pm DOE Booth 3401 IRI Office Hours — National Laboratory staff working on IRI will be available to answer questions about the IRI program
3:00pm DOE Booth 3401 Advanced Photon Source Experiment Workflow Demonstration — This demonstration showcases the use of the ALCF Polaris supercomputer for processing data (both online and offline) from Advanced Photon Source (APS) experiments in near real-time, using features of Globus Compute to create end-to-end data workflows.
4:00pm DOE Booth 3401 Implementing Time-Critical Streaming Science Patterns Using Distributed Computational Facilities — This talk highlights the achievements, the current state and the future directions of EJFAT (ESnet JLab FPGA-Accelerated Transport) project in enabling real-time seamless streaming of scientific data at Terabit rates between instruments and widely distributed processing facilities. This real-time linking of the experimental and computational resources of the U.S. research enterprise is central to the Department of Energy concepts of IRI (Integrated Research Infrastructure) for the future of how science is done. It fully aligns with ESnet's vision for the role the network should play in supporting cutting edge research and is critical to the design of the High-Performance Data Facility (HPDF) led by JLab. In this talk we will describe the custom hardware developed by ESnet, as well as the software framework developed by ESnet and JLab to build this technologically unique solution.

Thursday, November 21, 2024

Time Location Event
11:30am DOE Booth 3401 The DOE's Integrated Research Infrastructure (IRI) Program Overview — Debbie Bard (NERSC), Ryan Adamson (ORNL) — This presentation provides an overview of the Department of Energy's Integrated Research Infrastructure (IRI) program, a comprehensive initiative designed to enhance and interconnect scientific research facilities across the nation. We will discuss how the IRI program aims to create a cohesive network of state-of-the-art laboratories, computational resources, and data sharing platforms. The talk will offer a brief overview of the program's mission and goals, and Technical Subcommittees (TS) work, with particular emphasis on the TRUSTID TS.
12:15pm Room B311 BoF: IRI: What Novel Interfaces Will HPC Expose for Cross-Facility Workflows? — DOE has recently launched the Integrated Research Infrastructure (IRI) program, which is designed to enable new modes of integrated science across DOE user facilities. Common or unified interfaces are needed for these workflows to seamlessly orchestrate resources across high-performance computing, data, and network providers. These interfaces could be REST APIs for programmable workflows, expansive UIs like JupyterLab, or deep integration with external workflow orchestrators. This BoF will summarize the current efforts of the IRI interfaces working group and individual ASCR user facilities to develop new interfaces. We invite the community to provide feedback to help guide these IRI efforts.
12:40pm SCinet Theater, Booth 2049 DELERIA/SciStream Talk — Distributed Event-Level Experiment Readout and Integrated Analysis (DELERIA) enables the online analysis of data streamed from physics experiments across multiple scientific facilities using distributed workflow tools. SciStream is a middlebox-based architecture with control protocols that focuses on security and integration with federated identity management systems, such as Globus Auth, ensuring that memory-to-memory data streaming between federated entities (i.e., producers and consumers) is secure and efficient.
The team will demonstrate on-demand memory-to-memory streaming of scientific data using DELERIA over SciStream across SCinet facilities, the ESnet Testbed, Argonne National Laboratory resources, and the StarLight Testbed. The team will also show SciStream’s support for establishing authenticated, end-to-end connections between different facilities. This will show the use of SciStream on a real WAN with DELERIA, a real scientific data streaming application, and multiple WAN connections.

IRI-adjacent Activities at SC24

There will be several sessions, events, workshops, and demonstrations that illustrate aspects of the IRI ecosystem, including workflows, design patterns, and specific technologies. While these are not explicitly part of the IRI program, conference attendees who are interested in IRI might find these activities to be of particular interest.

Sunday, November 17, 2024

Time Location Event
9am-5:30pm Room B313 XLOOP Workshop — The XLOOP workshop often showcases tools, technologies, and workflows that exhibit the Time Sensitive IRI pattern. In addition, because XLOOP focuses on computing and experiments in a synergistic and collaborative relationship, the ideas presented at XLOOP may be of particular interest to attendees interested in IRI.

Tuesday, November 19, 2024

Time Location Event
12:15-1:15pm Room B213 BoF: Real-Time Scientific Data Streaming to HPC Nodes: Challenges and Innovations — This BoF discusses this alternative way of using HPC by opening with a science use case that exemplifies this new class of emerging workflows. Through a set of lightning talks from user facilities, the BoF will survey how HPC centers address this need today and what they have planned for the near future. These presentations aim to seed the ensuing discussion where the audience can ask questions to key staff of HPC facilities or can bring their specific streaming workflow to the attention of the workflow community.
5:15-6:45pm Room B212 BoF: Workflows Community: Collaborative Pathways for Designing an Integrated Infrastructure for Research Excellence — In this BoF session, we will deepen the discourse initiated during the previous BoF sessions and elevate these discussions by incorporating a wider array of perspectives, including those of scientists who develop and utilize these workflow systems within their specific domains. By examining the challenges and opportunities within multi-facility workflows, the session will explore themes such as near real-time processing and integration of data from multiple sources and further discuss the topics of coordination among different computing and experimental facilities, and co-design of experiment facilities. This initiative is motivated by the need to address the continuum of workflows that demand uninterrupted computing access and multi-facility workflows that enhance resilience and efficiency across distributed environments.

Wednesday, November 20, 2024

Time Location Event
3:15pm DOE Booth 3401 High Performance Data Facility Status and Plans — Graham Heyes (JLab) — In October of 2023, the DOE awarded the lead of the High-Performance Data Facility project to the Thomas Jefferson National Accelerator Facility in partnership with Lawrence Berkeley National Laboratory. This presentation will discuss where we are today and our plans for the future of the project.