Globus and the Integrated Research Infrastructure (IRI)

We review the role of Globus services in the DOE's Integrated Research Infrastructure (IRI).

1. Globus and the IRI

2. Integrating distributed resources – securely and reliably

Science applications

3. Connecting APS and ALCF
3
Advanced
Photon
Source
Theta
Bebop
Cluster
Argonne
Leadership
Computing
Facility
Laboratory
Computing
Research Center
Eagle store
APS
Computing
Orthros Cluster
APS DM system
Portals
Polaris

Compute Agent Globus Connect

4. Beamline and
experiment ID
DM system triggers Globus Flow
during or after data acquisition
env/
$> …
Data acquisition
Eagle Compute endpoint
Globus Compute launches
analysis on behalf of beamline
ALCF APS
Results transferred
to APS or shared in
data portals
Polaris
Globus transfers
APS data to Eagle
APS DM
Metadata
published to
Globus Search
Portal for discovery
and access to data,
and reprocessing
On-demand queues
allow experiment
time analysis
Slide credit: Benoit Côté, Argonne National Lab
Automating for experiment-time processing
Ubiquitous auth, data, compute, flows fabric enables many instrument applications

5. ARGONNE NEXUS

6. Extending the fabric across institutions
6
Alex Hexemer, Wiebke Koepp
David Schissel,
Sterling Smith
Oliver Hoidn, Albert Vong,
Jana Thayer, Ryan Coffee
Nathan Collier, Max
Grover, Forrest Hoffman
Daniel Allan, Stuart
Campbell, Matt Snyder
Bryan Hess, Amitoj Singh,
Cissie Mei
Rafael Ferreira da
Silva, Arjun Shankar,
Tyler Skluzacek
Bill Allcock, Benoit Cote,
Christine Simpson, Aditya
Tanikanti, Tom Uram, Mike
Papka, Steve Henke, Hannah
Parraga, Nicholas Schwarz
Ryan Lewis, Rafael Vescovi,
Casey Stone, Jie Xu, Lily
Robertson, many others
Nicholas Tyler, Pengfei Ding,
Debbie Bard

7. Globus Compute with IRI
workflows

Nicholas Tyler, NERSC
7
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis
with the Earth System Grid Federation and Globus-Flows
Max Grover, Argonne
Enhancing Research
Orchestration Capabilities at
ORNL
Tyler Skluzacek, ORNL
IRI related presentations this week

8. Innovations driven by IRI initiative will benefit
the whole research enterprise
8