A whirlwind tour of tech & AI for socio-environmental impact.
Size: 9.28 MB
Language: en
Added: May 29, 2024
Slides: 68 pages
Slide Content
Bits & Pixels
ALISON B. LOWNDES | SENIOR SCIENTIST | GLOBAL AI
2
JOHAN ROCKSTRÖM, ET AL
3
4
5
https://top500.org/lists/green500/2024/06/
6
With NVIDIA DRIVE Sim features such as road
elevation, road markings, islands, traffic
signals, signs, and vertical posts are replicated
at centimeter-level accuracy. Autonomous
vehicles can drive millions of miles in a wide
range of simulated scenarios so they hit the
road running, safely.
NVIDIA DRIVE SimTurbocharges
Developer Productivity to Get Self-
Driving Cars on the Road
Earth-2 Platform
Connecting Complex Simulation, Data and AI Workflows
Renderer
Modulus
Omniverse
Training Inference
Interactive
Visualisation
GPU
acceleratd
Simulation
AI Enterprise
Produce an AI Weather Forecast with a few lines of code
fromearth2studio.models.pximportFCN
fromearth2studio.dataimportGFS
fromearth2studio.ioimportZarrBackend
importearth2studio.runas run
# Load FourCastNetpretrained model
model= FCN.load_model(FCN.load_default_package())
# Create the data source
data= GFS()
# Create a ZarrIOBackend
io= ZarrBackend()
# Run 20 steps of inference
output_datastore= run.deterministic(["2024-01-01"], 20, model, data, io)
https://github.com/NVIDIA/earth2studio
FourCastNet
•10,000x faster
•10,000x more power efficient
•10,000+ ensemble members
•Better prediction of storm tracks
•Reduced uncertainty
https://arxiv.org/pdf/2202.11214
14
Lockheed Martin and NVIDIA Selected by NOAA for Earth Observation
Building a Climate Research Data Pipeline with NVIDIA Omniverse
Anomaly
Detection
AI
Algorithms
Data
Fusion
Sensor
Data
Ground
Data
Satellite
Data
BUILD
PHYSICAL WORLDDIGITAL TWIN
DESIGN OPERATE
SIMULATE
Physics Simulation in Omniverse
Multiple Ways to Ingest and Simulate Physics in Omniverse
NVIDIA PhysX
Rigid & Soft Body Dynamics, Destruction, Fluid & Fire
Import Physics Instance
Offline from External 3rd Party Application
NVIDIA Modulus
Accelerated with Physics-ML Platform
FP8
https://arxiv.org/pdf/2209.05433.pdf
Generative AI Across Industries
Defect Inspection in Factories
Real-Time Asset Tracking Autonomous Planning & NavigationOperational Efficiency in Warehouses
Human-Robot InteractionRobot Programming
LLAMA 2
STABLE DIFFUSION XL STARCODER2
NVIDIA AI Foundation Models
Enterprise-ready, performance optimized models
•State-of-the-art community, commercial and NVIDIA-built
models
•Performance-optimized for NVIDIA GPU-accelerated stack
•Easy model customization and deployment path with
NVIDIA NIM
GEMMA
MOLMIM
MIXTRAL 8X7B
NVIDIA NIM Microservices for Generative AI Inference
Available now as part of NVIDIA AI Enterprise 5.0; $1/GPU/HR
Simplified developmentof AI application
that can run in enterprise environments
Day 0 support for all generative AI models
providing choice across the ecosystem
Best accuracy for enterprise by enabling tuning
with proprietary data sources
Improved TCO with best latency and throughput
running on accelerated infrastructure
Enterprise software with feature branches,
validation and support
Deploy anywhere and maintain
controlof generative AI applications and
data
Optimizedinference engines
NVIDIA NIM
Domain specific code
Support for custom models
Industry standard APIs
DGX &
DGX
Cloud
Prebuilt container and Helm
chart
Announcing NVIDIA Blackwell
The Engine of the New Industrial Revolution
DECOMPRESSION ENGINE
800 GB/s
2nd GEN TRANSFORMER ENGINE
FP4/FP6 Tensor Core
AI SUPERCHIP
208B Transistors
5
th
GENERATION NVLINK
Scales to 576 GPUs
RAS ENGINE
100% In-System
Self-Test
SECURE AI
Full Performance
Encryption & TEE
Built to Democratize Trillion-Parameter AI
20 PetaFLOPS of AI performance on a single GPU
4X Training | 30X Inference | 25X Energy Efficiency & TCO
Expanding AI Datacenter Scale to beyond100K GPUs
“
“
—Marc AndreessenFoundera16z VC
https://pmarca.substack.com/p/why-ai-will-save-the-world
“..what AI could be:
A way to make everything we
care about better.”
25
Free AI Technical Training
A Few Clicks Away
Elevate your skills with free AI technical training. For a limited
time, we are offering a complimentary self-paced training course
to new members of our NVIDIA Developer Program.
You can select one of the 16 courses like:
•Getting Started with Deep Learning
•Deploying a Model for Inference at Production Scale
•Fundamentals of Accelerated Computing with CUDA Python
•Synthetic Data Generation for Training Computer Vision Models
•Get Started with Highly Accurate Custom ASR for Speech AI
•Optimizing CUDA Machine Learning Codes with Nsight Profiling
Tools
Seize this free opportunity to embrace the future of technology
at your own pace. Join the Developer Programnow and claim your
course today.
https://nvda.ws/3ugFbbo
Join The NVIDIA Developer Program
27
NGC CONTAINERS ENABLE YOU TO FOCUS ON BUILDING AI
PERFORMANCE
OPTIMIZED
DEPLOY
ANYWHERE
ENTERPRISE READY SOFTWARE
Scanned for CVEs, malware,
crypto
Tested for reliability
Backed by Enterprise support
Scalable
Updated monthly
Better performance on the same
system
Docker | cri-o | containerd| Singularity
Bare metal, VMs, Kubernetes
Multi-cloud, on-prem, hybrid, edge
https://catalog.ngc.nvidia.com/resources
ASTROPHYSICAL TWINS
Digital twins need not be confined to the Earth
SOLAR DYNAMICS JUPITER’S ATMOSPHERE ROVER ON MARSORBITAL DEBRIS
29
MEETCARTER
CHATTO CARTER
NeuralAngelo
32
33
34
Character animation
35
36
Imitation Learning
Orbital
Sidekick
Orbital Sidekick’s GHOSt2
fleet now in orbit
41
OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Rendering
OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Physics
Rendering
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Rendering
Physics
AI
SUPERCOMPUTING BRINGS WORLD SIMULATION TO AN INFLECTION POINT
VIRTUAL WORLD
Rendering
Physics
AI
Sensors
Controllers
Humans
PHYSICAL WORLD
Real-Time Data
Synchronization
Control Signal
DIGITAL TWINS ARE A NEW CLASS OF WORLD SIMULATION
VIRTUAL WORLD
Rendering
Physic
s
AI
48
EXPLORE OMNIVERSE ENTERPRISE
SEEYOU IN OMNIVERSE
DOWNLOAD OMNIVERSE
nvidia.com/omniverse
DEVELOP ON OMNIVERSE
DOCUMENTATION
docs.omniverse.nvidia.com
FORUMS
omniverse.nvidia.com/forums
TUTORIALS AND
WEBINARS
omniverse.nvidia.com/tutorials
DISCORD
discord.gg/nvidiaomniverse
Activate the Potential Within Your Organization
Across Every Industry and Job Function
Coding Copilot
Summarization
Kinetica Telco Copilot
Telco Customer Service Avatar SAP CRM Assistant
Software Security Analysis
Car Configurator
ServiceNow Customer
Relations Management
World Record Route Optimization
NVIDIA cuOpt
Get Started with NVIDIA API Catalog
•Experience optimized foundation models
•Start prototyping for free
•Deploy anywhere
•Get access to NVIDIA AI Enterprise 90-day eval
ai.nvidia.com
Industrial Metaverse Opportunities Exist at Every Scale
Every physical process will be software-defined
Product
Factory
City
Nation
Planetary
Galaxy
NVIDIA H100 GPU
Fully Connected with
NVLink Switches
One Giant GPU
NVIDIA DGX H100
NVIDIA Quantum-2
InfiniBand Networking
Scaling to Hundreds and
Thousands of DGX Nodes
DGX H100
AI Supercomputer
Chassis
•Multi-Generation Standardized for TTM and
Improved ROI
•Configurable into 100s of Solutions
•Integrates into Cloud and Enterprise Data Centers
Introducing MGX
Open modular server design for accelerated computing
Omniverse OVX Server
2U | x86 | 4 L40 | BF-3 | 2 CX-7 | 6 PCIE
MGX
Open modular server design for accelerated computing
Grace Omniverse OVX Server
2U | Grace | 4 L40 | BF-3 | 2 CX-7 | 6 PCIE
MGX
Open modular server design for accelerated computing
Grace Cloud Graphics Server
2U | Grace | 10 L4 | BF-3 | 11 PCIE
MGX
Open modular server design for accelerated computing
Hopper NVL Gen AI Inference Server
4U | x86 | 8 H100 NVL | 2 BF-3 | 10 PCIE
MGX
Open modular server design for accelerated computing
Grace Hopper Liquid-Cooled Server for HPC
1U | 2 Grace Hopper | 2 BF-3 | 4 PCIE
MGX
Open modular server design for accelerated computing
67
NVIDIA DEVELOPER PROGRAM
TOOLS
JOIN THE COMMUNITY THAT’S CHANGING THE WORLD
•Get exclusive access to an extensive library of NVIDIA software, spanning all of NVIDIA’s technology platforms.
•Save time with ready-to-run, GPU-optimized software, model scripts, and containerized apps from the NVIDIA NGCcatalog.
•Participate in early access programs where you can be one of the first to experience the latest NVIDIA technology.
TRAINING
•Take advantage of research papers, technical documentation, developer blogs, and industry-specific resources.
•Choose from a broad catalog of training options through the NVIDIA Deep Learning Institute (DLI).
•Get unlimited access to NVIDIA On-Demand, the home for NVIDIA resources from GTCs and other leading industry events.
COMMUNITY
•Network with like-minded developers, engage with GPU experts, and contribute to discussions in the developer forums.
•Attend exclusive meetups, GPU hackathons, and events.
•Connect with NVIDIA experts through developer-focused webinars and Instructor-led workshops.
Join the Free Program developer.nvidia.com/join