Talk for the World of AI Driven Tech event in NYC, addressing the global talent gap.

1. Exploring Solutions for Humanity's
Greatest Challenges Across the Omniverse
ALISON B. LOWNDES | SENIOR SCIENTIST | GLOBAL AI

4. MODERN ERA OF GAMING
SYNTHETIC WORLDS AND VISUAL COMPUTING

5. 5
FDL.ai

7. “
“
— Alison, March 2024
embrace failure

8. “
“
— Alison, March 2024
say Yes to imposter syndrome

9. “
“
— Alison, March 2024
be a badass

10. 10
There is a massive disconnect between Joe Public/Enterprise/politicians/policy-makers' non-expert opinion of "terminator" AGI
vs. the research understanding, describing the "general-purpose, generalisation, a broad set of skills, a robust & adaptable to
changing environments" [Anima S52122]. GenAI can now code, change text to image or video in 3D and more, but it's by no
means perfect. Translation does not understand nuance, for example, there is no reasoning, although OpenAI would argue
that GPT is grounded and has reasoning - temperature also controls the determinism (or the hallucination) factor.
Biologically, we don't yet fully understand how our brain reasons. We know we have vast experiences + innate foundational
skills learnt from birth. We also know that AI agents are much faster learners that we are - but it's us that's teaching them via
narrow, defined datasets. Although LLMs can now learn with human feedback, it's still a limited way to teach. An LLM needs
to be combined with a visual model - but that's only 2 of our 5 senses. We also have smell, touch & taste. Touch covers
robotics, movement, haptics. Smell & taste can come later eg AI smoke monitors.
AI needs to combine all stimuli with an internal world model (what Schmidhuber's been doing for years) first with LSTM, then
reinforcement learning.....ongoing.
We are a composition of 5 senses into our brain & spinal column (movement/haptics) + incredible pain & danger system. Our
eyes pull in far more info that we even use hence foveal rendering which follows the fact our peripheral vision works in low-
res, versus what we focus on at ~112M pixels - upper limit - we actually see an average of 576MP until your eyes start to age or
you're born with dodgy lenses which determine how you distinguish objects - the blurring we see or our "visual acuity" which
is the smallest angular separation we can resolve, according to many factors like distance & lighting conditions. I need reading
glasses now - unless I've got excellent light, for example.
Embodied AI must have open-ended objectives, massively multi-task with world knowledge.

11. Blogpost:
https://developer.nvidia.com/blog/gener
ate-stunning-images-with-stable-
diffusion-xl-on-the-nvidia-ai-inference-
platform/
LetsEnhance.io - Image
enhancement powered by AI

12. With NVIDIA DRIVE Sim features such as road
elevation, road markings, islands, traffic
signals, signs, and vertical posts are replicated
at centimeter-level accuracy. Autonomous
vehicles can drive millions of miles in a wide
range of simulated scenarios so they hit the
road running, safely.
NVIDIA DRIVE Sim Turbocharges
Developer Productivity to Get Self-
Driving Cars on the Road

13. NeuralAngelo
13

14. 14

15. Gaussian Splatting
A rasterisation technique vs. neural
methods like NeRF
Image via Dylan Ebert, Hugging Face

16. 16

17. More than 4000 Software Packages in the AI Development Stack
NVIDIA AI Enterprise provides enterprise-grade security and acceleration
DATA PROC
(RAPIDS)
TRAIN
(PyTorch)
OPTIMIZE
(TensorRT)
DEPLOY
(Triton)
NVIDIA CUDA
NVIDIA AI Enterprise
NVIDIA Dependency
3rd party & opensource
Security (CVE) Patching
CVE Patching
API Stability Enterprise Support with SLAs

19. 80 Billion Transistors
4.9 TB/s Bandwidth
NVIDIA H100 TSMC 4N Process

20. Grace CPU

21. NVIDIA H100 GPU

22. Fully Connected with
NVLink Switches

23. One Giant GPU

24. NVIDIA DGX H100

26. NVIDIA Quantum-2
InfiniBand Networking

27. Scaling to Hundreds and
Thousands of DGX Nodes

28. DGX H100
AI Supercomputer

29. INDUSTRIAL DIGITALIZATION
GENERATIVE AI
SUSTAINABILITY

33. 33
Character animation

34. 34

35. 35
35

36. 36
DriveSim Multi-Rate MultiGPU Rendering

37. 37
Sensors

38. https://www.nvidia.com/en-us/high-performance-computing/earth-2/demo/

39. OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD

40. OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Rendering

41. OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Physics
Rendering

42. WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Rendering
Physics
AI

43. SUPERCOMPUTING BRINGS WORLD SIMULATION TO AN INFLECTION POINT
VIRTUAL WORLD
Rendering
Physics
AI

44. Sensors
Controllers
Humans
PHYSICAL WORLD
Real-Time Data
Synchronization
Control Signal
DIGITAL TWINS ARE A NEW CLASS OF WORLD SIMULATION
VIRTUAL WORLD
Rendering
Physic
s
AI

45. 45
EXPLORE OMNIVERSE ENTERPRISE
SEE YOU IN OMNIVERSE
DOWNLOAD OMNIVERSE
nvidia.com/omniverse
DEVELOP ON OMNIVERSE
DOCUMENTATION
docs.omniverse.nvidia.com
FORUMS
omniverse.nvidia.com/forums
TUTORIALS AND
WEBINARS
omniverse.nvidia.com/tutorials
DISCORD
discord.gg/nvidiaomniverse

46. Free AI Technical Training
A Few Clicks Away
Elevate your skills with free AI technical training. For a limited
time, we are offering a complimentary self-paced training course
to new members of our NVIDIA Developer Program.
You can select one of the 16 courses like:
• Getting Started with Deep Learning
• Deploying a Model for Inference at Production Scale
• Fundamentals of Accelerated Computing with CUDA Python
• Synthetic Data Generation for Training Computer Vision Models
• Get Started with Highly Accurate Custom ASR for Speech AI
• Optimizing CUDA Machine Learning Codes with Nsight Profiling
Tools
Seize this free opportunity to embrace the future of technology
at your own pace. Join the Developer Program now and claim your
course today.
https://nvda.ws/3ugFbbo
Join The NVIDIA Developer Program

47. NGC CATALOG
ACCELERATES DEVELOPMENT
Focus on building, not setup
FULLY TRANSPARENT
Quickly identify and deploy the right software
PERFORMANCE OPTIMIZED
Tested across GPU-accelerated Platforms
SOTA models Model resumes Develop once. Deploy anywhere w/ NVIDIA VMI
1.5M+ Users | Millions of Downloads
Detailed security scan reports One click deploy from NGC
Monthly sw container updates
0.9
1.4
1.9
Jun '20 Nov '20 Nov '21
Training
Speedup
Faster Training on the Same
Stack*
*8x NVIDIA A100 40GB. NVIDIA DGX. Resnet-50. Mixed Precision. 256 Batch size.
catalog.ngc.nvidia.com

48. Image by CoPilot Designer
• NVIDIA cuOpt Accelerated Optimization Engine
• Breaks Industry World Records
• Commercial availability
• Navigate increasingly complex routing problems
with flexible solvers, parallelism processing
NVIDIA Accelerated Optimization
developer.nvidia.com/cuopt-logistics-optimization
Enable fast accuracy, performance, and
decision making with dynamic route
optimization

49. The Conference for the
Era of AI and the Metaverse
March 18-21, 2024