Sri Ambati's keynote presentation at Wells Fargo Day in San Francisco, April 2024

1. H2O.ai Confidential
Democratize AI with H2O.ai
8
7
222OF
THE
H2O
OF THE TOP 10
BANKS
OF THE TOP 10
4 OF THE TOP 10
MANUFACTURING
COMPANIES
INSURANCE
COMPANIES
FORTUNE
500
CUSTOMER OBSESSION
MAKER CULTURE
Commonwealth Bank, Goldman Sachs,
Wells Fargo, NVIDIA, Capital One, Nexus
Ventures, New York Life
2M
Community
30
Kaggle Grandmasters
2012
FOUNDED IN
SILICON VALLEY
$256M
FUNDRAISED,
SUSTAINABLE

2. Open Source is freedom, not free!

3. Democratize AI

4. AI for Good

5. H2O.ai Confidential
H2O.ai Confidential
H2O products are backed by 10% of the World’s Data Science
Grandmasters and a Team of Experts who are relentless in
solving critical problems.
KAGGLE GRANDMASTERS World’s Best Data Scientists
2 Quadruple GMs
1 Triple GM
7 Double GMs
#1 KGM
#3 KGM
5 Top 10 Globally
10 Kaggle Masters
H2O.ai KGM HIGHLIGHTS
● 2023 H2O KGMs win 3
healthcare-related
competitions
● July 2023 H2O KGMs make
“Top GenAI Scientists” list
● Oct 2023 H2O paper accepted
at EMNLP 2023
● Nov 2023 H2O KGMs win 1st
place in Kaggle Science Exam
competition
● Jan 2024 H2O KGM places 2nd
in Detect AI Text competition
● Feb 2024 introduced
foundational model
H2O-Danube 1.8b

6. Co-create

7. H2O.ai Confidential
Generative AI
Predictive AI
Generative AI
AWARD-WINNING AUTOML reaches
a new audience with chat & function
calling assistants for ML
Enhanced AI for Documents
Automation for data labeling
Automation of code for AI Apps
CUSTOMGPTS: H2O foundational
models, fine-tuned models, personality,
on top of predictive models
Convergence of World’s best Predictive and Generative AI
GenAI Apps
Enterprise h2oGPTe: Python
APIs and UI for chat, RAG
customGPTs
Function-calling & Agents
Prompt Tuning
Foundational Models
document and data labeling
on-premise, air-gapped,
cloud VPC | SaaS
+

8. H2O.ai Confidential
GenAI AppStudio
Structured
Datasets
Unstructured
Datasets
ETL / Prep for LLMs
Documents → QA Pairs
Fine Tuning LLMs
(& Prompts)
End Users
Vector DB
(Embeddings
)
myGPT
R. A. G.
Talk to your Data
Document QA
Document Chat
Image/Video Chat
LLM Query
GenAI Apps
+ +
+ +
+
+
LLM
Data Studio
AI Engines MLOps
EvalStudio
AI Apps
+ LLMs
Integration
LLMOps
API
Prompt
Studio
Continuous
Feedback
Parsing . Chunking
Indexing . Embeddings
LLM Agents
Chat / QA
Prompt Engineering
LLM
Workers
Enterprise h2oGPTe (RAG)
Make Your
Own Eval
Predictive AI Layer Predictive + Gen AI
h2o-functions
World’s Best AI to do Gen AI
Tabular
Data

9. Raise a forest, not just a tree.
Make ecosystems

10. H2O.ai Confidential
Hyperscalers
Technology
VARs/
Distributors
Successful Partnerships
Reduce complexity of the
sales process through
Marketplace. Collaborative
sales strategy.
Co-sell and integration to
accelerate inferencing on
end-to-end workflows.
Gain business agility with
faster time to market
Simplified procurement process,
flexible terms, simplified
deployment. Seamless integration
with cloud providers solutions.
Flexible deployment options,
Breakthrough cost reduction and
ROI. Secure, data never leaves the
environment
Access to expertise, custom
solutions, and seamless
integration, reducing the pain and
time of ML/Gen AI adoption
Strategic Fit Customer Value
Industry
Co-create GenAI solutions
related to various industry
specific problem statements
Faster time to market, rapid
innovation and developing
cutting-edge GenAI offerings
Public Sector Expansion into new agencies
Access to enterprise ready
solutions

11. Tech Ecosystem of H2O GenAI
OPEN SOURCE MODELS
VECTOR DATABASES
CLOSE SOURCE MODELS
LLM INFERENCING HARDWARE MODEL
HOSTING
CLOUD PROVIDERS

12. Thank you, Community.
Gratitude.
Makers, past, present and future!
H2O Movement
Community and Customers!
To all greatness, our greetings
endaro mahanubhavulu

13. Data Scientist = 100% data
Business Unit = 85% data, 15% storytelling
Executive = 15% data, 85% storytelling
Board = 99% storytelling
GrandPa = 100% storytelling

14. Prompt is your intellectual property

15. Everyone needs their own GPT

16. Every Nation needs to be an AI Nation

17. Private
On-prem, behind your firewall
Sovereign Data
Sovereign AI

18. H2O.ai Confidential
Documents
Data Sources
LLM
DataStudio myGPT
LLM
EvalStudio
Vector DB
(Embeddings)
Alternative
Datasets
Query + Documents
(Context)
Talk to Your Data
Ques Answers
Context Search
Doc Retrieval
Similar Doc
Personalization
Contextual Similarity
Continuous Eval
(feedback)
GenAI App Store
End User
+ +
+ +
+
+
Data AI Engines AI Apps LLM
Integration
Models
Data to QA pairs
ETL for LLMs
LLM Fine Tuning
Custom GPT
API
Embeddings
DataStore
The Whole Ecosystem of AI with GenAI to deliver Impact
LLMOps
Prompt
Studio

19. Time is the only non-renewable resource

21. Open Source Foundation Models
H2O Danube 2 LLM 1.8B, 2T Tokens, 4K seq length
fp8 precision during training (quantization)
Grouped Query Attention
(Dropped Windowing; Mistral Tokenizer)
Compute 7,600 GPU hrs, (8xH100, 45 days)
Inference is efficient. Embeddable.
Cost efficient! (lot less than you think!)
Ready to pre-train on your data!
Democratizing Foundation LLMs

23. Using LLM Studio
DPO,
with good chat data
Fine-Tuned for Chat

24. Open Source h2oGPT
Fine-tuning and RAG of Best-in-class Open Source LLMs
Open Source H2O LLM Studio
Best-in-class Studio to fine-tune LLMs

25. Enterprise h2oGPTe
Best-in class RAG and API to power GenAI Apps

26. H2O EvalStudio
Evaluation-led building of LLM-powered Applications
Open Source H2O EvalGPT
Evaluate LLMs for public and private benchmarks

27. LLM-Based Evaluation
Prompt/Context and
Document Embedding
Dimensionality Reduction
and Clustering
Cluster/Topic
Summarization
Auto Prompt Generation
Prompt Perturbation
• Invariance
• Adversarial
Robustness
• Performance Drop
Stratified Sampling
Weakness Detection
• Weak clusters/topics
Resilience
• Performance under
distribution shift
Interpretability Outcome Analysis: Cluster
Eval
Input-Output
Visualization
Diagnostics

28. Converging Predictive AI and Generative AI

29. H2O Agents
Converging Predictive AI and Generative AI

30. H2O Document AI
Prompt powered AI for Documents

31. H2O Label Genie
ETL for GenAI

32. H2O Document Diff
Document Difference Engine powered by GenAI

33. Costs of AI
Training
Inference Costs
vLLM
Data
Labeling,
Synthetic
Feedback

34. Our view on AGI -
The making of the world’s most powerful AI will be
Open Source and community led

35. Data sanskrit. plural of datum.
to give.
to impact with energy.
mineral rich in energy.

36. AI will usher in abundance

37. AI will usher in abundance
abundance of time
abundance of space
outer space, inner space
abundance of matter & energy

38. With great powers, comes great…
Responsible AI.

39. Long time ago, there once were -
Virus, Wars and Superstitions

40. Long time ago, there once were -
Virus, Wars and Fake News

41. AI can make a difference.

42. We can make a difference.

43. AI for Good
AI for Climate Change
AI to Protect WildLife and Pets
AI To Manage Pandemic Supply Chain
AI to Model WildFire Behaviors
AI to Predict Hurricanes
AI for H2O (Water)
AI to Democratize Health
AI to Educate and Upskill our Public Services
Responsible AI and Fairness

45. AI to predict Hurricanes

46. AI to fight Climate Change

47. AI to democratize health

48. our generation’s revolution.

49. busy being born and busy dying.
- Bob Dylan

50. this will be fun!

51. Gratitude

52. BC is Before Covid

53. H2O.ai Confidential
Democratizing
AI for
20,000
Organizations
11OF THE TOP
BANKS
GLOBAL
Partner with H2O.ai
Fortune 1000 / Forbes 2000 Ranked
PROVIDERS /
OTHER
DATA
SERVICES
BUSINESS
BANKS
RETAIL
COMPANIES
CREDIT

54. H2O.ai Confidential
r
r
r
r
Fortune 1000
Fortune 1000 &
Forbes Global 2000
Fortune 1000,
Fortune Global
500, Forbes
Global 2000
Forbes Global 2000 &
Fortune Global 500
Forbes Global 2000
Fortune Global
500

55. H2O.ai Confidential

56. H2O.ai Confidential

57. r
Fortune 1000
Fortune Global 500

58. H2O.ai Confidential
r
r
r
r
Fortune 1000
Fortune 1000 &
Forbes Global 2000
Fortune 1000,
Fortune Global
500, Forbes
Global 2000
Forbes Global 2000 &
Fortune Global 500
Forbes Global 2000
Fortune Global
500

59. Open Source is about freedom, not free!

60. Raise a forest, not just a tree.
Make ecosystems

61. purpose needs voice

62. dream

63. Make data and AI your first-class assets

64. Thank You: GenAI Open Source Ecosystem
h2oGPT (Open Source GPTs need RAG)
PyMuPDF
BGE, Instructor embeddings
ragas, evalGPT.ai, hf/leaderboard, llm-eval
hnswlib, Milvus, Chroma
LangChain, LlamaIndex, Open Interpreter
vLLMs, tgi-0.9
HuggingFace, H2O LLMStudio, GGUF, AWQ, Gradio
Alpaca LoRA, llama.cpp, AutoGPTQ, hf/TheBloke
OpenAssistant
LLama2, Falcon, Mistral, GPT3, Eleuther, BigScience
Pytorch, DeepSpeed
“Attention is All You Need” team and Transformers
CUDA, RocM
Python, Go, Rust, K8s, Clouds
# others I might have missed
# @ylecun
# @ Dr. Ebtesam Almazrouei
# @tloen/alpaca-lora @ecjwg

65. ETL for LLMs
H2O Data Studio
Label Genie powered by LLMs
Hydrogen Torch
Labeling as a Service

66. Evaluation led LLM Development
evalGPT.ai
ragas, retrieval
Evaluation as a Service
Eval Studio

67. Costs of AI
Training
Inference Costs
vLLM
Data
Labeling,
Synthetic
Feedback

68. When Generation is abundant
Curation becomes valuable

69. AI to curate AI

70. AI to do AI

71. customer is the moat.

72. Co-creation

73. Gov GenAI App Store

74. Feature Story
Feature Store

75. Algorithms
Design
Data
Domain
Business
Applications
Data is a
Team Sport
Teamwork makes the Dream Work

76. H2O.ai Confidential
KAGGLE
OUR
GrandMasters
UNITED STATES
FRANCE
UNITED
KINGDOM
GERMANY
CZECH REPUBLIC
HUNGARY
AUSTRIA
JAPAN
SINGAPORE
INDIA
TURKEY

77. Data is the new /* code */

78. Kaggle LLM Science Exam

79. Kaggle LLM Science Exam
H2O LLM Studio
H2O Data Studio
Hydrogen Torch
Driverless AI
Document AI
LLMOps and MLOps

80. RAG + Gen AI Use cases
Customer Experience, Contact Centers
Document Processing
Generating Marketing
Generating Code and Apps
Procurement, RFPs, Contracts, Inventory
Portfolio Recommendation (Earnings Calls)
Custom GPTs
Meeting Summaries, Tumor Board Summary
Multi-modal, Speech
Document Extraction, ETL for LLMs
Labeling, Translation
Ask Data. BI.

81. H2O.ai Confidential
AI for ALL
AI for Sales People
AI for Investors
AI for Manufacturers
AI for Retailers
AI for Hospitals
AI for Transportation
AI for Urban Planning
AI for Financial Services
AI for Real Estates
AI for Energy
AI for Tourism
AI for Hospitality
AI for Oil and Gas
AI for Nature
AI for Future
AI for Good
Government
Scam Shield
LLM based Scam
Prevention Service
LLM
Governments
Virtual Advisor
LLM based
conversation support
services
LLM
Governments
Blueprint Designer
LLM based design and
construction
LLM
Tourism
Tour Personalization
LLM based travel and
tour recommendations
LLM
Tourism
Language Assist
LLM based multilingual
assistance
LLM
Governments
Waste Management
GenAI based waste
optimization
LLM
Smart City
Dynamic Road Tax
Services to provide
route
recommendations
LLM
Manufacturing
Green Builder
LLMs for Carbon
reduction plans
LLM
Hospitals
Healthcare AI
Best public health
advice using GenAI
LLM
Hospitals
Disease Advice
LLMs for patient care
and disease advice
LLM
Real Estate
Tenancy Screener
LLM for person risk
profiling
LLM
Security
Edge Surveillance
Local LLMs in drones
for Intelligent
Surveillance
LLM
Gen AI App Store - Applications Powered by LLMs

82. H2O.ai Confidential
AI App Store - Everything AI in one place
AI for ALL
AI for Sales People
AI for Investors
AI for Manufacturers
AI for Retailers
AI for Hospitals
AI for Transportation
AI for Urban Planning
AI for Financial Services
AI for Real Estates
AI for Energy
AI for Tourism
AI for Hospitality
AI for Oil and Gas
AI for Nature
AI for Future
AI for Good

83. +
Scaling the AI & GenAI for 100s of Use Cases
Data LLMs /
Models
AI + LLM
Apps
GenAI
App Store
Model
Deployments
ATL AI
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
AI Access
Regions
100s of Use Cases

84. AIaaS Ecosystem with H2O.AI at AT&T
AI Governance
Center
Any AI/ML library
Build your own models
Import
Models
Create App/
Deploy
Model Microservice
● Model Validation
○ Adversarial analysis
○ Backtesting
○ What-if analysis
● Suggest models
○ Model catalog
● Suggest features
○ Feature store
● Ensemble strategies
● Model benchmarking
Create AI
App Store
Model Store
H2O Feature
Store
App Store
Model Analytics Platform
AI Bias eval, MLI
AI Ops
Application
Deploy AI
1
2 3
Self Service Data
Ingestion
H2O - 3
Data Store
on Prem
H2O Olympics
2.5
H2O Olympics
Responsible AI
AI/ML User
Model Store
H2O
WAVE
H2O WAVE
H2O Feature
Store
HDFS
Cloudera
H2O MLOps
Model Repository
Model Deployment
Model Monitoring
High Availability Model Hosting
GenAI (LLMs)
Integration
4

85. Customer and Community
Love is the greatest force in nature.

86. From Data Science to Strategy Science

87. Silence
The quieter you become the more we can hear
Ram Dass

88. listen
silent

90. universal
individual

91. you can do anything you set
your mind to.
eminem.

92. Courage

93. H2O.ai Confidential
whose world is this?

94. https://www.youtube.com/watch?v=ahY62u62Uw8
Transform
manager to a leader
caterpillar to a butterfly!

95. Rise of Data Scientist
From Data to Strategy Science
CDAO now works closely with CEO

96. Intelligence is the Edge

97. Every Company needs to be an AI Company

98. Every Nation needs to be an AI Nation

99. The only wisdom we can hope to acquire
Is the wisdom of humility: humility is endless
TS Eliot said that.

100. You can be in my dream
If I can be in yours.
Bob Dylan said that.

101. You can be in my selfie
If I can be in yours.

102. Gratitude
Wish you Well -

103. this will be fun!

104. H2O.ai Confidential