SlideShare a Scribd company logo
1 of 45
Powerful Distributed Compute
Designed for AI
Breakthrough Scaling with IPC - Labweek 2023
Connect!
X / Telegram: @developerAlly
Lens/bluesky: @alisonwonderland
LinkedIn: ally-haire
Slack: bit.ly/bacalhau-project-slack
Hello!
I’m Ally 👋
Ally Haire
Background
A Story about Data and Infrastructure
Components of current web stack:
-Networking
-Storage
-Compute -> so far a missing piece of the
decentralised infrastructure story
Compute
A Core Infrastructure Need
Components of the AI & ML pipeline:
-Data
-Models
-Compute -> for both training and running models
Compute
A Core Component for AI & ML
Overview
Distributed Compute: The Now Frontier of Open Infrastructure
Build a global, permissionless, distributed
compute network (dePIN)
Lilypad Vision
Accessible, Efficient, Open Compute
Enable internet-scale data processing, AI & ML and
other arbitrary computation
Unleash idle processing power and unlock an
efficient, open compute marketplace
Lilypad
Peer To Peer Compute Marketplace
Seamlessly Connecting Demand with Hardware Supply
Compute
Demand
Hardware
Supply
Why distributed compute
Current Compute & AI Landscape
Almost 70% of cloud is provided by just 3 companies - AWS, Microsoft & Google
Today, a handful of corporations
control 90% of the world’s data and IT
infrastructure
State of Compute
An Anti-Competitive, Inefficient Oligopoly
State of AI
Dominated & Controlled by the same players
“The dangers associated with closed AI are
considerably greater than the open approach”
Why distributed compute
A Practical & Philosophical Guide
AI has immense potential to provide benefit to humanity
…provided it’s accessible
Lilypad for…
Open AI - the Real, Collectively Owned Kind
This is a really good talk - recommend!
“ Open-source models are faster, more customizable & pound-for-pound
more capable”
Lilypad for…
Open Innovation
- Elon Musk, May 2023
“GPUs are at this point considerably
harder to get than drugs”
Lilypad for …
Accessible hardware via an efficient marketplace
Access to GPUs is the key
problem for open source
AI/ML to be competitive
DePIN can help solve this with
open, cooperative, efficient
compute networks
(leveraging filecoin network
with lilypad coordination
unlocks this access)
Inefficient marketplaces mean
●Many powerful GPUs left idle in large data centres
●Lots of hobbyists / gamers open to or looking for new
revenue streams.
●Personal devices becoming more and more powerful while
AI models become more performant.
Lilypad aligns supply and demand by providing GPUs for AI &
ML & new revenue streams to compute providers
Lilypad for …
Accessible hardware via an open p2p marketplace
Oligopolies do not make for efficient use of hardware, nor do
they provide good pricing models for users.
Lilypad enables coordination layers for matching CPU/GPU
with supply (jobs) bringing better market dynamics and
cheaper prices.
Lilypad for…
Efficiency of Pricing & Distribution
Lilypad Offers...
Efficient Resource Use & Open Access
Practical Solutions
-Efficient Marketplace
-Accessible Hardware
-Competitive Pricing
-Speeds Innovation
Gives OSS AI & new market
entrants a viable platform
to compete from
Open Tech as Public Good
Open Compute
-Distributes value more fairly
-Reduces bias
-encourages community
consensus on security,
ethics
-Increases breadth of
solutions through access
How does it work?
The Tech Stuff - AURORA TESTNET IS LIVE ON IPC!!!
Lilypad Aurora uses IPC Fendermint to build a dedicated
subchain that underpins Lilypad's computational network
and enables Lilypad's own ERC20 token (LP) for service and
gas payments.
Built in GO & Solidity, Lilypad is fully EVM-Compatible.
Technical Details
Lilypad Aurora Testnet is Live!
v2 🎉
v2 🎉
Code Libraries
Smart Contracts
(on-chain)
Lilypad Network
(off-chain)
A mix of Solidity and golang SDK code that could easily be rearranged into a
custom compute over data project.
The smart contracts we deploy to IPC that run Lilypad. These contracts handle
deal agreements, escrow payments, dispute resolution and job payments.
The various services that hang off the smart contracts which schedule and run
jobs on the Lilypad network. The services are solver, resource provider, job
creator, mediator and directory services.
Tech Stack
Lilypad Modular Layers
Backed by academic research, Lilypad opts for a game
theory approach to job/compute verification using
optimistic reproducibility to incentivise good actors &
discourage cheating & collusion in the network.
Lilypad Job Verification
With Optimistic Reproducibility
• A Module is a github repo that defines a compute job in
docker (or arbitrary wasm)
• Module author can create and test new modules on a local
dev stack
• Compute Providers are then able to add verified modules
to their allowlist (automatic tests in future)
• In future, module authors will be able to charge a fee to run
their models - bootstrapping the ecosystem & rewarding AI
developer contributions
Module System
& Deterministic Modules
• Some stuff here
Compute Modules
LoRA, SDXL, LLMs
v2 🎉
v2 🎉
Announced! 🎉
Code Libraries
Smart Contracts
(on-chain)
Lilypad Network
(off-chain)
Lilypad AI Studio
(value layer)
A mix of Solidity and golang SDK code that could easily be rearranged into a
custom compute over data project.
The smart contracts we deploy to IPC that run Lilypad. These contracts handle
deal agreements, escrow payments, dispute resolution and job payments.
The various services that hang off the smart contracts which schedule and run
jobs on the Lilypad network. The services are solver, resource provider, job
creator, mediator and directory services.
A SaaS layer that enables users to pay with Stripe to run jobs on the Lilypad
network. This acts as an abstraction layer and users who pay with Stripe won’t
have to deal with private keys and tokens.
Tech Stack
The Lilypad Value Layers
Show me the code
What can I do with it?
Users & Developers have access to easy Stable Diffusion XL and
cutting edge open source LLMs & AI via
-the Lilypad CLI,
-Aurora Net smart contracts, (web3 native flow)
You shouldn’t need to pay a fortune to keep a cloud GPU
running, so that you don’t lose access to it for the training job
you need to run once a week.
User Details
Where’s my AI please?
Network name: Lilypad Aurora testnet
New RPC URL:
http://testnet.lilypad.tech:8545
Chain ID: 1337
Currency symbol: lilETH
Block explorer URL: (leave blank)
Getting Started
Add the Lilypad Aurora Network to your Wallet
Get some funds from the faucet:
http://faucet.lilypad.tech
The faucet will give you both ETH
(to pay for gas) and LP (to stake
and pay for jobs).
Getting Started
Get some testnet LP tokens!
CLI Install
Via
-Go Toolchain
-Binaries
Then setup your wallet
key to interact with
Lilypad
> lilypad run cowsay:v0.0.1 -i Message="Never gonna give you
up"
Cow do you do?
Hello, World!
> lilypad run
sdxl:v0.9-lilypad1 -i
PromptEnv="PROMPT=An astronaut
riding on a unicorn"
SDXL An astronaut on a unicorn?
Smart Contract Usage
Call AI from your smart contracts!
SDXL An astronaut on a unicorn?
I’m not a developer though :(
Where’s my AI please?
You shouldn’t need a degree in AI to access state of the art
open source models for your next App idea - in fact, it should
be as easy as any web UI out there makes it.
Lilypad AI Studio
app.lilypad.tech
Web Interface - no
wallet needed!
Social Signin
Pay with Stripe
(free in beta test)
API keys for Dev’s
Lilypad AI Studio
www.lilypad.tech
Web Interface - no
wallet needed!
Social Signin
Pay with Stripe
(currently free!)
Tweet us your creations!
@Lilypad_Tech
Prompt: Depict yourself as a giant cosmic
entity, The Font of Knowledge, with infinite
cosmic knowledge and awareness
How do I contribute to the network?
I’m in!! What can I do?
A personal invitation to compute providers to join early adopters like Holon,
LabDAO, Piknik and others to help us calibrate the decentralised compute
cloud!
Join us in shaping the future of compute & building
open infra with DePIN
bit.ly/join-lilypad-calib-net
Got a GPU? We need you!
Announcing Baklava Calibration Phase!
Join the future of Compute!
Get in touch with us
Slack: #lilypad-general
bit.ly/bacalhau-project-slack
Twitter: @Lilypad_Tech
Blog: blog.lilypadnetwork.org
Docs: docs.lilypadnetwork.org
Github: github.com/bacalhau-project/lilypad
YouTube: youtube.com/@lilypadnetwork
Powerful Distributed Compute
Designed for AI & the
Open Data Economy
Open Data & Open Infrastructure Summit 2023
Thank you!
Run a Node? Make a Module?
Check out the docs for
more!
docs.lilypad.tech
AI Studio
And…Introducing…
Accessible Decentralised AI

More Related Content

Similar to Lilypad @ Labweek, Istanbul, 2023.pdf

IoTWorld 2016 OSS Keynote Param Singh, Ian Skerrett
IoTWorld 2016 OSS Keynote Param Singh, Ian SkerrettIoTWorld 2016 OSS Keynote Param Singh, Ian Skerrett
IoTWorld 2016 OSS Keynote Param Singh, Ian SkerrettParam Singh
 
AIoT: Intelligence on Microcontroller
AIoT: Intelligence on MicrocontrollerAIoT: Intelligence on Microcontroller
AIoT: Intelligence on MicrocontrollerAndri Yadi
 
AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...
AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...
AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...Amazon Web Services
 
Intel 20180608 v2
Intel 20180608 v2Intel 20180608 v2
Intel 20180608 v2ISSIP
 
The Neo4j Data Platform for Today & Tomorrow.pdf
The Neo4j Data Platform for Today & Tomorrow.pdfThe Neo4j Data Platform for Today & Tomorrow.pdf
The Neo4j Data Platform for Today & Tomorrow.pdfNeo4j
 
Iterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time DeliveryIterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time DeliveryAsanka Abeysinghe
 
Democratizing Data Science on Kubernetes
Democratizing Data Science on Kubernetes Democratizing Data Science on Kubernetes
Democratizing Data Science on Kubernetes John Archer
 
CHIPS Alliance_Object Automation Inc_workshop
CHIPS Alliance_Object Automation Inc_workshopCHIPS Alliance_Object Automation Inc_workshop
CHIPS Alliance_Object Automation Inc_workshopObject Automation
 
Metaverse and Digital Twins on Enterprise-Public.pdf
Metaverse and Digital Twins on Enterprise-Public.pdfMetaverse and Digital Twins on Enterprise-Public.pdf
Metaverse and Digital Twins on Enterprise-Public.pdf湯米吳 Tommy Wu
 
Vertex Perspectives | AI-optimized Chipsets | Part I
Vertex Perspectives | AI-optimized Chipsets | Part IVertex Perspectives | AI-optimized Chipsets | Part I
Vertex Perspectives | AI-optimized Chipsets | Part IVertex Holdings
 
Vertex perspectives ai optimized chipsets (part i)
Vertex perspectives   ai optimized chipsets (part i)Vertex perspectives   ai optimized chipsets (part i)
Vertex perspectives ai optimized chipsets (part i)Yanai Oron
 
Cytoscape CI Chapter 2
Cytoscape CI Chapter 2Cytoscape CI Chapter 2
Cytoscape CI Chapter 2bdemchak
 
Dell AI Telecom Webinar
Dell AI Telecom WebinarDell AI Telecom Webinar
Dell AI Telecom WebinarBill Wong
 
Docker cloud hybridation & orchestration
Docker cloud hybridation & orchestrationDocker cloud hybridation & orchestration
Docker cloud hybridation & orchestrationAdrien Blind
 
IRJET- Automation using Alexa and Raspberry Pi
IRJET- Automation using Alexa and Raspberry PiIRJET- Automation using Alexa and Raspberry Pi
IRJET- Automation using Alexa and Raspberry PiIRJET Journal
 
Introduction to Apache Kafka and why it matters - Madrid
Introduction to Apache Kafka and why it matters - MadridIntroduction to Apache Kafka and why it matters - Madrid
Introduction to Apache Kafka and why it matters - MadridPaolo Castagna
 
OSCON 2013 - The Hitchiker’s Guide to Open Source Cloud Computing
OSCON 2013 - The Hitchiker’s Guide to Open Source Cloud ComputingOSCON 2013 - The Hitchiker’s Guide to Open Source Cloud Computing
OSCON 2013 - The Hitchiker’s Guide to Open Source Cloud ComputingMark Hinkle
 
Node-RED Interoperability Test
Node-RED Interoperability TestNode-RED Interoperability Test
Node-RED Interoperability TestBoris Adryan
 

Similar to Lilypad @ Labweek, Istanbul, 2023.pdf (20)

IoTWorld 2016 OSS Keynote Param Singh, Ian Skerrett
IoTWorld 2016 OSS Keynote Param Singh, Ian SkerrettIoTWorld 2016 OSS Keynote Param Singh, Ian Skerrett
IoTWorld 2016 OSS Keynote Param Singh, Ian Skerrett
 
The future of AI is hybrid
The future of AI is hybridThe future of AI is hybrid
The future of AI is hybrid
 
AIoT: Intelligence on Microcontroller
AIoT: Intelligence on MicrocontrollerAIoT: Intelligence on Microcontroller
AIoT: Intelligence on Microcontroller
 
Breaking RSA & the internet
Breaking RSA & the internetBreaking RSA & the internet
Breaking RSA & the internet
 
AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...
AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...
AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...
 
Intel 20180608 v2
Intel 20180608 v2Intel 20180608 v2
Intel 20180608 v2
 
The Neo4j Data Platform for Today & Tomorrow.pdf
The Neo4j Data Platform for Today & Tomorrow.pdfThe Neo4j Data Platform for Today & Tomorrow.pdf
The Neo4j Data Platform for Today & Tomorrow.pdf
 
Iterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time DeliveryIterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time Delivery
 
Democratizing Data Science on Kubernetes
Democratizing Data Science on Kubernetes Democratizing Data Science on Kubernetes
Democratizing Data Science on Kubernetes
 
CHIPS Alliance_Object Automation Inc_workshop
CHIPS Alliance_Object Automation Inc_workshopCHIPS Alliance_Object Automation Inc_workshop
CHIPS Alliance_Object Automation Inc_workshop
 
Metaverse and Digital Twins on Enterprise-Public.pdf
Metaverse and Digital Twins on Enterprise-Public.pdfMetaverse and Digital Twins on Enterprise-Public.pdf
Metaverse and Digital Twins on Enterprise-Public.pdf
 
Vertex Perspectives | AI-optimized Chipsets | Part I
Vertex Perspectives | AI-optimized Chipsets | Part IVertex Perspectives | AI-optimized Chipsets | Part I
Vertex Perspectives | AI-optimized Chipsets | Part I
 
Vertex perspectives ai optimized chipsets (part i)
Vertex perspectives   ai optimized chipsets (part i)Vertex perspectives   ai optimized chipsets (part i)
Vertex perspectives ai optimized chipsets (part i)
 
Cytoscape CI Chapter 2
Cytoscape CI Chapter 2Cytoscape CI Chapter 2
Cytoscape CI Chapter 2
 
Dell AI Telecom Webinar
Dell AI Telecom WebinarDell AI Telecom Webinar
Dell AI Telecom Webinar
 
Docker cloud hybridation & orchestration
Docker cloud hybridation & orchestrationDocker cloud hybridation & orchestration
Docker cloud hybridation & orchestration
 
IRJET- Automation using Alexa and Raspberry Pi
IRJET- Automation using Alexa and Raspberry PiIRJET- Automation using Alexa and Raspberry Pi
IRJET- Automation using Alexa and Raspberry Pi
 
Introduction to Apache Kafka and why it matters - Madrid
Introduction to Apache Kafka and why it matters - MadridIntroduction to Apache Kafka and why it matters - Madrid
Introduction to Apache Kafka and why it matters - Madrid
 
OSCON 2013 - The Hitchiker’s Guide to Open Source Cloud Computing
OSCON 2013 - The Hitchiker’s Guide to Open Source Cloud ComputingOSCON 2013 - The Hitchiker’s Guide to Open Source Cloud Computing
OSCON 2013 - The Hitchiker’s Guide to Open Source Cloud Computing
 
Node-RED Interoperability Test
Node-RED Interoperability TestNode-RED Interoperability Test
Node-RED Interoperability Test
 

Recently uploaded

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 

Recently uploaded (20)

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 

Lilypad @ Labweek, Istanbul, 2023.pdf

  • 1. Powerful Distributed Compute Designed for AI Breakthrough Scaling with IPC - Labweek 2023
  • 2. Connect! X / Telegram: @developerAlly Lens/bluesky: @alisonwonderland LinkedIn: ally-haire Slack: bit.ly/bacalhau-project-slack Hello! I’m Ally 👋 Ally Haire
  • 3. Background A Story about Data and Infrastructure
  • 4. Components of current web stack: -Networking -Storage -Compute -> so far a missing piece of the decentralised infrastructure story Compute A Core Infrastructure Need
  • 5. Components of the AI & ML pipeline: -Data -Models -Compute -> for both training and running models Compute A Core Component for AI & ML
  • 6. Overview Distributed Compute: The Now Frontier of Open Infrastructure
  • 7. Build a global, permissionless, distributed compute network (dePIN) Lilypad Vision Accessible, Efficient, Open Compute Enable internet-scale data processing, AI & ML and other arbitrary computation Unleash idle processing power and unlock an efficient, open compute marketplace
  • 8. Lilypad Peer To Peer Compute Marketplace Seamlessly Connecting Demand with Hardware Supply Compute Demand Hardware Supply
  • 9. Why distributed compute Current Compute & AI Landscape
  • 10. Almost 70% of cloud is provided by just 3 companies - AWS, Microsoft & Google Today, a handful of corporations control 90% of the world’s data and IT infrastructure State of Compute An Anti-Competitive, Inefficient Oligopoly
  • 11. State of AI Dominated & Controlled by the same players “The dangers associated with closed AI are considerably greater than the open approach”
  • 12. Why distributed compute A Practical & Philosophical Guide
  • 13. AI has immense potential to provide benefit to humanity …provided it’s accessible Lilypad for… Open AI - the Real, Collectively Owned Kind This is a really good talk - recommend!
  • 14. “ Open-source models are faster, more customizable & pound-for-pound more capable” Lilypad for… Open Innovation
  • 15. - Elon Musk, May 2023 “GPUs are at this point considerably harder to get than drugs”
  • 16. Lilypad for … Accessible hardware via an efficient marketplace Access to GPUs is the key problem for open source AI/ML to be competitive DePIN can help solve this with open, cooperative, efficient compute networks (leveraging filecoin network with lilypad coordination unlocks this access)
  • 17. Inefficient marketplaces mean ●Many powerful GPUs left idle in large data centres ●Lots of hobbyists / gamers open to or looking for new revenue streams. ●Personal devices becoming more and more powerful while AI models become more performant. Lilypad aligns supply and demand by providing GPUs for AI & ML & new revenue streams to compute providers Lilypad for … Accessible hardware via an open p2p marketplace
  • 18. Oligopolies do not make for efficient use of hardware, nor do they provide good pricing models for users. Lilypad enables coordination layers for matching CPU/GPU with supply (jobs) bringing better market dynamics and cheaper prices. Lilypad for… Efficiency of Pricing & Distribution
  • 19. Lilypad Offers... Efficient Resource Use & Open Access Practical Solutions -Efficient Marketplace -Accessible Hardware -Competitive Pricing -Speeds Innovation Gives OSS AI & new market entrants a viable platform to compete from Open Tech as Public Good Open Compute -Distributes value more fairly -Reduces bias -encourages community consensus on security, ethics -Increases breadth of solutions through access
  • 20. How does it work? The Tech Stuff - AURORA TESTNET IS LIVE ON IPC!!!
  • 21. Lilypad Aurora uses IPC Fendermint to build a dedicated subchain that underpins Lilypad's computational network and enables Lilypad's own ERC20 token (LP) for service and gas payments. Built in GO & Solidity, Lilypad is fully EVM-Compatible. Technical Details Lilypad Aurora Testnet is Live!
  • 22. v2 🎉 v2 🎉 Code Libraries Smart Contracts (on-chain) Lilypad Network (off-chain) A mix of Solidity and golang SDK code that could easily be rearranged into a custom compute over data project. The smart contracts we deploy to IPC that run Lilypad. These contracts handle deal agreements, escrow payments, dispute resolution and job payments. The various services that hang off the smart contracts which schedule and run jobs on the Lilypad network. The services are solver, resource provider, job creator, mediator and directory services. Tech Stack Lilypad Modular Layers
  • 23. Backed by academic research, Lilypad opts for a game theory approach to job/compute verification using optimistic reproducibility to incentivise good actors & discourage cheating & collusion in the network. Lilypad Job Verification With Optimistic Reproducibility
  • 24. • A Module is a github repo that defines a compute job in docker (or arbitrary wasm) • Module author can create and test new modules on a local dev stack • Compute Providers are then able to add verified modules to their allowlist (automatic tests in future) • In future, module authors will be able to charge a fee to run their models - bootstrapping the ecosystem & rewarding AI developer contributions Module System & Deterministic Modules
  • 25. • Some stuff here Compute Modules LoRA, SDXL, LLMs
  • 26. v2 🎉 v2 🎉 Announced! 🎉 Code Libraries Smart Contracts (on-chain) Lilypad Network (off-chain) Lilypad AI Studio (value layer) A mix of Solidity and golang SDK code that could easily be rearranged into a custom compute over data project. The smart contracts we deploy to IPC that run Lilypad. These contracts handle deal agreements, escrow payments, dispute resolution and job payments. The various services that hang off the smart contracts which schedule and run jobs on the Lilypad network. The services are solver, resource provider, job creator, mediator and directory services. A SaaS layer that enables users to pay with Stripe to run jobs on the Lilypad network. This acts as an abstraction layer and users who pay with Stripe won’t have to deal with private keys and tokens. Tech Stack The Lilypad Value Layers
  • 27. Show me the code What can I do with it?
  • 28. Users & Developers have access to easy Stable Diffusion XL and cutting edge open source LLMs & AI via -the Lilypad CLI, -Aurora Net smart contracts, (web3 native flow) You shouldn’t need to pay a fortune to keep a cloud GPU running, so that you don’t lose access to it for the training job you need to run once a week. User Details Where’s my AI please?
  • 29. Network name: Lilypad Aurora testnet New RPC URL: http://testnet.lilypad.tech:8545 Chain ID: 1337 Currency symbol: lilETH Block explorer URL: (leave blank) Getting Started Add the Lilypad Aurora Network to your Wallet
  • 30. Get some funds from the faucet: http://faucet.lilypad.tech The faucet will give you both ETH (to pay for gas) and LP (to stake and pay for jobs). Getting Started Get some testnet LP tokens!
  • 31. CLI Install Via -Go Toolchain -Binaries Then setup your wallet key to interact with Lilypad
  • 32. > lilypad run cowsay:v0.0.1 -i Message="Never gonna give you up" Cow do you do? Hello, World!
  • 33. > lilypad run sdxl:v0.9-lilypad1 -i PromptEnv="PROMPT=An astronaut riding on a unicorn" SDXL An astronaut on a unicorn?
  • 34. Smart Contract Usage Call AI from your smart contracts!
  • 35. SDXL An astronaut on a unicorn?
  • 36. I’m not a developer though :( Where’s my AI please? You shouldn’t need a degree in AI to access state of the art open source models for your next App idea - in fact, it should be as easy as any web UI out there makes it.
  • 37. Lilypad AI Studio app.lilypad.tech Web Interface - no wallet needed! Social Signin Pay with Stripe (free in beta test) API keys for Dev’s
  • 38. Lilypad AI Studio www.lilypad.tech Web Interface - no wallet needed! Social Signin Pay with Stripe (currently free!)
  • 39. Tweet us your creations! @Lilypad_Tech Prompt: Depict yourself as a giant cosmic entity, The Font of Knowledge, with infinite cosmic knowledge and awareness
  • 40. How do I contribute to the network? I’m in!! What can I do?
  • 41. A personal invitation to compute providers to join early adopters like Holon, LabDAO, Piknik and others to help us calibrate the decentralised compute cloud! Join us in shaping the future of compute & building open infra with DePIN bit.ly/join-lilypad-calib-net Got a GPU? We need you! Announcing Baklava Calibration Phase!
  • 42. Join the future of Compute! Get in touch with us Slack: #lilypad-general bit.ly/bacalhau-project-slack Twitter: @Lilypad_Tech Blog: blog.lilypadnetwork.org Docs: docs.lilypadnetwork.org Github: github.com/bacalhau-project/lilypad YouTube: youtube.com/@lilypadnetwork
  • 43. Powerful Distributed Compute Designed for AI & the Open Data Economy Open Data & Open Infrastructure Summit 2023 Thank you!
  • 44. Run a Node? Make a Module? Check out the docs for more! docs.lilypad.tech