SlideShare a Scribd company logo
1 of 38
Download to read offline
DevOps & MLOps - IDI 2024
Come portare in
produzione un sistema di
ML che ora gira solo nel
locale del nostro data
scientist ?
DevOps & MLOps - IDI 2024
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
alessandra.bilardi@corley.it
corley.it
DevOps & MLOps - IDI 2024
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
alessandra.bilardi@corley.it
corley.it
DevOps & MLOps - IDI 2024
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
alessandra.bilardi@corley.it
corley.it
DevOps & MLOps - IDI 2024
SUMMARY
DevOps methods & actors
MLOps methods & actors
Use case
AWS services
What we take home
DevOps & MLOps - IDI 2024
reference
DevOps & MLOps - IDI 2024
DevOps methods & actors
DevOps & MLOps - IDI 2024
DevOps methods & actors
DevOps & MLOps - IDI 2024
DevOps methods & actors
DevOps & MLOps - IDI 2024
MLOps methods & actors
DevOps & MLOps - IDI 2024
ML system & actors
DevOps & MLOps - IDI 2024
reference
DevOps & MLOps - IDI 2024
reference
DevOps & MLOps - IDI 2024
ML system & actors
DevOps & MLOps - IDI 2024
MLOps methods & actors
DevOps & MLOps - IDI 2024
MLOps methods & actors
DevOps & MLOps - IDI 2024
reference
DevOps & MLOps - IDI 2024
Use case
DevOps & MLOps - IDI 2024
Use case
DevOps & MLOps - IDI 2024
Use case
DevOps & MLOps - IDI 2024
reference
DevOps & MLOps - IDI 2024
DevOps & MLOps - IDI 2024
AWS services
DevOps & MLOps - IDI 2024
AWS services
DevOps & MLOps - IDI 2024
AWS Step Functions
DevOps & MLOps - IDI 2024
AWS Step Functions
https://github.com/aws/aws-step-functions-data-science-sdk-python
DevOps & MLOps - IDI 2024
AWS services
DevOps & MLOps - IDI 2024
AWS services
DevOps & MLOps - IDI 2024
Amazon SageMaker Pipeline
DevOps & MLOps - IDI 2024
Amazon SageMaker Pipeline
https://github.com/aws/amazon-sagemaker-examples/tree/main/sagemaker-pipeline-parameterization
DevOps & MLOps - IDI 2024
reference
DevOps & MLOps - IDI 2024
What we take home
DevOps & MLOps - IDI 2024
Data Scientist & Cloud Engineer
1
How to survive with colleagues with different skills, without hindering the table football
game during the lunch break.
2 Versioning of configuration,
training and inference data
statistics, models, ..
3
Define tools and services:
libraries, images, storages, ..
4 Define guidelines for who does
what: review, support,
deploying the model, ..
Promoting resources
awareness to be used
DevOps & MLOps - IDI 2024
AWS services
DevOps & MLOps - IDI 2024
Step Functions vs SageMaker Pipeline
DevOps & MLOps - IDI 2024
AWS services
Which AWS services for which role, when we want to automate a solution from local to
production: depends on the life cycle of the model but above all by the actors involved.
Data Scientists (DS) Cloud Engineer (CE) DS AWS Services CE AWS Services
many one AWS Step Functions AWS CloudFormation
one many Amazon SageMaker
Pipeline
AWS CloudFormation
& Step Functions
DevOps & MLOps - IDI 2024
AWS services
Which AWS services for which model, when we have a small model, we can also use
something like AWS Lambda, but when we need GPU, we must to use an Endpoint.
AWS Service Provisioning type Resources Cost per hour
Endpoint Provisioned 2 CPU + 4GB RAM $0.056
Endpoint Serverless 4096MB $0.288
AWS Lambda Serverless 4096MB $0.00024012 +GBsec
DevOps & MLOps - IDI 2024
Thanks
for listening!

More Related Content

Similar to How to move your ML system from local to production - 2024-03-15

Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdf
Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdfLaunching your Application the Amazon Way - AWS Startup Day Boston 2018.pdf
Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdf
Amazon Web Services
 
Feature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine LearningFeature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine Learning
Provectus
 

Similar to How to move your ML system from local to production - 2024-03-15 (20)

Introducing power bi in your company - andrea martorana tusa
Introducing power bi in your company - andrea martorana tusaIntroducing power bi in your company - andrea martorana tusa
Introducing power bi in your company - andrea martorana tusa
 
App Development Evolution: What has changed?
App Development Evolution: What has changed? App Development Evolution: What has changed?
App Development Evolution: What has changed?
 
CGI-IgniteChicago
CGI-IgniteChicagoCGI-IgniteChicago
CGI-IgniteChicago
 
The App Evolution
The App Evolution The App Evolution
The App Evolution
 
Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdf
Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdfLaunching your Application the Amazon Way - AWS Startup Day Boston 2018.pdf
Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdf
 
The Future of Integration | Webinar of the 24th of April 2020
The Future of Integration | Webinar of the 24th of April 2020The Future of Integration | Webinar of the 24th of April 2020
The Future of Integration | Webinar of the 24th of April 2020
 
Using PaaS to run APIs and Microservices in Production
Using PaaS to run APIs and Microservices in ProductionUsing PaaS to run APIs and Microservices in Production
Using PaaS to run APIs and Microservices in Production
 
Neo4j_Anurag Tandon_Product Vision and Roadmap.Benelux.pptx.pdf
Neo4j_Anurag Tandon_Product Vision and Roadmap.Benelux.pptx.pdfNeo4j_Anurag Tandon_Product Vision and Roadmap.Benelux.pptx.pdf
Neo4j_Anurag Tandon_Product Vision and Roadmap.Benelux.pptx.pdf
 
AWS Enterprise Summit London 2015 | Adobe Creative Cloud and AWS
 AWS Enterprise Summit London 2015 | Adobe Creative Cloud and AWS AWS Enterprise Summit London 2015 | Adobe Creative Cloud and AWS
AWS Enterprise Summit London 2015 | Adobe Creative Cloud and AWS
 
C sharp annual conference 15-apr-18 - delhi
C sharp annual conference   15-apr-18 - delhiC sharp annual conference   15-apr-18 - delhi
C sharp annual conference 15-apr-18 - delhi
 
3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud
 
Making the move from iaa s to iaas+
Making the move from iaa s to iaas+Making the move from iaa s to iaas+
Making the move from iaa s to iaas+
 
DevOps on AWS: Accelerating Software Delivery with AWS Developer Tools | AWS ...
DevOps on AWS: Accelerating Software Delivery with AWS Developer Tools | AWS ...DevOps on AWS: Accelerating Software Delivery with AWS Developer Tools | AWS ...
DevOps on AWS: Accelerating Software Delivery with AWS Developer Tools | AWS ...
 
The Need for Speed
The Need for SpeedThe Need for Speed
The Need for Speed
 
WSO2Con EU 2016: Planning Your Cloud Strategy
WSO2Con EU 2016: Planning Your Cloud StrategyWSO2Con EU 2016: Planning Your Cloud Strategy
WSO2Con EU 2016: Planning Your Cloud Strategy
 
EWUG 2018 February the journey continues.....
EWUG 2018 February   the journey continues.....EWUG 2018 February   the journey continues.....
EWUG 2018 February the journey continues.....
 
Serverless Computing no Microsoft Azure
Serverless Computing no Microsoft AzureServerless Computing no Microsoft Azure
Serverless Computing no Microsoft Azure
 
Feature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine LearningFeature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine Learning
 
The Big Connection: Integrating Cloud with Enterprise Systems
The Big Connection: Integrating Cloud with Enterprise SystemsThe Big Connection: Integrating Cloud with Enterprise Systems
The Big Connection: Integrating Cloud with Enterprise Systems
 
The Future of DevOps.pdf
The Future of DevOps.pdfThe Future of DevOps.pdf
The Future of DevOps.pdf
 

More from Alessandra Bilardi

More from Alessandra Bilardi (20)

Overview of the OpenCV library and some use cases - 2024-04-19
Overview of the OpenCV library and some use cases - 2024-04-19Overview of the OpenCV library and some use cases - 2024-04-19
Overview of the OpenCV library and some use cases - 2024-04-19
 
Overview of the Kaggle platform and its competitions
Overview of the Kaggle platform and its competitionsOverview of the Kaggle platform and its competitions
Overview of the Kaggle platform and its competitions
 
Forecasting in AWS - 2024-02-01
Forecasting in AWS - 2024-02-01Forecasting in AWS - 2024-02-01
Forecasting in AWS - 2024-02-01
 
From your laptop to all resource that you need - 2023-12-09
From your laptop to all resource that you need - 2023-12-09From your laptop to all resource that you need - 2023-12-09
From your laptop to all resource that you need - 2023-12-09
 
Parallelize data processing - 2023-10-24
Parallelize data processing - 2023-10-24Parallelize data processing - 2023-10-24
Parallelize data processing - 2023-10-24
 
The Fourier transformation - 2023-07-23
The Fourier transformation - 2023-07-23The Fourier transformation - 2023-07-23
The Fourier transformation - 2023-07-23
 
Anomaly Detection and IP Insights - 2023-06-10
Anomaly Detection and IP Insights - 2023-06-10Anomaly Detection and IP Insights - 2023-06-10
Anomaly Detection and IP Insights - 2023-06-10
 
Forecasting in AWS - 2023-05-16
Forecasting in AWS - 2023-05-16Forecasting in AWS - 2023-05-16
Forecasting in AWS - 2023-05-16
 
Natural conversation - 2023-05-06
Natural conversation - 2023-05-06Natural conversation - 2023-05-06
Natural conversation - 2023-05-06
 
Classification - 2023-03-25
Classification - 2023-03-25Classification - 2023-03-25
Classification - 2023-03-25
 
Data transformation on AWS - 2022-10-11
Data transformation on AWS - 2022-10-11Data transformation on AWS - 2022-10-11
Data transformation on AWS - 2022-10-11
 
Anomaly Detection Overview - 2022-05-26
Anomaly Detection Overview - 2022-05-26Anomaly Detection Overview - 2022-05-26
Anomaly Detection Overview - 2022-05-26
 
Automation: from local test to production deploy - 2020-11-05
Automation: from local test to production deploy - 2020-11-05Automation: from local test to production deploy - 2020-11-05
Automation: from local test to production deploy - 2020-11-05
 
Minetest - 2020-06-27
Minetest - 2020-06-27Minetest - 2020-06-27
Minetest - 2020-06-27
 
Line follower - 2020-02-01
Line follower - 2020-02-01Line follower - 2020-02-01
Line follower - 2020-02-01
 
Rubik's cube - 2019-04-06
Rubik's cube  - 2019-04-06Rubik's cube  - 2019-04-06
Rubik's cube - 2019-04-06
 
AWS database solutions and open sources - 2019-03-28
AWS database solutions and open sources - 2019-03-28AWS database solutions and open sources - 2019-03-28
AWS database solutions and open sources - 2019-03-28
 
Evolving our Datastore - 2018-03-27
Evolving our Datastore - 2018-03-27Evolving our Datastore - 2018-03-27
Evolving our Datastore - 2018-03-27
 
Find the matches - 2018-02-24
Find the matches - 2018-02-24Find the matches - 2018-02-24
Find the matches - 2018-02-24
 
Arduino - 2017-06-26
Arduino - 2017-06-26Arduino - 2017-06-26
Arduino - 2017-06-26
 

Recently uploaded

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
MarinCaroMartnezBerg
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
AroojKhan71
 
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
amitlee9823
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
amitlee9823
 

Recently uploaded (20)

Predicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science ProjectPredicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science Project
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
 
ALSO dropshipping via API with DroFx.pptx
ALSO dropshipping via API with DroFx.pptxALSO dropshipping via API with DroFx.pptx
ALSO dropshipping via API with DroFx.pptx
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 

How to move your ML system from local to production - 2024-03-15

  • 1. DevOps & MLOps - IDI 2024 Come portare in produzione un sistema di ML che ora gira solo nel locale del nostro data scientist ?
  • 2. DevOps & MLOps - IDI 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
  • 3. DevOps & MLOps - IDI 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
  • 4. DevOps & MLOps - IDI 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
  • 5. DevOps & MLOps - IDI 2024 SUMMARY DevOps methods & actors MLOps methods & actors Use case AWS services What we take home
  • 6. DevOps & MLOps - IDI 2024 reference
  • 7. DevOps & MLOps - IDI 2024 DevOps methods & actors
  • 8. DevOps & MLOps - IDI 2024 DevOps methods & actors
  • 9. DevOps & MLOps - IDI 2024 DevOps methods & actors
  • 10. DevOps & MLOps - IDI 2024 MLOps methods & actors
  • 11. DevOps & MLOps - IDI 2024 ML system & actors
  • 12. DevOps & MLOps - IDI 2024 reference
  • 13. DevOps & MLOps - IDI 2024 reference
  • 14. DevOps & MLOps - IDI 2024 ML system & actors
  • 15. DevOps & MLOps - IDI 2024 MLOps methods & actors
  • 16. DevOps & MLOps - IDI 2024 MLOps methods & actors
  • 17. DevOps & MLOps - IDI 2024 reference
  • 18. DevOps & MLOps - IDI 2024 Use case
  • 19. DevOps & MLOps - IDI 2024 Use case
  • 20. DevOps & MLOps - IDI 2024 Use case
  • 21. DevOps & MLOps - IDI 2024 reference
  • 22. DevOps & MLOps - IDI 2024
  • 23. DevOps & MLOps - IDI 2024 AWS services
  • 24. DevOps & MLOps - IDI 2024 AWS services
  • 25. DevOps & MLOps - IDI 2024 AWS Step Functions
  • 26. DevOps & MLOps - IDI 2024 AWS Step Functions https://github.com/aws/aws-step-functions-data-science-sdk-python
  • 27. DevOps & MLOps - IDI 2024 AWS services
  • 28. DevOps & MLOps - IDI 2024 AWS services
  • 29. DevOps & MLOps - IDI 2024 Amazon SageMaker Pipeline
  • 30. DevOps & MLOps - IDI 2024 Amazon SageMaker Pipeline https://github.com/aws/amazon-sagemaker-examples/tree/main/sagemaker-pipeline-parameterization
  • 31. DevOps & MLOps - IDI 2024 reference
  • 32. DevOps & MLOps - IDI 2024 What we take home
  • 33. DevOps & MLOps - IDI 2024 Data Scientist & Cloud Engineer 1 How to survive with colleagues with different skills, without hindering the table football game during the lunch break. 2 Versioning of configuration, training and inference data statistics, models, .. 3 Define tools and services: libraries, images, storages, .. 4 Define guidelines for who does what: review, support, deploying the model, .. Promoting resources awareness to be used
  • 34. DevOps & MLOps - IDI 2024 AWS services
  • 35. DevOps & MLOps - IDI 2024 Step Functions vs SageMaker Pipeline
  • 36. DevOps & MLOps - IDI 2024 AWS services Which AWS services for which role, when we want to automate a solution from local to production: depends on the life cycle of the model but above all by the actors involved. Data Scientists (DS) Cloud Engineer (CE) DS AWS Services CE AWS Services many one AWS Step Functions AWS CloudFormation one many Amazon SageMaker Pipeline AWS CloudFormation & Step Functions
  • 37. DevOps & MLOps - IDI 2024 AWS services Which AWS services for which model, when we have a small model, we can also use something like AWS Lambda, but when we need GPU, we must to use an Endpoint. AWS Service Provisioning type Resources Cost per hour Endpoint Provisioned 2 CPU + 4GB RAM $0.056 Endpoint Serverless 4096MB $0.288 AWS Lambda Serverless 4096MB $0.00024012 +GBsec
  • 38. DevOps & MLOps - IDI 2024 Thanks for listening!