SlideShare a Scribd company logo
1 of 59
Download to read offline
#DataDevOps
A MANIFESTO FOR A DEVOPS-LIKE
CULTURE SHIFT IN DATA &
ANALYTICS
SEBASTIAN HEROLD
DR. ARIF WIDER
2018-06-26
MUNICH
2
Sebastian Herold
Big Data Architect @ Zalando
@heroldamus
Previously 7 years @ Scout24
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics
4
Data Challenges
Data Manifesto
AI Empowerment
Data Architecture
Data-Driven Company
AGENDA
DataDevOps Culture
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
5
> 300,000
product choices
as at June 2018
ZALANDO IN NUMBERS
~4.5billion EURO
revenue 2017
> 75%
of visits via
mobile devices
> 200
million
visits
per
month
> 23
millionactive customers
> 15,000
employees in
Europe
17
countries
~ 2,000
brands
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
6
ZALANDO IN NUMBERS
GB/s on Kafka read
>2
People in Tech
>2000
Dev Teams
>250
MSTR User
>2000
AWS Accounts
>260
Data Scientists
>150
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
7
DATA CHALLENGES
FRAUD
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
8
DATA CHALLENGES
PRICING &
FORECASTING
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
9
DATA CHALLENGES
PERSONALISATION
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
10
DATA CHALLENGES
SIZING
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
11
DATA CHALLENGESVISUAL
SEARCH
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
12
DATA CHALLENGES
MANY
MORE
13
AI EMPOWERMENT
INSTITUTIONALISING
MACHINE LEARNING
AT SCALE
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
INNOVATION
TOP-DOWN vs BOTTOM-UP
15 TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
BEGINNERS EXPERTSAI MATURITY
2017
2018
2019
AI SKILLS SHIFT
TIME
16
FACETS OF INSTITUTIONALISING
Processes InfrastructureData Quality
Education Marketing Serving EventsData
Metadata Sharability Compliance ConnectivityGuilds
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
17
MSTR
Learn
TEAMAIMATURITY
Define Explore Extract Model Serve Observe
“LEVEL ZERO”
ANALYTICS &
REPORTING
AI EXPERTS
DATA PRODUCT JOURNEY
Basic
Training
Offers
BI Consulting
AI
Consulting
AI Literacy
Training
Expert Training
Data Science
Guild
MS Excel
Data Catalog
incl. meta
data
SQL Engine / SuperSet
Kafka
Jupyter Notebook Hub
ETL RStudio Shiny
Spark
DIFFERENT OFFERS FOR DIFFERENT PEOPLE & STEPS
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
18
WHERE WE CAME FROM: DISTRIBUTED DATA PLATFORMS
ZALON’S
DATA PLATFORM
FASHION STORE’S
DATA PLATFORM
OTHER BUSINESS UNIT’S
DATA PLATFORMBI PLATFORM
OTHER BUSINESS UNIT’S
DATA PLATFORM
CENTRAL
DATA PLATFORM
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
19
WHERE WE WANT TO GO: INTEGRATED DATA PLATFORM
FASHION STORE’S
DATA PLATFORM
OTHER BUSINESS UNIT’S
DATA PLATFORM
OTHER BUSINESS UNIT’S
DATA PLATFORM
CENTRAL
DATA PLATFORM ZALON’S
DATA PLATFORM
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
20
DATA PLATFORM DESIGN PRINCIPLES
CLOUD FIRST DATA FRESHNESS & QUALITY
MERGE ANALYTICS AND DATA SCIENCE EMPOWER CONSUMERS AND PRODUCERS
INNOVATION
SCALABILITY
FLEXIBILITY
STREAMING
MICRO-BATCHING
BI AI
SELF-SERVICE
RESPONSIBILITIES
TOOLING
ROLES
METADATA
PROCESSES
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
21
DATA PLATFORM ARCHITECTURE
DBs
MicroServices
GAP/Others
Data Sources
22
DATA PLATFORM ARCHITECTURE
DBs
MicroServices
GAP/Others
Data Sources Ingestion
Event-Bus
Batch or Delta
Loads + CDC
Connectors
Data Gateway
23
DBs
MicroServices
GAP/Others
Data Sources Ingestion Storage
Event-Bus
Batch or Delta
Loads + CDC
Connectors
Data Storage
Data Catalog
Data Gateway
Model
Repo
DATA PLATFORM ARCHITECTURE
Metadata Flow
Data Flow
24
DBs
MicroServices
GAP/Others
Data Sources Ingestion Storage Processing
Event-Bus
Batch or Delta
Loads + CDC
Connectors
Data Storage
Data Catalog Orchestration
Batch Process.
Acceleration Layer
SQL Engine
Stream Process.
Data Gateway
Model
Repo
Model Serving
DATA PLATFORM ARCHITECTURE
Metadata Flow
Data Flow
25
DATA PLATFORM ARCHITECTURE
DBs
MicroServices
GAP/Others
Data Sources Ingestion Storage Processing
Event-Bus
Batch or Delta
Loads + CDC
Connectors
Data Storage
Data Catalog Orchestration
Batch Process.
Acceleration Layer BI Tools
SQL/Apps
Notebooks
Data Catalog UI
SQL Engine
Stream Process.
Data Gateway
Model
Repo
Model Serving
Access
Metadata Flow
Data Flow
26
DATA PLATFORM ARCHITECTURE
Governance
Processes & Glossary
DBs
MicroServices
GAP/Others
Data Sources Ingestion Storage Processing
Event-Bus
Batch or Delta
Loads + CDC
Connectors
Data Storage
Data Catalog Orchestration
Batch Process.
Acceleration Layer BI Tools
SQL/Apps
Notebooks
Data Catalog UI
SQL Engine
Stream Process.
Data Gateway
Model
Repo
Model Serving
Access
Metadata Flow
Data Flow
27
MERGE OF BI AND DATA SCIENCE JOURNEY
BI Product
Journey
AI Product
Journey≈
Learn Define Explore Extract Model Serve Observe
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
28
MERGE OF BI AND DATA SCIENCE JOURNEY
BI Product
Journey
AI Product
Journey≈
Explore Extract Model Serve ObserveLearn Define
LET’S FOCUS ON THE TECHNICAL PART !
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
29
BI Product
Journey
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
30
BI PRODUCT JOURNEY
EXPLORATION
Explore Extract Model Serve Observe
Data Catalog UI
31
BI PRODUCT JOURNEY
EXTRACTION
Explore Extract Model Serve Observe
32
BI PRODUCT JOURNEY
MODELING
Explore Extract Model Serve Observe
33
BI PRODUCT JOURNEY
SERVING
Explore Extract Model Serve Observe
34
BI PRODUCT JOURNEY
OBSERVING
Explore Extract Model Serve Observe
35
AI Product
Journey
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
36
AI PRODUCT JOURNEY
EXPLORATION
Explore Extract Model Serve Observe
Data Catalog UI
37
AI PRODUCT JOURNEY
EXTRACTION
Explore Extract Model Serve Observe
38
AI PRODUCT JOURNEY
Explore Extract Model Serve Observe
Model Repo
MODELING
39
Panda Serving
AI PRODUCT JOURNEY
SERVING
Explore Extract Model Serve Observe
40
AI PRODUCT JOURNEY
OBSERVING
Explore Extract Model Serve Observe
41 TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
THE DATA DRIVEN COMPANY
“The McKinsey Global Institute indicates that data driven organizations
are 23 times more likely to acquire customers, 6 times as likely to retain
those customers, and 19 times as likely to be profitable as a result.”
What does “data driven” mean
● Data is a key asset of the company
● All decisions in the company (products and processes) are data-driven, i.e. based on objective
data insights
● Data Analytics and Data Science are common place in the company
● Company-wide data-architecture in place
● Company-wide data governance rules in place
Source: https://www.mckinsey.com/business-functions/marketing-and-sales/our-insights/five-facts-how-customer-analytics-boosts-corporate-performance
42
DATA MANIFESTO
THEMES FOR A
DATA-DRIVEN COMPANY
AT SCALE
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
43
M
ETRIC
CONSUMER
DATA LANDSCAPE
DATA
PRODUCER
THEMES FOR DATA AT SCALE
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
44
M
ETRIC
CONSUMER
DATA LANDSCAPE
DATA
PRODUCER
THEMES FOR DATA AT SCALE
AutonomyAutonomy
Alignment
Ownership
Platform
Transparency
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
45
M
ETRIC
CONSUMER
DATA LANDSCAPE
DATA
PRODUCER
THEMES FOR DATA AT SCALE
Autonomy
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
46
M
ETRIC
CONSUMER
DATA LANDSCAPE
DATA
PRODUCER
THEMES FOR DATA AT SCALE
Autonomy
Alignment
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
47
M
ETRIC
CONSUMER
DATA LANDSCAPE
DATA
PRODUCER
THEMES FOR DATA AT SCALE
Autonomy
Alignment
Ownership
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
48
M
ETRIC
CONSUMER
DATA PLATFORM
DATA LANDSCAPE
DATA
PRODUCER
THEMES FOR DATA AT SCALE
Autonomy
Alignment
Ownership
Platform
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
49
M
ETRIC
CONSUMER
DATA PLATFORM
DATA LANDSCAPE
DATA
PRODUCER
THEMES FOR DATA AT SCALE
Autonomy
Alignment
Ownership
Platform
Transparency
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
50
AWSCENTRAL DATA LAKE ON S3
ROLES & RESPONSIBILITIES
DATA CATALOG
DATA INFRA
CHECKOUT
SERVICE
PRODUCER
SPECIAL
OFFER
SERVICE
CONSUMER
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
51
AWSCENTRAL DATA LAKE ON S3
ROLES & RESPONSIBILITIES
DATA CATALOG
DATA INFRA
ORDER EVENTS
EVENT METADATA
CHECKOUT
SERVICE
PRODUCER
SPECIAL
OFFER
SERVICE
CONSUMER
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
52
AWSCENTRAL DATA LAKE ON S3
ROLES & RESPONSIBILITIES
ORDER EVENTS
EVENT METADATA
CHECKOUT
SERVICE
DATA CATALOG
PRODUCER
DATA INFRA
INGESTION TEMPLATE
SPECIAL
OFFER
SERVICE
CONSUMER
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
53
AWSCENTRAL DATA LAKE ON S3
ROLES & RESPONSIBILITIES
ORDER EVENTS
EVENT METADATA
CHECKOUT
SERVICE
DATA CATALOG
PRODUCER
DATA INFRA
INGESTION TEMPLATE VIEW: ORDER HISTORY BY USER
SPECIAL
OFFER
SERVICE
CONSUMER
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
54
DATADEVOPS
A CULTURE OF
DISTRIBUTED RESPONSIBILITIES
ABOUT DATA & ANALYTICS
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
55
DATADEVOPS
WHAT IS DEVOPS?
Distributed
Ops skills
Shared Ops
responsibilities
Self-service
platforms
Cross-functional
dev teams
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
56
DATADEVOPS
WHAT IS DATADEVOPS?
Distributed
Data skills
Shared Data
responsibilities
Self-service
Data platform
Cross-functional
product teams
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
57
Consequences for Product Teams
‣ Think about data & reporting
‣ Deliver your data to the lake
‣ Provide meta data
‣ Eat your own dog food: Consume your own data
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
58
Benefits for Product Teams
‣ Independently work with data
‣ No dependencies to data teams
‣ It’s easy to consume data produced by other teams
‣ Faster product & measurement iterations
TDWI’18 Munich - DataDevOps - Sebastian Herold & Arif Wider
THANKS!
QUESTIONS?
A MANIFESTO FOR A DEVOPS-LIKE
CULTURE SHIFT IN DATA &
ANALYTICS
SEBASTIAN HEROLD
DR. ARIF WIDER
2018-06-26
MUNICH

More Related Content

What's hot

Build a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo CarsBuild a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo CarsNeo4j
 
The Challenges of model based and traditional plm
The Challenges of model based and traditional plmThe Challenges of model based and traditional plm
The Challenges of model based and traditional plmJos Voskuil
 
Building Intelligent Solutions with Graphs, Stefan Kolmar, Neo4j
Building Intelligent Solutions with Graphs, Stefan Kolmar, Neo4jBuilding Intelligent Solutions with Graphs, Stefan Kolmar, Neo4j
Building Intelligent Solutions with Graphs, Stefan Kolmar, Neo4jNeo4j
 
Knowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph CompositionKnowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph CompositionNeo4j
 
Digital Business Engineering
Digital Business EngineeringDigital Business Engineering
Digital Business EngineeringBoris Otto
 
GraphTour 2020 - Neo4j: What's New?
GraphTour 2020 - Neo4j: What's New?GraphTour 2020 - Neo4j: What's New?
GraphTour 2020 - Neo4j: What's New?Neo4j
 
Industrial Data Space - Why we need a European Initiative on Data Sovereignty
Industrial Data Space - Why we need a European Initiative on Data SovereigntyIndustrial Data Space - Why we need a European Initiative on Data Sovereignty
Industrial Data Space - Why we need a European Initiative on Data SovereigntyThorsten Huelsmann
 
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesIndustrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesBoris Otto
 
Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...
Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...
Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...Team per la Trasformazione Digitale
 
Industry 4.0: Smart Service with InsideOut Ecosystem
Industry 4.0: Smart Service with InsideOut EcosystemIndustry 4.0: Smart Service with InsideOut Ecosystem
Industry 4.0: Smart Service with InsideOut EcosystemDr. Paul Gromball
 
INDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLE
INDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLEINDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLE
INDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLEThorsten Huelsmann
 
Session 1.3 semantic asset management in the dutch rail engineering and con...
Session 1.3   semantic asset management in the dutch rail engineering and con...Session 1.3   semantic asset management in the dutch rail engineering and con...
Session 1.3 semantic asset management in the dutch rail engineering and con...semanticsconference
 
Industrial Data Space Association - New Members, New Insights, New Future Dir...
Industrial Data Space Association - New Members, New Insights, New Future Dir...Industrial Data Space Association - New Members, New Insights, New Future Dir...
Industrial Data Space Association - New Members, New Insights, New Future Dir...Thorsten Huelsmann
 
The Road to Level 3 #COMIT2017
The Road to Level 3 #COMIT2017The Road to Level 3 #COMIT2017
The Road to Level 3 #COMIT2017Comit Projects Ltd
 
GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0Neo4j
 
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...Big Data Value Association
 
Introducing Industrial Data Space Initiative, CPDP Conferende 2017
Introducing Industrial Data Space Initiative, CPDP Conferende 2017Introducing Industrial Data Space Initiative, CPDP Conferende 2017
Introducing Industrial Data Space Initiative, CPDP Conferende 2017Thorsten Huelsmann
 
Ogi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokisOgi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokisOpenGovIntelligence
 
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018 Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018 DataBench
 
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE
 

What's hot (20)

Build a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo CarsBuild a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo Cars
 
The Challenges of model based and traditional plm
The Challenges of model based and traditional plmThe Challenges of model based and traditional plm
The Challenges of model based and traditional plm
 
Building Intelligent Solutions with Graphs, Stefan Kolmar, Neo4j
Building Intelligent Solutions with Graphs, Stefan Kolmar, Neo4jBuilding Intelligent Solutions with Graphs, Stefan Kolmar, Neo4j
Building Intelligent Solutions with Graphs, Stefan Kolmar, Neo4j
 
Knowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph CompositionKnowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph Composition
 
Digital Business Engineering
Digital Business EngineeringDigital Business Engineering
Digital Business Engineering
 
GraphTour 2020 - Neo4j: What's New?
GraphTour 2020 - Neo4j: What's New?GraphTour 2020 - Neo4j: What's New?
GraphTour 2020 - Neo4j: What's New?
 
Industrial Data Space - Why we need a European Initiative on Data Sovereignty
Industrial Data Space - Why we need a European Initiative on Data SovereigntyIndustrial Data Space - Why we need a European Initiative on Data Sovereignty
Industrial Data Space - Why we need a European Initiative on Data Sovereignty
 
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesIndustrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
 
Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...
Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...
Data & Analytics Framework - Raffaele Lillo, Chief Data Officer of Digital Tr...
 
Industry 4.0: Smart Service with InsideOut Ecosystem
Industry 4.0: Smart Service with InsideOut EcosystemIndustry 4.0: Smart Service with InsideOut Ecosystem
Industry 4.0: Smart Service with InsideOut Ecosystem
 
INDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLE
INDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLEINDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLE
INDUSTRIAL DATA SPACE - SOVEREIGN, SECURE, SIMPLE
 
Session 1.3 semantic asset management in the dutch rail engineering and con...
Session 1.3   semantic asset management in the dutch rail engineering and con...Session 1.3   semantic asset management in the dutch rail engineering and con...
Session 1.3 semantic asset management in the dutch rail engineering and con...
 
Industrial Data Space Association - New Members, New Insights, New Future Dir...
Industrial Data Space Association - New Members, New Insights, New Future Dir...Industrial Data Space Association - New Members, New Insights, New Future Dir...
Industrial Data Space Association - New Members, New Insights, New Future Dir...
 
The Road to Level 3 #COMIT2017
The Road to Level 3 #COMIT2017The Road to Level 3 #COMIT2017
The Road to Level 3 #COMIT2017
 
GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0
 
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
 
Introducing Industrial Data Space Initiative, CPDP Conferende 2017
Introducing Industrial Data Space Initiative, CPDP Conferende 2017Introducing Industrial Data Space Initiative, CPDP Conferende 2017
Introducing Industrial Data Space Initiative, CPDP Conferende 2017
 
Ogi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokisOgi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokis
 
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018 Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
 
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
 

Similar to DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics

DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics
DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & AnalyticsDataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics
DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & AnalyticsDr. Arif Wider
 
Building Audi’s enterprise big data platform
Building Audi’s enterprise big data platformBuilding Audi’s enterprise big data platform
Building Audi’s enterprise big data platformDataWorks Summit
 
apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...
apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...
apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...apidays
 
Building the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesBuilding the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesKevin Sigliano
 
DataDevOps - A Manifesto on Shared Data Responsibility in Times of Microservices
DataDevOps - A Manifesto on Shared Data Responsibility in Times of MicroservicesDataDevOps - A Manifesto on Shared Data Responsibility in Times of Microservices
DataDevOps - A Manifesto on Shared Data Responsibility in Times of MicroservicesDr. Arif Wider
 
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...Dr. Arif Wider
 
The 3 pillars of agile integration: Container, Connector and API
The 3 pillars of agile integration:  Container, Connector and APIThe 3 pillars of agile integration:  Container, Connector and API
The 3 pillars of agile integration: Container, Connector and APIJudy Breedlove
 
Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...
Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...
Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...Amazon Web Services
 
Big Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 ConferenceBig Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 ConferenceDavid Feinleib
 
2014 Future of Cloud Computing - 4th Annual Survey Results
2014 Future of Cloud Computing - 4th Annual Survey Results2014 Future of Cloud Computing - 4th Annual Survey Results
2014 Future of Cloud Computing - 4th Annual Survey ResultsMichael Skok
 
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)Denodo
 
The year 2027? How the new industrial revolution is influencing value creat...
The year 2027?  How the new industrial revolution is  influencing value creat...The year 2027?  How the new industrial revolution is  influencing value creat...
The year 2027? How the new industrial revolution is influencing value creat...Robin Teigland
 
Phil Carter of IDC: An analyst point of view
Phil Carter of IDC: An analyst point of viewPhil Carter of IDC: An analyst point of view
Phil Carter of IDC: An analyst point of viewVeritas Technologies LLC
 
Sap Leonardo - what is it, and why would I want one?
Sap Leonardo - what is it, and why would I want one?Sap Leonardo - what is it, and why would I want one?
Sap Leonardo - what is it, and why would I want one?Tom Raftery
 
Architecting a Digital Enterprise
Architecting a Digital EnterpriseArchitecting a Digital Enterprise
Architecting a Digital EnterpriseWSO2
 
Neo4j Graph Data Platform: Making Your Data More Intelligent
Neo4j Graph Data Platform: Making Your Data More IntelligentNeo4j Graph Data Platform: Making Your Data More Intelligent
Neo4j Graph Data Platform: Making Your Data More IntelligentNeo4j
 
Business Ecosystems Internet of Things at ABB
Business Ecosystems Internet of Things at ABBBusiness Ecosystems Internet of Things at ABB
Business Ecosystems Internet of Things at ABBMikko Marsio
 
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...Databricks
 
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe inside-BigData.com
 

Similar to DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics (20)

DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics
DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & AnalyticsDataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics
DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics
 
Building Audi’s enterprise big data platform
Building Audi’s enterprise big data platformBuilding Audi’s enterprise big data platform
Building Audi’s enterprise big data platform
 
apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...
apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...
apidays Paris 2022 - How GraphQL accelerates B2B Composable Commerce, Marco E...
 
Building the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesBuilding the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data Strategies
 
DataDevOps - A Manifesto on Shared Data Responsibility in Times of Microservices
DataDevOps - A Manifesto on Shared Data Responsibility in Times of MicroservicesDataDevOps - A Manifesto on Shared Data Responsibility in Times of Microservices
DataDevOps - A Manifesto on Shared Data Responsibility in Times of Microservices
 
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
 
The 3 pillars of agile integration: Container, Connector and API
The 3 pillars of agile integration:  Container, Connector and APIThe 3 pillars of agile integration:  Container, Connector and API
The 3 pillars of agile integration: Container, Connector and API
 
Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...
Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...
Industrial IoT: Connecting Existing Machines to Tomorrow's IoT, ft. Deutsche ...
 
Big Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 ConferenceBig Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 Conference
 
2014 Future of Cloud Computing - 4th Annual Survey Results
2014 Future of Cloud Computing - 4th Annual Survey Results2014 Future of Cloud Computing - 4th Annual Survey Results
2014 Future of Cloud Computing - 4th Annual Survey Results
 
Cerved Datascience Milan
Cerved Datascience MilanCerved Datascience Milan
Cerved Datascience Milan
 
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
 
The year 2027? How the new industrial revolution is influencing value creat...
The year 2027?  How the new industrial revolution is  influencing value creat...The year 2027?  How the new industrial revolution is  influencing value creat...
The year 2027? How the new industrial revolution is influencing value creat...
 
Phil Carter of IDC: An analyst point of view
Phil Carter of IDC: An analyst point of viewPhil Carter of IDC: An analyst point of view
Phil Carter of IDC: An analyst point of view
 
Sap Leonardo - what is it, and why would I want one?
Sap Leonardo - what is it, and why would I want one?Sap Leonardo - what is it, and why would I want one?
Sap Leonardo - what is it, and why would I want one?
 
Architecting a Digital Enterprise
Architecting a Digital EnterpriseArchitecting a Digital Enterprise
Architecting a Digital Enterprise
 
Neo4j Graph Data Platform: Making Your Data More Intelligent
Neo4j Graph Data Platform: Making Your Data More IntelligentNeo4j Graph Data Platform: Making Your Data More Intelligent
Neo4j Graph Data Platform: Making Your Data More Intelligent
 
Business Ecosystems Internet of Things at ABB
Business Ecosystems Internet of Things at ABBBusiness Ecosystems Internet of Things at ABB
Business Ecosystems Internet of Things at ABB
 
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
 
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
 

More from Dr. Arif Wider

Data Mesh - It's not about technology, it's about people
Data Mesh - It's not about technology, it's about peopleData Mesh - It's not about technology, it's about people
Data Mesh - It's not about technology, it's about peopleDr. Arif Wider
 
Continuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in ProductionContinuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in ProductionDr. Arif Wider
 
Continuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in ProductionContinuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in ProductionDr. Arif Wider
 
Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...
Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...
Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...Dr. Arif Wider
 
A High-Performance Solution to Microservice UI Composition @ XConf Hamburg
A High-Performance Solution to Microservice UI Composition @ XConf HamburgA High-Performance Solution to Microservice UI Composition @ XConf Hamburg
A High-Performance Solution to Microservice UI Composition @ XConf HamburgDr. Arif Wider
 
An Unexpected Solution to Microservices UI Composition
An Unexpected Solution to Microservices UI CompositionAn Unexpected Solution to Microservices UI Composition
An Unexpected Solution to Microservices UI CompositionDr. Arif Wider
 

More from Dr. Arif Wider (6)

Data Mesh - It's not about technology, it's about people
Data Mesh - It's not about technology, it's about peopleData Mesh - It's not about technology, it's about people
Data Mesh - It's not about technology, it's about people
 
Continuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in ProductionContinuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in Production
 
Continuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in ProductionContinuous Intelligence: Keeping your AI Application in Production
Continuous Intelligence: Keeping your AI Application in Production
 
Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...
Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...
Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...
 
A High-Performance Solution to Microservice UI Composition @ XConf Hamburg
A High-Performance Solution to Microservice UI Composition @ XConf HamburgA High-Performance Solution to Microservice UI Composition @ XConf Hamburg
A High-Performance Solution to Microservice UI Composition @ XConf Hamburg
 
An Unexpected Solution to Microservices UI Composition
An Unexpected Solution to Microservices UI CompositionAn Unexpected Solution to Microservices UI Composition
An Unexpected Solution to Microservices UI Composition
 

Recently uploaded

Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)Data & Analytics Magazin
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 

Recently uploaded (17)

Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 

DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & Analytics