Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2FWc5Sk.
Ben Sigelman talks about "Deep Systems", their common properties and re-introduces the fundamentals of control theory from the 1960s, including the original conceptualizations of Observability & Controllability. He uses examples from Google & other companies to illustrate how deep systems have damaged people's ability to observe software, and what needs to be done in order to regain control. Filmed at qconsf.com.
Ben Sigelman is a co-founder and the CEO at LightStep, a co-creator of Dapper (Google’s distributed tracing system), and co-creator of the OpenTracing and OpenTelemetry projects (both part of the CNCF). His work and interests gravitate towards observability, especially where microservices, high transaction volumes, and large engineering organizations are involved.
Architectures That Scale Deep - Regaining Control in Deep Systems
1. Ben Sigelman (@el_bhs, bhs@lightstep.com)
Co-founder & CEO: LightStep
Co-creator: OpenTracing, OpenTelemetry, Google Dapper, Google Monarch
Architectures that Scale Deep:
Regaining Control in Deep Systems
QCon SF, November 2019
2. InfoQ.com: News & Community Site
• Over 1,000,000 software developers, architects and CTOs read the site world-
wide every month
• 250,000 senior developers subscribe to our weekly newsletter
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• 2 dedicated podcast channels: The InfoQ Podcast, with a focus on
Architecture and The Engineering Culture Podcast, with a focus on building
• 96 deep dives on innovative topics packed as downloadable emags and
minibooks
• Over 40 new content items per week
Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
properties-deep-systems/
3. Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
Presented at QCon San Francisco
www.qconsf.com
21. Deep Systems
Architectures with ≥ 4 layers of
independently operated services
(including external/cloud dependencies)
Deep Systems
Architectures with ≥ 4 layers of
independently operated services
(including external/cloud dependencies)
24. “Where’s Chris?! I’m dealing with
a P0 and they’re the only one
who knows how to debug this.”
What do deep systems sound like?
25. “It can’t be our fault, our
dashboard says we’re healthy”
What do deep systems sound like?
26. “Kafka is on fire”
What do deep systems sound like?
27. “I need 100% availability
from your team.
One hundred percent.”
What do deep systems sound like?
28. “I didn’t know I depended on
that region”
What do deep systems sound like?
29. “That was on a dashboard but I
can’t find it”
What do deep systems sound like?
30. Lots of challenges:
- People-management
- Security
- Multi-tenancy
- “Big-customer” success
- Performance
- Observability
What do deep systems sound like?
45. Managing Deep Systems
Services must have SLOs
(“Service Level Objectives”: latency, errors, etc)
For effective service management, only
three things matter:
0. Releasing service functionality
1. Gradually improving SLOs
2. Rapidly restoring SLOs
In a deep system, we must control the
entire “triangle” to maintain our SLOs
47. Observability: “The Conventional Wisdom”
Observing microservices is hard
Google and Facebook solved this (right???)
They used Metrics, Logging, and Distributed Tracing…
… So we should, too.
68. Tracing is the backbone of
simple observability
in deep systems
69. Thank You
Feedback always
welcome:
twitter → @el_bhs
the emails → bhs@lightstep.com
Play with LightStep,
for free, anytime:
(no email address required!)
lightstep.com/play
70. Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
properties-deep-systems/