Frank Pfleger & Lukasz Pielak @ JavaZone 2018, Norway

1. DISTRIBUTED TRACING
THE WAY TO

2. WHO ARE WE?
▸ Frank Pfleger
@frankpfleger
frank@trasier.com
▸ Lukasz Pielak
@lukaszpielak
lukasz@trasier.com

3. WHAT IS THIS TALK ABOUT
▸ Understand the concepts
▸ The way to Distributed Tracing
▸ Beyond Distributed Tracing

4. LOGGING VS
TRACING

5. LOGGING VS TRACING
LOGGING
Event in an application
at a given time

6. Retrospective

7. LOGGING VS TRACING
TRACING
▸ Bringing events in causal order
▸ Not Log4j’s Level.TRACE ;-)
▸ Mapped Diagnostic Context (MDC)

8. TRACING - MDC
Source: https://www.baeldung.com/mdc-in-log4j-2-logback

9. TRACING - MDC
Source: https://www.baeldung.com/mdc-in-log4j-2-logback

10. TRACEABILITY
OF SOFTWARE

11. TRACEABILITY OF SOFTWARE
MONOLITHIC
ARCHITECTURE

12. TRACEABILITY OF SOFTWARE
MONOLITHIC
ARCHITECTURE
▸ Difficult maintenance
▸ Long time to build
▸ Big bang release
▸ Profiling
▸ YourKit, VisualVM
▸ Flight Recorder

13. TRACEABILITY OF SOFTWARE
MICROSERVICES

14. TRACEABILITY OF SOFTWARE
MICROSERVICES

15. TRACEABILITY OF SOFTWARE
MICROSERVICES

16. TRACEABILITY OF SOFTWARE
▸ Difficult error detection (multiple
hosts / pods)
▸ Increased latency
▸ Service versioning
▸ Profilers not useful
▸ MDC limited
MICROSERVICES

17. TRACEABILITY OF SOFTWARE
MDC CONTEXT PROPAGATION
TK TK TK
TKTK
TK
TK
TK TK

18. DISTRIBUTED
TRACING

19. DISTRIBUTED TRACING
BRINGING EVENTS IN
CAUSAL ORDER
IN
DISTRIBUTED ENVIRONMENT

20. DISTRIBUTED TRACING
Span Trace Tree Trace Context Tracer

21. DISTRIBUTED TRACING

22. DISTRIBUTED TRACING
WHY DISTRIBUTED TRACING?
▸ Latency visualization
▸ Error analysis
▸ Infrastructure check
▸ Hidden architecture revealed

23. DISTRIBUTED TRACING
PROBLEMS OF DISTRIBUTED TRACING
▸ Trace Context
▸ Clock skew / synchronization
▸ Performance and stability
▸ Data ingestion and storage SERVICE B
SERVICE A
Latency measurement points

24. THE WAY TO
DISTRIBUTED TRACING

25. SERVICE B
SERVICE C
USER INTERFACE
Live Reporting
(Performance monitoring)
SERVICE A
Context propagation
(Service Instrumentation)
DATASTORE
BigData Store
(High-Performance / Indexing)
COLLECTOR
Decoupled Reporter
(Asynchronous collecting)
Common language
(Specification / Trace-Context)

26. TOOLING LANDSCAPE

27. TOOLING LANDSCAPE

28. TOOLING LANDSCAPE
Source: https://zipkin.io

29. TOOLING LANDSCAPE
Source: https://www.jaegertracing.io/docs/ & https://medium.com/@nakayamakenjiro/take-opentracing-for-torus-distirbuted-storage-4b475d8eafa4

30. APM - PROVIDERS
SUPPORT FOR OPENTRACING ENABLES

31. ▸ Finally a common carrier format … not yet
▸ traceparent
▸ version — trace-id — span-id — trace-flags
▸ tracestate
▸ key1=value1,key2=value2,…
THE WAY TO DISTRIBUTED TRACING
W3C RFC FOR A COMMON LANGUAGE

32. CONSIDER EXISTING SOLUTIONS
REUSABLE TRACE CONTEXT
DON’T UNDERESTIMATE YOUR DATA

33. BEYOND
DISTRIBUTED TRACING

34. BEYOND DISTRIBUTED TRACING
BUSINESS TRACING
EASY BUG TRIAGE
REPLAY CONVERSATIONS
MOCK SERVICES
BUSINESS ANALYSIS
PREDICTIVE ANALYSIS
DATA AS A SERVICE

35. BUSINESS TRACING
CONVERSATION AS A WHOLE

36. BUSINESS TRACING
CONVERSATION AS A WHOLE

37. BUSINESS TRACING
CONVERSATION AS A WHOLE

38. BUSINESS TRACING
INSPECT PAYLOAD OF TRANSACTIONS

39. THE POINT IS, YOU CAN NEVER
BE TOO GREEDY.
Donald Trump
BUSINESS TRACING

40. BEYOND DISTRIBUTED TRACING
BUSINESS TRACING
EASY BUG TRIAGE
REPLAY CONVERSATIONS
MOCK SERVICES
BUSINESS ANALYSIS
PREDICTIVE ANALYSIS
DATA AS A SERVICE

41. BEYOND DISTRIBUTED TRACING
BUSINESS TRACING
EASY BUG TRIAGE
REPLAY CONVERSATIONS
MOCK SERVICES
BUSINESS ANALYSIS
PREDICTIVE ANALYSIS
DATA AS A SERVICE

42. BEYOND DISTRIBUTED TRACING
BUSINESS TRACING
EASY BUG TRIAGE
REPLAY CONVERSATIONS
MOCK SERVICES
BUSINESS ANALYSIS
PREDICTIVE ANALYSIS
DATA AS A SERVICE

43. BEYOND DISTRIBUTED TRACING
BUSINESS TRACING
EASY BUG TRIAGE
REPLAY CONVERSATIONS
MOCK SERVICES
BUSINESS ANALYSIS
PREDICTIVE ANALYSIS
DATA AS A SERVICE

44. BEYOND DISTRIBUTED TRACING
BUSINESS TRACING
EASY BUG TRIAGE
REPLAY CONVERSATIONS
MOCK SERVICES
BUSINESS ANALYSIS
PREDICTIVE ANALYSIS
DATA AS A SERVICE

45. BEYOND DISTRIBUTED TRACING
BUSINESS TRACING
EASY BUG TRIAGE
REPLAY CONVERSATIONS
MOCK SERVICES
BUSINESS ANALYSIS
PREDICTIVE ANALYSIS
DATA AS A SERVICE

46. Q & MAYBE A;-)
▸ Lukasz Pielak
@lukaszpielak
lukasz@trasier.com
▸ Frank Pfleger
@frankpfleger
frank@trasier.com

47. THANK YOU
adesso Schweiz AG
Bahnhaldenstrasse 7
CH-8052 Zurich
T +41 58 520 98 00
adesso Schweiz AG
Morgenstrasse 129
CH-3018 Bern
T +41 58 520 97 00
adesso Schweiz AG
Viaduktstrasse 8
CH-4051 Basel
T +41 58 520 97 20
info@adesso.ch
www.adesso.ch