AgileCamp Silicon Valley 2015: Unlock Excellence with Agile Metrics by Kathryn Kuhn

1. Unlock Excellence with
Agile Metrics
Data-Driven Continuous Improvement
September 2015 – Agile Camp Silicon Valley
@kathryn_e_kuhn
@goagilecamp
www.linkedin.com/in/kathrynekuhn

2. 2
©
2015
CA.
ALL
RIGHTS
RESERVED.
Kathryn Kuhn
Based on the San
Francisco Bay Area
Been doing this Agile
thing since 1998
The usual Agile
certifications meant to
impress you
GO STEELERS!

3. 3
©
2015
CA.
ALL
RIGHTS
RESERVED.
In
God
we
trust
All
others
bring
data
W.
Edwards
Deming

4. 4
©
2015
CA.
ALL
RIGHTS
RESERVED.
• We are a data-driven company
• This is data
• Therefore
• We should be driven by it

5. 5
©
2015
CA.
ALL
RIGHTS
RESERVED.
Oh my!

6. Question:
What Metrics are Coveted/
Abused/Over-used in Your
Organization?

7. 7
©
2015
CA.
ALL
RIGHTS
RESERVED.
Common Metrics Traps
What will impede our outcomes?

8. 8
©
2015
CA.
ALL
RIGHTS
RESERVED.
Common Metrics Traps
Manipulation
Unbalanced metrics
Costly KPIs
Availability bias
Mechanical decision-making
False negatives
- 8 -

9. 9
©
2015
CA.
ALL
RIGHTS
RESERVED.
Beware the One-Metric to Solve Them All

10. 10
©
2015
CA.
ALL
RIGHTS
RESERVED.
Photo
courtesy
of
Flickr
:
CreaQve
Commons

11. 11
©
2015
CA.
ALL
RIGHTS
RESERVED.
Photo
courtesy
of
Flickr
:
CreaQve
Commons

12. 12
©
2015
CA.
ALL
RIGHTS
RESERVED.
How Do I Unravel This All
What metrics help us achieve our desired outcomes?

13. 13
©
2015
CA.
ALL
RIGHTS
RESERVED.
First: You Need To Organize Based on
Outcomes
• How
Deep/Wide
is
our
Agile?
Adop%on
Outcomes
• Are
We
Delivering
Value
Faster?
Opera%ons
Outcomes
• Are
We
MeeQng
ExpectaQons?
Business
Outcomes

14. 14
©
2015
CA.
ALL
RIGHTS
RESERVED.
Second– You Need Context (2 dimensions)
Q1:
How
Mature
are
the
Agile
Prac-ces
of
Your
Group
(Team/Program/
Department/Business
Unit)?
Just
GeZng
Started
We’re
Doing
It
and
…..
We’re
Doing
Our
Best
and
We
Can
Improve

15. 15
©
2015
CA.
ALL
RIGHTS
RESERVED.
Q2: Which Layer of the
Business System are we
focused on?
Second– You Need Context (2 dimensions)

16. Activity
Q. What Metrics are you Using
to Track Agile Adoption?

17. 17
©
2015
CA.
ALL
RIGHTS
RESERVED.
Now Let’s Zero in on Operational
Metrics
Steering not Aiming

18. 18
©
2015
CA.
ALL
RIGHTS
RESERVED.
not
aiming
…
…
but
steering

19. 19
©
2015
CA.
ALL
RIGHTS
RESERVED.

20. 20
©
2015
CA.
ALL
RIGHTS
RESERVED.

21. 21
©
2015
CA.
ALL
RIGHTS
RESERVED.
Some of My Favorites: Do It Fast
Responsiveness: Feature Cycle Time
Velocity
(Planned
and
Actual)
/
Work
Capacity
e.g.,
In
Planning
we
average
6
stories
planned
per
human
per
sprint.
We
finish
about
2
stories
per
human
per
sprint
Productivity: Focus Factor *
hFp://www.scruminc.com/wp-­‐content/uploads/2014/05/Hyper-­‐Produc%ve-­‐Me%rcs.pdf

22. 22
©
2015
CA.
ALL
RIGHTS
RESERVED.
Some of My Favorites:
Do It On Time: Sprint Predictability Ranges
Keep Doing It: Employee NPS Score

23. 23
©
2015
CA.
ALL
RIGHTS
RESERVED.
Metrics Mantra #1: Teams Execute
Will we complete our work in a sprint
(stories, tasks, defects, etc.)?

24. 24
©
2015
CA.
ALL
RIGHTS
RESERVED.
Teams
Execute
-­‐
24
-­‐

25. 25
©
2015
CA.
ALL
RIGHTS
RESERVED.
Teams:
Consistency
over
Throughput

26. 26
©
2015
CA.
ALL
RIGHTS
RESERVED.
Metrics Mantra #2: Programs
Deliver Value
Will we meet our plan objectives
(features, milestones, quality, etc.)?

27. 27
©
2015
CA.
ALL
RIGHTS
RESERVED.
Programs Deliver Value

28. 28
©
2015
CA.
ALL
RIGHTS
RESERVED.
Tracking Release/”PI” Progress

29. 29
©
2015
CA.
ALL
RIGHTS
RESERVED.
Release / “PI” Tracking Dashboard

30. 30
©
2015
CA.
ALL
RIGHTS
RESERVED.
Metrics Mantra #4: Occasionally
Glance Backward

31. 31
©
2015
CA.
ALL
RIGHTS
RESERVED.
Consider Past Performance

32. 32
©
2015
CA.
ALL
RIGHTS
RESERVED.
2 Minutes on My Toothbrush
hcp://culQvaQngthought.com/author/aziz-­‐ansari/
“The notion of being
paralyzed and
inconvenienced by the
technology that was built
to make our lives easier is
fascinating to me.”

33. 33
©
2015
CA.
ALL
RIGHTS
RESERVED.
Thank you
kkuhn@rallydev.com
@kathryn_e_kuhn
www.linkedin.com/in/kathrynekuhn