This document discusses the top 5 considerations for operating a Kubernetes environment at scale. It begins with introductions from Marko Bocevski of Keitaro and Patrick Lin of SignalFx. The agenda then covers challenges in cloud-native environments, Keitaro's experience managing Kubernetes at scale, and a demonstration of SignalFx's Kubernetes monitoring capabilities. Key benefits of SignalFx for Keitaro are discussed, along with next steps around integrating SignalFx and improving alerting. The presentation concludes with a Q&A.
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Top Considerations For Operating a Kubernetes Environment at Scale
1. MM/DD/YY
PREPARED FOR:
PLACE LOGO HERE
TOP 5 CONSIDERATIONS FOR OPERATING A
KUBERNETES ENVIRONMENT AT SCALE
Marko Bocevski, Co-Founder & CTO at Keitaro
Patrick Lin, VP Products at SignalFx
@signalfx | www.signalfx.com
3. AGENDA
• Challenges in Today’s Cloud-Native Environments
• Keitaro’s Experience in Managing Kubernetes at Scale
• Deep Dive into SignalFx’s New Kubernetes Monitoring
• What’s Next for Keitaro
• Q&A
4. @signalfx | www.signalfx.com4
CLOUD ERA HAS DRIVEN A NEW
TECHNOLOGY PLATFORM
Software Delivered
“As A Service”
Microservices
of enterprises expect
to monitor
microservices by the
end of 2018
Containers
of new workloads in
containers by 2019
Function as
a Service
Event-driven, short-lived
architectures with no
runtime access
using Lambda functions
in production
of software will be
delivered with a
subscription model
by 2020
>80%
Gartner: Market Trends: Prepare
Now to Smooth the Inevitable
Transition to a Subscription-Based
Business Model
>76% 12.3%
Gartner: How Microservices Have a
Macroeffect on APM
Gartner 2017 Strategic Roadmap for
Compute Infrastructure
Requiring more operational
oversight from Development
and enabling more
frequent updates
Decentralized application
architectures, requiring
strong collaboration
across teams
50%
Elastic architectures
provisioned directly by
engineering teams
2017 Key Takeaways from The State of
Modern Apps Report
5. @signalfx | www.signalfx.com5
DEV
• Plan
• Create
• Verify
• Package
• Release
• Configure
• Monitor
• Support
OPS
OPSDEV
• Plan
• Create
• Verify
• Package
• Release
• Configure
• Monitor
• Support
Throw it over the fence
OLD
Monolith
NEW
Microservices
AND A FUNDAMENTAL ORGANIZATION SHIFT
You write it. You run it.
6. @signalfx | www.signalfx.com6
LEADING TO NEW OPERATING MODELS
DEV OPSOLD
10x Teams
Monolith
PLAN | CREATE | VERIFY
NEW
PACKAGE | RELEASE | CONFIGURE MONITOR | SUPPORT
Microservices
100x Releases 1000x Dependencies
100x Components
7. TREND SOLUTION CRITERIA TECH REQUIREMENTS
1. Scale-out open source platforms,
microservices architectures
Monitoring service-wide aggregate
metrics vs. host-specific metrics
Streaming aggregation of composite
metrics
2. Containers and functions /
serverless
Instant discovery with real-time
monitoring
Streaming high-resolution metrics
3. Developer choice, decentralized
operations (loss of centralized
control)
Shared context across distributed
teams and instant visibility into any
changes in environment
Centralized, self-service, real-time
operational intelligence solution
4. High-velocity release cycles
Predictive analytics and proactive
alerting to identify emerging trends
Real-time streaming analytics, alerts,
anomaly detection, outlier detection
5. Troubleshooting across
distributed teams
Advanced real-time correlation and
dimensional analysis
Interactive, high-cardinality queries
and alerts
CLOUD-NATIVE MONITORING REQUIREMENTS
8. AGENDA
• Challenges in Today’s Cloud-Native Environments
• Keitaro’s Experience in Managing Kubernetes at Scale
• Deep Dive into SignalFx’s New Kubernetes Monitoring
• What’s Next for Keitaro
• Q&A
9. OVERVIEW OF
• Founded in 2011, based in Sweden
• Provides Linux and open-source software
consultancy with a strong focus in bleeding
edge technologies and managed services
• Key focus on providing docker and
kubernetes based services
• Customers across telecom, financial services,
education, tech, media, and government
5
Locations
36
Employees
100+
Finished or Ongoing
Projects
18
KUBERNETES
deployments
10. TODAY’S BUSINESS OBJECTIVES
• Increasing customer expectations for always-on apps
• Reimaging a highly collaborative Dev and Ops organizations
• Leveraging cutting-edge technologies
• Modernizing application deployments and availability
11. CUSTOMER USE CASE
VIDERUMS MOVE TO KUBERNETES
Viderum (http://www.viderum.com) is a SaaS provider of open
data management platforms
1. Implemented a SaaS solution that can scale to support thousands of customers using “traditional”
software - CKAN (http://www.ckan.org)
2. Setup based on a custom deployment of kubernetes including deis/workflow, traefik, crunchy
postgres, Ceph, Minio etc.
3. Implemented scaling and application/service clustering by utilizing data from kubernetes and docker
metrics
4. Simplified workflow and encapsulated a lot of the cluster complexity to the developers.
5. Optimized resources and enabled delivery of more than 100 data portals per node
6. Zero downtime for deployment and easy rollback.
7. Enabled deployment of new portals within seconds
12. SCALING KUBERNETES
Scaling is pretty easy, fast and without downtime
1. Scaling pods when you need more resources for any service
a. In mere seconds
b. Autoscaling
2. Scaling nodes when you need to grow performance
of whole cluster.
a. Seamless horizontal scaling
b. Built-in advanced mechanisms for load distribution
13. TOP CONSIDERATIONS IN DEPLOYING KUBERNETES
Kubernetes is a complex framework and it is up to you to use
it cleverly
1. Calculate at start all resources needed (cpu, memory, storage).
2. Plan good distribution of services across cluster like databases, caching, workload and
similar.
3. Implement good monitoring and metrics tools.
4. Understand your cluster and utilize the vast amount of metrics flowing through it
5. Kubernetes provides basis but is not enough, combine it with other tools that will help in
your use-case.
14. TOP CONSIDERATIONS IN OPERATING KUBERNETES
1) Automatic provisioning/decommissioning based on demand
2) Shorter lifecycle of containers / advent of microservices
3) Easy of spinning up new containers
4) Automatic placement by orchestrator (running different types of services
and don’t know where they are)
5) Engaging broader organization (business owners also need visibility and
access to key metrics)
15. AGENDA
• Challenges in Today’s Cloud-Native Environments
• Keitaro’s Experience in Managing Kubernetes at Scale
• Deep Dive into SignalFx’s New Kubernetes Monitoring
• What’s Next for Keitaro
• Q&A
16. INTRODUCING KUBERNETES MONITORING
DYNAMIC DETECTORS
Deliver On-Time Alerts That
Adapt To Fast-Moving Data
SIGNALFX SMART AGENT
Eliminate the Need to Manually
Configure for Each New
Container, App, or Service
OUT-OF-THE-BOX VISUALIZATIONS
Immediately Visualize Your Data
and Explore ’Up and Down’ The
Stack
The most comprehensive, real-time view into health and performance for orchestrated container environments
18. SIGNALFX SMART AGENT
• Based on SignalFx collectd agent
• Enhanced with service discovery and
auto-configuration when working in
conjunction with Kubernetes
• Deploy with out-of-the-box rules, then
customize for your specific use case
Eliminate the Need to Manually Configure for Each New Container, App, or Service
19. OUT-OF-THE-BOX KUBERNETES VISUALIZATIONS
• Top-to-bottom view to correlate
issues from app down to
infrastructure
- Architecture view
- Pods and nodes dashboards
- Built-in container content
• Links to related Navigator views to
explore 'up and down' the stack
• Monitoring for etcd as well
Immediately Visualize Your Data and Explore ’Up and Down’ The Stack
20. DYNAMIC DETECTORS
• On-time alerting optimized for high-
churn environments to minimize
discovery delay
• Built-in alert conditions great for finding
patterns and trends across dynamic
environments
Deliver On-Time Alerts That Adapt To Fast-Moving Data
21. AGENDA
• Challenges in Today’s Cloud-Native Environments
• Keitaro’s Experience in Managing Kubernetes at Scale
• Deep Dive into SignalFx’s New Kubernetes Monitoring
• What’s Next for Keitaro
• Q&A
22. KEY BENEFITS WITH SIGNALFX (TO DATE)
• Highly configurable views and alerts across nodes, containers, services and
applications
• Lots of integrations out of the box especially Kubernetes integration
• Pagerduty and Slack integration works flawlessy
• Real-time metrics collection
• Easy to use dashboards to get quick insights into key metrics and KPIs
23. WHAT’S NEXT FOR KEITARO
• Explore integrating SignalFx into customer applications
• Implement Kubernetes scaling triggers based on data from SignalFx
• Set up data views for customers
• Fine tune alerting and detection specifically for highly-available services
24. AGENDA
• Challenges in Today’s Cloud-Native Environments
• Keitaro’s Experience in Managing Kubernetes at Scale
• Deep Dive into SignalFx’s New Kubernetes Monitoring
• What’s Next for Keitaro
• Q&A
25. GET STARTED TODAY
• Read more about Kubernetes Monitoring from SignalFx
- docs.signalfx.com/en/latest/integrations/kubernetes-quickstart.html
• Start a free trial with SignalFx
- info.signalfx.com/trial.html
27. MM/DD/YY
PREPARED FOR:
PLACE LOGO HERE
TOP 5 CONSIDERATIONS FOR OPERATING A
KUBERNETES ENVIRONMENT AT SCALE
Marko Bocevski, Co-Founder & CTO at Keitaro
Patrick Lin, VP Product & Partnerships at SignalFx
@signalfx | www.signalfx.com