Knative and Kubernetes - bringing serverless to more developers

@BretMcG github.com/bretmcg
Knative and Kubernetes:
Bringing serverless to more
developers
Bret McGowen
@BretMcG
Developer Advocate
Google
linktr.ee/bretmcg
Connect with me
GitHub - github.com/bretmcg
SlideShare - slideshare.net/bretmc
My LinkTree - inktr.ee/bretmcg
YouTube - youtube.com/c/BretMcG
Speaker Deck - speakerdeck.com/bretmcg
Sessionize - sessionize.com/bretmcg
LinkedIn - linkedin.com/in/bretmcgowen
Instagram - instagram.com/bret.mcgowen

Serverless swear words
Contai***s
Kubern****s
Infrastr****re
Offl*ne
Cluster of virt*** mach***s
.

Serverless model(s)
Operational model
Fully managed security Pay only for usage
No servers
Event-driven Open
Service-based
Programming model

Keep the serverless programming model,
however your infrastructure is managed.
Operational model
Fully managed security Pay only for usage
No servers
Event-driven Open
Service-based
Programming model

Hosted FaaS/compute
Easiest dev experience
Code focused
Limited runtime options
Serverless anywhere
Knative / GKE serverless addon
On prem or multi-cloud
Code or containers
Custom hardware (GPU, TPU, IoT, etc)
Offline
You manage infra
Serverless operational spectrum
Managed by your cloud
Container orchestration (k8s)
Not serverless for programming or ops
Container focused
You manage infra
Managed by your team
Serverless containers
Custom languages & runtimes
Infra still cloud-managed

Hosted FaaS/compute
Code focused
Hosted FaaS/compute
Container focused
You manage infra
Serverless anywhere
Code or containers
Offline
You manage infra

Serverless Compute on Cloud
Platform
App Engine Standard
Highly scalable, serverless web
applications.
Deploy and scale Applications
that react to Requests
Cloud Functions
Event-driven serverless
compute platform.
Deploy and scale Functions
that react to Events

Back end code functions that automatically run in
response to a trigger event
Microservices
Cloud "glue"
Node.js 6, Node.js 8, Python 3.7, Go 1.11 (bit.ly/gcf-go-alpha)
Pricing: per 100ms & based on allocated memory
Cloud Functions

Cloud Functions as cloud glue
Access 20+ Google
services from GCF
Cloud Storage
Cloud Pub/Sub
HTTPS
Firebase
Cloud Scheduler

Cloud Functions announcements
Generally Available (with SLA!)
Python 3.7, Node 8
Tokyo, Belgium, Iowa
Environment Variables
Cloud Scheduler
New!
Ubuntu 18.04 with many packages
(ffmpeg, imagemagick, headless Chrome)
Security Controls: VPC, IAM
Scaling Controls
Cloud SQL Direct Connect

App Engine: 2nd generation runtimes
New!
Pay for what you use, scale to zero
Open-source, idiomatic experience
Use any module, extension, or framework
New supported runtimes:
○ Node.js 8
○ Python 3.7
○ PHP 7.2

Container focused
You manage infra
Hosted FaaS/compute
Code focused
Serverless anywhere
Code or containers
Offline
You manage infra

First, a word about
containers....
Containers != Kubernetes
(I'm ﬁred now)

What are containers?
app
libs
kernel
libs
app app
kernel
app
libs
libs
kernel
kernel
libs
app
kernel
libs
app
libs
app
libs
app
kernel
libs
app
app app
app
Shared machines Virtual Machines Containers
x
x
x
x
x
x
No isolation
Common libs
Highly coupled apps
and OS
Isolation
No common libs
Expensive and inefficient
Hard to manage
Isolation
No common libs
Less overhead
Less dependency
on host OS

FROM python
RUN apt-get update && apt-get install -y blender
ENV APP_HOME /app
COPY . $APP_HOME
WORKDIR $APP_HOME
RUN pip install Flask
EXPOSE 8080
CMD ["python", "app.py"]
Don't be
afraid of this
Image
It’s a method of packaging
an application executable and
its dependencies (runtime,
libraries, configuration)
Runtime
and running as a set
of resource-isolated
processes.

Bad news friends...
All major clouds run their functions as containers
behind the scenes.

Everything at Google
runs in containers:
Gmail, Web Search, Maps, ...
MapReduce, batch, ...
GFS, Colossus, ...
Even GCE itself: VMs in containers
We launch over
4 billion containers
per week.

Demo: containers aren’t scary

Two serverless challenges today
Dependencies
Constrained runtimes,
frameworks and packages
Multi-Cloud
Unable to run your workloads
on-prem, in the cloud or on a
third party service provider
1 2

Secure on gVisor
Fully managed
BYO workloads
Pay for use & stateless
Alpha invitations coming
later this year
Sign up: g.co/serverlesscontainers
New: serverless containers on GCF (EAP)

Serverless anywhere
Code or containers
Offline
You manage infra
Serverless anywhere
Container focused
You manage infra
Hosted FaaS/compute
Code focused

Meet Knative: serverless on Kubernetes
Kubernetes-based
building blocks for
serverless workloads
Build - Serving - Events
*kay-native

Knative partners

Knative isn't
Not an open source FaaS developer-facing product
It's primitives, not a product
Not the right solution for everyone

The Knative stack
Kubernetes + Istio
Platform

The Knative stack
Knative
Build Serving Events
Kubernetes + Istio
Platform
Primitives

Knative
Build Serving Events
Kubernetes + Istio
Platform
Products
Serverless Containers on GCF GKE Serverless Add-on SAP Kyma
Pivotal Function Service IBM Cloud Functions Red Hat Cloud Functions
Primitives
riff OpenFaaS Jazz

What is Kubernetes?

*Sources: COCOMO Model, CNCF.io Certified Providers
442 Years of effort* 5,000+ Contributors 30k+ GitHub stars
The incredible Kubernetes ecosystem

Isolation: Keep jobs from interfering with
each other
Scheduling: Where should my job be run?
Lifecycle: Keep my job running
Discovery: Where is my job now?
Constituency: Who is part of my job?
Scale-up: Making my jobs bigger or smaller
Auth{n,z}: Who can do things to my job?
Monitoring: What’s happening with my job?
Health: How is my job feeling?
Container orchestration

Kubernetes abstracts away infrastructure
Nodes
Master

Developers using Kubernetes still have a lot to do
Have to do
Write code
Build docker image
Upload image to registry
Deploy service
Expose to the internet
Setup logging & monitoring
Scale workload
Want to do
Write code

Reasons for using Kubernetes (2014) vs
hosted serverless (2014)
Reduce lock-in
Performance
Multi-cloud
Customizability
Use custom hardware (GPU, TPU, IoT, etc)
Offline/reduced connectivity
Existing on-prem infrastructure
Existing applications

Everybody got all fired up
about Kubernetes and
microservices and then were
like ‘Oh s----, what’s going on?’
Istio lets us view our entire
system and find trouble spots.
Anonymous early adopter
Observability:

Traffic control Observability Fault-injection
Security Hybrid cloud
Istio

Example: canaries & traffic steering
destination: pictures.example.local
match:
httpHeaders:
user-agent:
regex: ^(.*?;)?(iPhone)(;.*)?$
precedence: 2
route:
- tags:
version: 2.0-alpha
env: staging
pictures
version: 2.0-alpha
env: staging
version: 1.5
env: prod
Proxy
Frontend
Pictures
Proxy
Pictures
Proxy

Kubernetes provides a good operator experience.
What about developer experience?

Demo: deploy an app on Knative

Knative Serving defines principled objects
Knative defines primitives with clear separation of concerns
So far, we used Service, a lite version of Knative objects
spec:
container:
image: gcr.io/knative-samples/simple-app:latest
env:
- name: SIMPLE_MSG
value: "Hello Serverlessconf SF!"
Service

Configuration
Service
Configuration
Current/desired state for your application
Code & configuration (separated, ala 12 factor)

Revision
Configuration
Service
Configuration
Revision
Point in time snapshots for your code and configuration

Revision
Configuration
Revision
Point in time snapshots for your code and configuration
Route
Maps traffic to a revisions
Supports fractional, named routing
Route
Configuration
Service

Demo: Blue-green deployment

Blue-green deployment model
Route
100%
Revision
Configuration
kind: Route
...
spec:
traffic:
- revisionName: blue-green-00001
percent: 100

kind: Route
...
spec:
traffic:
percent: 100
percent: 0
name: v2
Deploy updated version of the service
● Blue continues to take 100% of traﬃc
● Named route (v2) to green version
Revision
Route
100%
Revision
0%
v2
Configuration
Configuration

Update service conﬁguration
● Send % of traﬃc to green
● Still have explicit v2 route
kind: Route
...
spec:
traffic:
percent: 50
percent: 50
name: v2
Revision
Route
98%
Revision
2% (Experiment)
Configuration
Configuration
Revision
Route
Revision
Configuration
Configuration

Update service conﬁguration
● Incrementally add %, until all traﬃc is on green
● Keep explicit named route to blue
Secured with RBAC-based ACL
kind: Route
...
spec:
traffic:
percent: 0
name: v1
percent: 100
Revision
Route
0%
v1
Revision
100%
Configuration
Configuration
Revision
Route
Revision
Configuration
Configuration

Revision
Route
0%
v1
Revision
100%
Configuration
Configuration
Revision
Route
Revision
Configuration
Configuration
Demo: Deploying and updating live service

More Knative pieces
Knative Build enables source/git based deployments
Knative Events compatible with CNCF standard Cloud Events
Knative scales down when you don’t need it
Knative scales up linearly with your load
● Supports unpredictable usage pattern
● 1-n when you app starts taking traffic

Knative auto-builds
Supports GitOps or
src-to-URL
development patterns
Why developers care?
● No cross-compiling toil.
● No need for Docker locally.
● Cloud caching, faster
image push.
● Tooling ecosystem for
Enterprise Policy to audit
Builds.
Loosely coupled
● Use it to get started, and
graduate to decoupled CI.
● Keep your existing CI/CD
to get started, and
graduate to audited Builds.

Knative has opinions but is extensible
Knative API
● Event sources, event types
● Buildpack build templates
● Network configuration
● Logging targets
Some opinions
may not be ideal
for your use-case
Kubernetes
● Auto-scaling strategy
● Function invokers
● Message bus

GKE serverless add-on
Available for all later this year
Request early access today at
g.co/serverlessaddon GKE serverless add-on

The goal is more serverless
experiences for more
developers. Even if it’s not
perfectly serverless, happy devs
will drive organizational change.

Resources
cloud.google.com/serverless
Knative
github.com/knative
slack.knative.dev
GKE serverless add-on (sign-up)
g.co/serverlessaddon
Containers on Cloud Functions (sign-up)
g.co/serverlesscontainers
Thank you!
Bret McGowen
@BretMcG

Connect with me
GitHub - github.com/bretmcg
SlideShare - slideshare.net/bretmc
My LinkTree - inktr.ee/bretmcg
YouTube - youtube.com/c/BretMcG
Speaker Deck - speakerdeck.com/bretmcg
Sessionize - sessionize.com/bretmcg
LinkedIn - linkedin.com/in/bretmcgowen
Instagram - instagram.com/bret.mcgowen
Thank you!
Bret McGowen
@BretMcG

Knative and Kubernetes - bringing serverless to more developers

Recommended

Recommended

More Related Content

Similar to Knative and Kubernetes - bringing serverless to more developers

Similar to Knative and Kubernetes - bringing serverless to more developers (20)

More from Bret McGowen - NYC Google Developer Advocate

More from Bret McGowen - NYC Google Developer Advocate (9)

Recently uploaded

Recently uploaded (20)

Knative and Kubernetes - bringing serverless to more developers