How To Love Kubernetes and Not Wreck The Planet (keynote)

A presentation at Continuous Lifecycle Online in May 2021 in by Holly Cummins

Slide 1

How to Love K 8 s a n d N o t Wrec k the P la net Holly Cummins IBM @holly_cummins

Slide 2

H ow to Love C l oud Na ti ve an d Not Wreck the Planet Holly Cummins IBM @holly_cummins

Slide 3

#IBMGarage @holly_cummins

Slide 4

#IBMGarage @holly_cummins

Slide 5

#IBMGarage @holly_cummins

Slide 6

continuous delivery #IBMGarage @holly_cummins

Slide 7

continuous delivery 20 to 60 code changes are submitted every minute #IBMGarage @holly_cummins

Slide 8

#IBMGarage @holly_cummins

Slide 9

#IBMGarage @holly_cummins

Slide 10

#IBMGarage @holly_cummins

Slide 11

#IBMGarage @holly_cummins

Slide 12

#IBMGarage @holly_cummins

Slide 13

#IBMGarage @holly_cummins

Slide 14

how many pipelines? #IBMGarage @holly_cummins

Slide 15

#IBMGarage @holly_cummins

Slide 16

how much energy does that use? #IBMGarage @holly_cummins

Slide 17

how much energy does that use? #IBMGarage @holly_cummins

Slide 18

code #IBMGarage @holly_cummins

Slide 19

oil code #IBMGarage @holly_cummins

Slide 20

code #IBMGarage ~= oil @holly_cummins

Slide 21

80% of energy is fossil fuels #IBMGarage @holly_cummins

Slide 22

80% of (US) energy is fossil fuels #IBMGarage @holly_cummins

Slide 23

why does this matter? #IBMGarage @holly_cummins

Slide 24

why does this matter? oh. #IBMGarage @holly_cummins

Slide 25

the earth is getting warmer #IBMGarage @holly_cummins

Slide 26

the earth is getting warmer #IBMGarage @holly_cummins

Slide 27

warmer #IBMGarage @holly_cummins

Slide 28

uncomfortably warmer #IBMGarage @holly_cummins

Slide 29

uncomfortably warmer drought #IBMGarage @holly_cummins

Slide 30

uncomfortably warmer drought floods #IBMGarage @holly_cummins

Slide 31

uncomfortably warmer drought floods submersion #IBMGarage @holly_cummins

Slide 32

uncomfortably warmer drought floods submersion hurricanes #IBMGarage @holly_cummins

Slide 33

uncomfortably warmer drought floods submersion hurricanes fires #IBMGarage @holly_cummins

Slide 34

#IBMGarage @holly_cummins

Slide 35

our industry contributes to climate change #IBMGarage @holly_cummins

Slide 36

we contribute to climate change #IBMGarage @holly_cummins

Slide 37

data centres 1-2% #IBMGarage @holly_cummins

Slide 38

#IBMGarage data centres aviation 1-2% 2.5% @holly_cummins

Slide 39

#IBMGarage data centres aviation 1-2% 2.5% @holly_cummins

Slide 40

#IBMGarage data centres aviation 1-2% 2.5% @holly_cummins

Slide 41

#IBMGarage data centres aviation 1-2% 2.5% @holly_cummins

Slide 42

the dream #IBMGarage @holly_cummins

Slide 43

the dream #IBMGarage @holly_cummins

Slide 44

the dream #IBMGarage @holly_cummins

Slide 45

#IBMGarage @holly_cummins

Slide 46

#IBMGarage @holly_cummins

Slide 47

kubesprawl #IBMGarage @holly_cummins

Slide 48

the cluster is the unit of deployment #IBMGarage @holly_cummins

Slide 49

21 clusters per IBM Cloud account #IBMGarage @holly_cummins

Slide 50

21 clusters per IBM Cloud account #IBMGarage @holly_cummins

Slide 51

utilisation elasticity #IBMGarage @holly_cummins

Slide 52

application #IBMGarage @holly_cummins

Slide 53

application control plane #IBMGarage @holly_cummins

Slide 54

application manual replica count horizontal auto-scaling control plane #IBMGarage @holly_cummins

Slide 55

! clusters are less elastic than applications manual replica count horizontal auto-scaling application control plane #IBMGarage @holly_cummins

Slide 56

! clusters are less elastic than applications application control plane ! every cluster has overhead #IBMGarage @holly_cummins

Slide 57

#IBMGarage @holly_cummins

Slide 58

#IBMGarage @holly_cummins

Slide 59

serverless? #IBMGarage @holly_cummins

Slide 60

serverless? #IBMGarage @holly_cummins

Slide 61

serverless? #IBMGarage @holly_cummins

Slide 62

dr. malice #IBMGarage @holly_cummins

Slide 63

namespaces #IBMGarage @holly_cummins

Slide 64

namespace isolation is not enough #IBMGarage @holly_cummins

Slide 65

conway’s law is for clusters, too #IBMGarage @holly_cummins

Slide 66

#IBMGarage @holly_cummins

Slide 67

noisy neighbours #IBMGarage @holly_cummins

Slide 68

name collisions scope errors #IBMGarage @holly_cummins

Slide 69

#IBMGarage @holly_cummins

Slide 70

dev staging prod that weird experiment #IBMGarage @holly_cummins

Slide 71

is this a win? lots of applications control plane #IBMGarage @holly_cummins

Slide 72

zombie workload #IBMGarage @holly_cummins

Slide 73

2017 survey 25% of 16,000 servers doing no useful work #IBMGarage @holly_cummins

Slide 74

2017 survey 25% of 16,000 servers doing no useful work “perhaps someone forgot to turn them off” #IBMGarage @holly_cummins

Slide 75

Hey boss, I created a Kubernetes cluster. #IBMGarage @holly_cummins

Slide 76

Hey boss, I created a Kubernetes cluster. I forgot it for 2 months. #IBMGarage @holly_cummins

Slide 77

Hey boss, I created a Kubernetes cluster. I forgot it for 2 months. … and it’s £1000 a month. #IBMGarage @holly_cummins

Slide 78

== £ #IBMGarage @holly_cummins

Slide 79

#IBMGarage @holly_cummins

Slide 80

is there a solution? #IBMGarage @holly_cummins

Slide 81

let’s figure out what all these cloud workloads are, since I’m paying for them IT Department, UK Bank #IBMGarage long meetings @holly_cummins

Slide 82

let’s figure out what all these cloud workloads are, since I’m paying for them IT Department, UK Bank #IBMGarage long meetings @holly_cummins

Slide 83

tags #IBMGarage @holly_cummins

Slide 84

#IBMGarage @holly_cummins

Slide 85

governance #IBMGarage @holly_cummins

Slide 86

make it easiest to do the right thing #IBMGarage @holly_cummins

Slide 87

make it easiest to do the right thing #IBMGarage @holly_cummins

Slide 88

finops #IBMGarage @holly_cummins

Slide 89

large bank, 2013 50% reduction in CPUs with a lease system #IBMGarage @holly_cummins

Slide 90

large bank, 2013 50% reduction in CPUs with a lease system #IBMGarage @holly_cummins

Slide 91

“chaos testing” (turning it off and waiting for shrieks) #IBMGarage @holly_cummins

Slide 92

multicloud management #IBMGarage @holly_cummins

Slide 93

traffic monitoring #IBMGarage @holly_cummins

Slide 94

is K8s the solution? #IBMGarage @holly_cummins

Slide 95

is K8s the solution? (is K8s zombie-proof?) #IBMGarage @holly_cummins

Slide 96

is the cloud zombie-proof? #IBMGarage @holly_cummins

Slide 97

shut it down? but … what if I need this cluster later? #IBMGarage @holly_cummins

Slide 98

the IKEA cognitive bias #IBMGarage @holly_cummins

Slide 99

#IBMGarage @holly_cummins

Slide 100

gitops #IBMGarage @holly_cummins

Slide 101

gitops (infrastructure as code) #IBMGarage @holly_cummins

Slide 102

#IBMGarage @holly_cummins

Slide 103

spin it down #IBMGarage @holly_cummins

Slide 104

spin it down spin it up kubectl apply -f all-my-cluster/ #IBMGarage @holly_cummins

Slide 105

spin it down spin it up kubectl apply -f all-my-cluster/ #IBMGarage @holly_cummins

Slide 106

spin it down spin it up kubectl apply -f all-my-cluster/ #IBMGarage @holly_cummins

Slide 107

spinning down clusters: the new lights off? #IBMGarage @holly_cummins

Slide 108

spinning down clusters: the new lights off? oh. it is. #IBMGarage @holly_cummins

Slide 109

shutting down instances out of hours reduced costs by 37% #IBMGarage (thanks for the statistic, @darkandnerdy) @holly_cummins

Slide 110

cautions #IBMGarage @holly_cummins

Slide 111

beware micro-optimisation theatre #IBMGarage @holly_cummins

Slide 112

#IBMGarage @holly_cummins

Slide 113

“unsustainable” #IBMGarage @holly_cummins

Slide 114

“sustainable” #IBMGarage @holly_cummins

Slide 115

“sustainable” #IBMGarage @holly_cummins

Slide 116

fixing the wrong problem #IBMGarage @holly_cummins

Slide 117

but … every little helps… #IBMGarage @holly_cummins

Slide 118

think about the other things you’re not optimising #IBMGarage @holly_cummins

Slide 119

knowledge helps us focus on optimisations that matter #IBMGarage @holly_cummins

Slide 120

#IBMGarage @holly_cummins

Slide 121

jevons’ paradox #IBMGarage @holly_cummins

Slide 122

the highway problem #IBMGarage @holly_cummins

Slide 123

what we imagine when we widen roads #IBMGarage @holly_cummins

Slide 124

what we get #IBMGarage @holly_cummins

Slide 125

unsolved problem opportunity #IBMGarage @holly_cummins

Slide 126

sustainability == continuous lifecycle #IBMGarage @holly_cummins

Slide 127

1-2% #IBMGarage @holly_cummins

Slide 128

tool creators, support 1-2% #IBMGarage @holly_cummins

Slide 129

tool creators, support better utilisation elasticity multi-tenancy de-zombification visibility disposability #IBMGarage 1-2% @holly_cummins

Slide 130

1-2% #IBMGarage @holly_cummins

Slide 131

users … 1-2% #IBMGarage @holly_cummins

Slide 132

users … up utilisation aim for elasticity limit kubesprawl de-zombification know what you’re using turn it off #IBMGarage 1-2% @holly_cummins

Slide 133

questions @holly_cummins #IBMGarage @holly_cummins