How to work in Tech and Not Wreck The Planet

A presentation at QCon Plus in November 2020 in by Holly Cummins

Slide 1

how to wor k in tech and not wreck the pl anet Holly Cummins IBM Garage @holly_cummins

Slide 2

we have a problem. #IBMGarage @holly_cummins

Slide 3

we have a problem. #IBMGarage @holly_cummins

Slide 4

the earth is getting warmer #IBMGarage @holly_cummins

Slide 5

the earth is getting warmer #IBMGarage @holly_cummins

Slide 6

warmer #IBMGarage @holly_cummins

Slide 7

uncomfortably warmer #IBMGarage @holly_cummins

Slide 8

uncomfortably warmer drought #IBMGarage @holly_cummins

Slide 9

uncomfortably warmer drought floods #IBMGarage @holly_cummins

Slide 10

uncomfortably warmer drought floods submersion #IBMGarage @holly_cummins

Slide 11

uncomfortably warmer drought floods submersion hurricanes #IBMGarage @holly_cummins

Slide 12

uncomfortably warmer drought floods submersion hurricanes fires #IBMGarage @holly_cummins

Slide 13

#IBMGarage @holly_cummins

Slide 14

there’s a bug in our 2030 flood risk graph for Tokyo … isn’t there? #IBMGarage @holly_cummins

Slide 15

there’s a bug in our 2030 flood risk graph for Tokyo … isn’t there? #IBMGarage uh … no. @holly_cummins

Slide 16

technical debt #IBMGarage @holly_cummins

Slide 17

borrowing against the future #IBMGarage @holly_cummins

Slide 18

environmental debt #IBMGarage @holly_cummins

Slide 19

borrowing against the future #IBMGarage @holly_cummins

Slide 20

#IBMGarage @holly_cummins

Slide 21

me? #IBMGarage @holly_cummins

Slide 22

me? you? #IBMGarage @holly_cummins

Slide 23

#IBMGarage @holly_cummins

Slide 24

computers contribute to climate change #IBMGarage @holly_cummins

Slide 25

#IBMGarage data centres aviation 1-2% 2.5% @holly_cummins

Slide 26

#IBMGarage data centres aviation 1-2% 2.5% @holly_cummins

Slide 27

#IBMGarage data centres aviation 1-2% 2.5% @holly_cummins

Slide 28

Dr. Malice, IT person #IBMGarage @holly_cummins

Slide 29

waste #IBMGarage @holly_cummins

Slide 30

#IBMGarage @holly_cummins

Slide 31

workload #IBMGarage @holly_cummins

Slide 32

runtime environment: virtual machine, physical machine or cluster workload #IBMGarage @holly_cummins

Slide 33

runtime environment: virtual machine, physical machine or cluster workload #IBMGarage @holly_cummins

Slide 34

utilisation elasticity #IBMGarage @holly_cummins

Slide 35

mainframes are super-efficient #IBMGarage @holly_cummins

Slide 36

mainframes are super-efficient #IBMGarage @holly_cummins

Slide 37

IBM zSeries 50% power consumption of x86 (30% more performance) #IBMGarage @holly_cummins

Slide 38

application #IBMGarage @holly_cummins

Slide 39

application control plane #IBMGarage @holly_cummins

Slide 40

application control plane #IBMGarage @holly_cummins manual replica count horizontal auto-scaling

Slide 41

! clusters are less elastic than applications manual replica count horizontal auto-scaling application control plane #IBMGarage @holly_cummins

Slide 42

! clusters are less elastic than applications application control plane ! every cluster has overhead #IBMGarage @holly_cummins

Slide 43

conway’s law is for clusters, too #IBMGarage @holly_cummins

Slide 44

namespaces #IBMGarage @holly_cummins

Slide 45

namespace isolation is not enough #IBMGarage @holly_cummins

Slide 46

#IBMGarage @holly_cummins

Slide 47

dev prod staging that weird experiment #IBMGarage @holly_cummins

Slide 48

is this a win? lots of applications control plane #IBMGarage @holly_cummins

Slide 49

zombie workload #IBMGarage @holly_cummins

Slide 50

Hey boss, I created a Kubernetes cluster. #IBMGarage @holly_cummins

Slide 51

Hey boss, I created a Kubernetes cluster. I forgot it for 2 months. #IBMGarage @holly_cummins

Slide 52

Hey boss, I created a Kubernetes cluster. I forgot it for 2 months. … and it’s £1000 a month. #IBMGarage @holly_cummins

Slide 53

2017 survey 25% of 16,000 servers doing no useful work #IBMGarage @holly_cummins

Slide 54

2017 survey 25% of 16,000 servers doing no useful work “perhaps someone forgot to turn them off” #IBMGarage @holly_cummins

Slide 55

£ == #IBMGarage @holly_cummins

Slide 56

#IBMGarage @holly_cummins

Slide 57

is there a solution? #IBMGarage @holly_cummins

Slide 58

pleading emails #IBMGarage @holly_cummins

Slide 59

let’s figure out what all these cloud workloads are, since I’m paying for them IT Department, UK Bank #IBMGarage @holly_cummins long meetings

Slide 60

let’s figure out what all these cloud workloads are, since I’m paying for them IT Department, UK Bank #IBMGarage @holly_cummins long meetings

Slide 61

tags #IBMGarage @holly_cummins

Slide 62

#IBMGarage @holly_cummins

Slide 63

governance #IBMGarage @holly_cummins

Slide 64

make it easiest to do the right thing #IBMGarage @holly_cummins

Slide 65

make it easiest to do the right thing #IBMGarage @holly_cummins

Slide 66

finops #IBMGarage @holly_cummins

Slide 67

is the cloud zombie-proof? #IBMGarage @holly_cummins

Slide 68

is the cloud zombie-proof? #IBMGarage @holly_cummins

Slide 69

shut it down? but … what if I need this cluster later? #IBMGarage @holly_cummins

Slide 70

#IBMGarage @holly_cummins

Slide 71

gitops #IBMGarage @holly_cummins

Slide 72

gitops (infrastructure as code) #IBMGarage @holly_cummins

Slide 73

#IBMGarage @holly_cummins

Slide 74

spin it down #IBMGarage @holly_cummins

Slide 75

spin it down spin it up #IBMGarage @holly_cummins

Slide 76

spin it down spin it up #IBMGarage @holly_cummins

Slide 77

spin it down spin it up #IBMGarage @holly_cummins

Slide 78

spinning down clusters: the new lights off? #IBMGarage @holly_cummins

Slide 79

spinning down clusters: the new lights off? oh. it is. #IBMGarage @holly_cummins

Slide 80

shutting down instances out of hours reduced costs by 37% #IBMGarage (thanks for the statistic, @darkandnerdy) @holly_cummins

Slide 81

large bank, 2013 50% reduction in CPUs with a lease system #IBMGarage @holly_cummins

Slide 82

large bank, 2013 50% reduction in CPUs with a lease system #IBMGarage @holly_cummins

Slide 83

multicloud management #IBMGarage @holly_cummins

Slide 84

traffic monitoring #IBMGarage @holly_cummins

Slide 85

cautions #IBMGarage @holly_cummins

Slide 86

beware micro-optimisation theatre #IBMGarage @holly_cummins

Slide 87

is my travel sustainable? #IBMGarage @holly_cummins

Slide 88

is my travel sustainable? #IBMGarage @holly_cummins

Slide 89

fixing the wrong problem #IBMGarage @holly_cummins

Slide 90

but … every little helps… #IBMGarage @holly_cummins

Slide 91

think about the other things you’re not optimising #IBMGarage @holly_cummins

Slide 92

knowledge helps us focus on optimisations that matter #IBMGarage @holly_cummins

Slide 93

jevons’ paradox #IBMGarage @holly_cummins

Slide 94

the highway problem #IBMGarage @holly_cummins

Slide 95

what we imagine when we widen roads #IBMGarage @holly_cummins

Slide 96

what we get #IBMGarage @holly_cummins

Slide 97

unsolved problem == opportunity #IBMGarage @holly_cummins

Slide 98

#IBMGarage @holly_cummins

Slide 99

system designers, support #IBMGarage @holly_cummins

Slide 100

system designers, support performance make it fast and lean better utilisation elasticity multi-tenancy de-zombification visibility disposability #IBMGarage @holly_cummins

Slide 101

#IBMGarage @holly_cummins

Slide 102

users … #IBMGarage @holly_cummins

Slide 103

users … up utilisation aim for elasticity limit sprawl de-zombification know what you’re using turn it off #IBMGarage @holly_cummins

Slide 104

Thank you. Questions? @holly_cummins IBM Garage #IBMGarage @holly_cummins