A Research Study into DevOps Bottlenecks

A presentation at DevOps Summit Amsterdam 2019 in October 2019 in Amsterdam, Netherlands by Baruch Sadogursky

Slide 1

Slide 1

Research into DevOps bottlenecks

Slide 2

Slide 2

Why “research”? We interview people ■ VP R&D @ JFrog ■ CTO @ Bugsee ■ CTO @ Top Israeli Finance Firm ■ VP Engineering at CA Technologies ■ CTO @ ScentBird ■ Architect, a top Fortune-Rated Privately-Held Tech Firm ■ Applications Engineering Manager at Fortune 500 SW Company ■ Architect, US Army (Contractor) @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 3

Slide 3

What is DevOps? @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 4

Slide 4

This is devops* Ops Deep specialization Dev Common goals, tools, culture QA *Unless you’re Netflix **You’re not @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 5

Slide 5

Collaboration Ops Dev @jbaruch QA http://jfrog.com/shownotes #DOSAMS

Slide 6

Slide 6

Collaboration People Process @jbaruch Tools http://jfrog.com/shownotes #DOSAMS

Slide 7

Slide 7

Slide 8

Slide 8

🎩 @jbaruch #dockercon jfrog.com/shownotes @ErinMeyerINSEAD’s “Culture Map”

Slide 9

Slide 9

Shownotes ■The slides ■The video ■All the links ■Comments, ratings ■Raffle! @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 10

Slide 10

What bottlenecks?

Slide 11

Slide 11

DevOps and Delivery Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 12

Slide 12

Release cycles 2 years 6 months 2 weeks 1 day 2 hours @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 13

Slide 13

@jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 14

Slide 14

Are they happy with it? 0% Satisfied 20% Satisfied 50% Satisfied 80% Satisfied 100% Satisfied @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 15

Slide 15

@jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 16

Slide 16

How do you know it’s good? @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 17

Slide 17

“ I don’t measure it because I’ve had no complaints @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 18

Slide 18

“ When the bug queue is empty, we are good @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 19

Slide 19

“ When I get fewer tickets on the process @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 20

Slide 20

“ Automation of every single piece @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 21

Slide 21

Other measures ■ Version adoption ■ Bug Burn-down diagram ■ Productivity Gains “used to be 2 days, now its 2 minutes” ■ Quality, No Regressions! ■MTTR ■ Business metrics @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 22

Slide 22

What’s the right release cycle? @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 23

Slide 23

@jbaruch #LiquidSoftware

Slide 24

Slide 24

Update available Yes No Do we trust the update? Yes How about no Let’s update! Yes Are there any high risks? No Do we want it? No

Slide 25

Slide 25

“ ■Acceptance tests @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 26

Slide 26

“ ■The dreadful updates @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 27

Slide 27

“ ■Impossible dilemma: we need the update, but it will break things @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 28

Slide 28

Update available Yes No Can we verify the update? No Yes Yes How about no Do we trust the update? Time consuming verification Let’s update! Yes Are there any high risks? No Do we want it? No

Slide 29

Slide 29

Slide 30

Slide 30

Features that we want @jbaruch Acceptance tests costs http://jfrog.com/shownotes #DOSAMS

Slide 31

Slide 31

Slide 32

Slide 32

Slide 33

Slide 33

Slide 34

Slide 34

@jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 35

Slide 35

This is not a new idea! ■ XP: short feedback ■ Scrum: reducing cycle time to absolute minimum ■ TPS: Decide as late as possible and Deliver as fast as possible ■ Kanban: Incremental change @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 36

Slide 36

Continuous updates ■ Frequent ■ Automatic ■ Tested ■ Canary ■ State-aware ■ Observability ■ *Local Rollbacks @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 37

Slide 37

Slide 38

Slide 38

You don’t offload quality tests to customers The customers are always ready to update You just lost the last excuse for not releasing fast

Slide 39

Slide 39

Slide 40

Slide 40

Education @jbaruch Automation http://jfrog.com/shownotes Trust #DOSAMS

Slide 41

Slide 41

“ Pain is instructional @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 42

Slide 42

“ You need to know, You need to believe, You need to give a sh*t @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 43

Slide 43

Also, @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 44

Slide 44

“Activation Energy” @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 45

Slide 45

@jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 46

Slide 46

RESIST FAKE NEWS @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 47

Slide 47

First push is hard “ Keep your eye on the prize For an older code base this could take more than a year to achieve, but its still worth it @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 48

Slide 48

Tools @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 49

Slide 49

Immutable Scriptable “ @jbaruch Universal http://jfrog.com/shownotes #DOSAMS

Slide 50

Slide 50

Guide, don’t dictate Aim for the 80% Tool Java JFrog Artifactory JFrog Xray Gradle Maven Ant Rating Invest Invest Research Invest Maintain Divest

Slide 51

Slide 51

Let’s talk about trust @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 52

Slide 52

Remember this? Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 53

Slide 53

Some commits should fail! Develop Test @jbaruch Build http://jfrog.com/shownotes #DOSAMS

Slide 54

Slide 54

Slide 55

Slide 55

“ Quality is the bottleneck Automatic testing is not enough The “big green button” concept is lack of trust in quality @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 56

Slide 56

“ Quality is the bottleneck Automatic testing is not enough, but we can use our customers as testers Canary releases @jbaruch http://jfrog.com/shownotes #DOSAMS

Slide 57

Slide 57

DevOps Ops Dev @jbaruch QA http://jfrog.com/shownotes #DOSAMS

Slide 58

Slide 58

DevOps People Process @jbaruch Tools http://jfrog.com/shownotes #DOSAMS

Slide 59

Slide 59

DevOps Automation Trust @jbaruch Education http://jfrog.com/shownotes #DOSAMS

Slide 60

Slide 60

QA & Twitter Ads ◇@jbaruch ◇#DOSAMS ◇https://jfrog.com/shownotes ◇https://liquidSoftware.com