A presentation at Cloud Sud by Horacio Gonzalez
14 SEPTEMBRE 2023 Des silos au Platform Engineering en passant par le DevOps Adopter GitOps et aller au-delà de l’hype Horacio Gonzalez OVH Cloud Sébastien Blanc Aiven
Who are we? Sébastien Blanc DevRel Aiven @sebi2706 Horacio Gonzalez DevRel OVHcloud @LostInBrittany
14 SEPTEMBRE 2023 IT in the 90s Once upon a time…
In a time almost forgotten When even internet was young…
When Windows 95 was the cutting edge And a 100 Mb disk was huge…
Big companies still used mainframes Bigger, fancier, but still the same old IBM
Bare-metal based IT reigned Control, reliability, security… But cost, rigidity, logistics…
Applying the industrial model Trying to shoehorn IT into a model where it doesn’t fit
Walls & Silos And procedures, and hierarchy, and corporate politics
14 SEPTEMBRE 2023 Tooling evolves CVS, Ant and (Leeeroy) Jenkins
Old school procedures
Tooling empowering changes Theory existed since 1999 But without the right tooling…
Source control tools Better than copying and renaming folders…
Dependency management & build Better than grabbing each dependency in their website and running javac by hand…
Unit testing and continuous integration Hudson CI If Testing is Doubting, let’s doubt automatically
Monitoring tools No more spending nights looking at a status screen
Too many changes in a few years Old ways were difficult to change
14 SEPTEMBRE 2023 XP, agility and DevOps Buzzwords that changed the IT
Extreme Programming
Manifesto for Agile Software Development
Breaching walks, breaking down silos
The business of Agility The Dark Side rises
Agile Tooling
Back to industrial practices ?
Is DevOps the same than Agility? Can you have one without the other?
You could have Agility without DevOps Even if I fail to see why you would want…
DevOps is a reaction to the wall of confusion Making the different stakeholders to work together in sync
You cannot have DevOps without agility DevOps is about shorter development sprints, increased focus on testing, increasing automation
DevOps comes with Agility DevOps is an extension of Agile that includes systems and operations
14 SEPTEMBRE 2023 Enter the Cloud Renting server time in other’s people infra
From virtualisation to the cloud How to use the infrastructure at its full capacity
The five pillars of the Cloud
Cloud demands automation
It changes the way how IT works And it demands a mentality change
Empowering developers Infrastructure is only a click away
Distributed is the new black Cloud Native architectures and services
Sysadmins who code Creating tools: automation, monitoring, observability…
New roles appear: SRE WTF is a System Reliability Engineer?
14 SEPTEMBRE 2023 Declarative Infrastructure The intern metaphor
Containers make dev life easier
Less simple if you must operate them Like in a production context
And what about microservices? Are you sure you want to operate them by hand?
And what about microservices? Are you sure you want to operate them by hand?
Kubernetes: a full orchestrator
Kubernetes - Desired State Management
Terraform - Declarative infra as code
14 SEPTEMBRE 2023 GitOps And other alternatives (why not KafkaOps?)
Continuous Integration(CI) & Continuous Delivery (CD) Build Test Security Checks Continuous Integration Continuous Delivery Release Deploy Stage Deploy Prod
A central source of truth
What is GitOps? Git is the single source of truth Treat everything as code Operations through Git workflows
14 SEPTEMBRE 2023 Platform What is it? Why is it useful? Why do we need Platform Engineers?
A fancy name for something already there Most companies already have some kind of platform Often homemade…
So many options …
So many options …
Shift left and Cognitive Load
Managing the self-service commodity
“The discipline of designing and building toolchains and workflows that enable self-service capabilities for software engineering organizations in the cloud-native era. Platform engineers provide an integrated product most often referred to as an “Internal Developer Platform” covering the operational necessities of the entire lifecycle of an application.” Lucas Galante
IDP is the new Facade Pattern
Team Topologies “Organizations that consider establishing such a platform team should be very cautious not to accidentally create a separate DevOps team, nor should they simply relabel their existing hosting and operations structure as a platform.” TechRadar, October 2021
Team Topologies Stream-aligned team Enabling team Complicated Subsystem team Platform team
Platform as a Product The Internal Dev Platform is the Product ● Conduct user research ○ Run friction logs ○ Empathy meetings ● Create a roadmap ● …
14 SEPTEMBRE 2023 Build your own Platform And becoming Platform Engineer
How to glue those all together ?
Kubernetes Operators A Kubernetes version of the human operator
Building operators Basic K8s elements: Controllers and Custom Resources
Extending Kubernetes API By defining new types of resources
A reconcile loop Strives to reconcile current state and desired state
Custom Controllers for Custom Resources Operators implement and manage Custom Resources using custom reconciliation logic
Operator SDK Three different ways to build an Operator
How to assemble all those building bricks ?
Platform Building Frameworks Custom Resource / Promise Pipeline 2 Custom Resource X Pipeline 1 “A framework for building platforms” Custom Resource Y
MERCI À NOS SPONSORS
Dans le paysage technologique rapide et en constante évolution d’aujourd’hui, les organisations sont confrontées au défi de briser les silos traditionnels et d’adopter des pratiques collaboratives pour stimuler l’innovation et atteindre l’excellence opérationnelle. Le voyage commence par l’adoption des principes DevOps, qui mettent l’accent sur la communication, la collaboration et l’automatisation entre les équipes de développement et d’exploitation. Cependant, DevOps traite de la relation entre Devs et Ops, et les besoins des autres parties prenantes, sous la forme de politiques d’entreprise, de gouvernance et de contraintes, restent externes au processus. En adoptant l’ingénierie de plate-forme, les organisations peuvent établir une plate-forme unifiée qui permet aux développeurs, aux équipes d’exploitation et aux parties prenantes de travailler ensemble de manière transparente et d’accélérer la livraison de logiciels de haute qualité.
Dans cette conférence, nous embarquerons pour un voyage de DevOps à GitOps et enfin à Platform Engineering, en élucidant chaque étape avec des définitions claires, des études de cas et des applications du monde réel. Nous disséquerons les éléments qui relient ces pratiques et éclairerons comment elles améliorent de manière collaborative le processus de développement logiciel.
En nous concentrant sur l’ingénierie de plate-forme, nous explorerons sa capacité à transcender les capacités de DevOps et de GitOps, une solution intégrée qui s’adapte aux diverses exigences des parties prenantes, aux politiques d’entreprise et aux contraintes de gouvernance. Nous aborderons les aspects techniques de la mise en œuvre d’une plate-forme unifiée, son potentiel d’amélioration de la collaboration et le rôle de l’automatisation.
