Data Impact On The Environment

A presentation at International Conference on Massive Storage Systems and Technology (MSST) in May 2023 in Santa Clara, CA, USA by erik riedel

Slide 1

Slide 1

DATA IMPACT ON THE ENVIRONMENT ERIK RIEDEL, PHD CHIEF ENGINEERING OFFICER FLAX COMPUTING MAY 2023 revision 7

Slide 2

Slide 2

Slide 3

Slide 3

Reduce carbon footprint Reduce cost footprint focus on efficiency & results via carbon / performance focus on efficiency & results via cost / performance scope 1 & 2 operational carbon; scope 3 embodied carbon capex, opex, people-ex

Slide 4

Slide 4

THANKS

Slide 5

Slide 5

ERIK RIEDEL AND GARTH GIBSON, “UNDERSTANDING CUSTOMER DISSATISFACTION WITH UNDERUTILIZED DISTRIBUTED FILE SERVERS” 5TH NASA GODDARD SPACE FLIGHT CENTER CONFERENCE ON MASS STORAGE SYSTEMS AND TECHNOLOGIES. COLLEGE PARK, MD. SEPTEMBER 1996.

Slide 6

Slide 6

SCALING STORAGE

Slide 7

Slide 7

PETER CORBETT, JEAN-PIERRE PROST, CHRIS DEMETRIOU, GARTH GIBSON, ERIK RIEDEL, JIM ZELENKA, YUQUN CHEN, ED FELTEN, KAI LI, JOHN HARTMAN, LARRY PETERSON, BRIAN BERSHAD, ALEC WOLMAN, RUTH AYDT, “PROPOSAL FOR A COMMON PARALLEL FILE SYSTEM PROGRAMMING INTERFACE” TECHNICAL REPORT CMU-CS96-193. PRESENTED AT THE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS (SUPERCOMPUTING ‘96). PITTSBURGH, PA. NOVEMBER 1996.

Slide 8

Slide 8

GARTH GIBSON, DAVID NAGLE, KHALIL AMIRI, JEFF BUTLER, FAY CHANG, HOWARD GOBIOFF, CHARLES HARDIN, ERIK RIEDEL, DAVID ROCHBERG, JIM ZELENKA, “A COST-EFFECTIVE, HIGH-BANDWIDTH STORAGE ARCHITECTURE” CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS (ASPLOS VIII). SAN JOSE, CA. OCTOBER 1998.

Slide 9

Slide 9

ERIK RIEDEL, GARTH GIBSON, CHRISTOS FALOUTSOS, “ACTIVE STORAGE FOR LARGE-SCALE DATA MINING AND MULTIMEDIA” 24TH INTERNATIONAL CONFERENCE ON VERY LARGE DATABASES (VLDB ‘98). NEW YORK, NY. AUGUST 1998.

Slide 10

Slide 10

OBJECTS

Slide 11

Slide 11

MIKE MESNIER, GREGORY R. GANGER, ERIK RIEDEL “OBJECT-BASED STORAGE” IEEE COMMUNICATIONS MAGAZINE 41 (8). AUGUST 2003.

Slide 12

Slide 12

Slide 13

Slide 13

Slide 14

Slide 14

Slide 15

Slide 15

CLOUDS

Slide 16

Slide 16

ERIK RIEDEL “EFFICIENT & CONVENIENT - HOW TO BUILD BIG STORAGE AS A CLOUD”, MSST CONFERENCE PACIFIC GROVE, CA. APRIL 2012.

Slide 17

Slide 17

Slide 18

Slide 18

Slide 19

Slide 19

SCALABLE STORAGE CLOUDS

Slide 20

Slide 20

$/TB $/TB/month $

Slide 21

Slide 21

Slide 22

Slide 22

ATMOS (2008) >1,000 CUSTOMERS >1 EXABYTE DEPLOYED ECS (2013) >>1,200 CUSTOMERS >1 EXABYTE DEPLOYED ATMOS OVER $2B LIFETIME CUSTOMER REVENUE 22.7 drives/U 816x drives 4x servers 2x switches 18x cables

Slide 23

Slide 23

SOSP 2003

Slide 24

Slide 24

Slide 25

Slide 25

CARBON

Slide 26

Slide 26

Slide 27

Slide 27

Slide 28

Slide 28

Slide 29

Slide 29

natural resources carbon footprint demand growth

Slide 30

Slide 30

TECHNOLOGY ADVANCES

Slide 31

Slide 31

Technology Constantly Advances Computing Technology has advanced in leaps & bounds. hardware, software, operations, applications, methods, methodologies Makes sense to regularly consider updates & refreshes.

Slide 32

Slide 32

Slide from my PhD thesis defense in 1999 Today 100G networking PB storage THz computing TB memory

Slide 33

Slide 33

1999 2022 8,640 TB storage 480 spindles 1,152 GHz compute 122,880 GB memory 76,800 W power $650,000 cost

Slide 34

Slide 34

CIRCULAR ECONOMY

Slide 35

Slide 35

https://www.youtube.com/watch?v=PuzEMYCGeVk

Slide 36

Slide 36

https://www.youtube.com/watch?v=PuzEMYCGeVk

Slide 37

Slide 37

https://www.youtube.com/watch?v=PuzEMYCGeVk

Slide 38

Slide 38

https://www.youtube.com/watch?v=PuzEMYCGeVk

Slide 39

Slide 39

Slide 40

Slide 40

Slide 41

Slide 41

$0.45 / $1 $0.35 / $1 $0.25 / $1 $1 / $1 $0.05 / $1 25,000 to 95,000 servers / month from “Open Uncomplicated” - presented at the OCP Virtual Summit in June 2020

Slide 42

Slide 42

Slide 43

Slide 43

REDUCE

Slide 44

Slide 44

Reduce carbon footprint Reduce cost footprint focus on efficiency & results via carbon / performance focus on efficiency & results via cost / performance scope 1 & 2 operational carbon; scope 3 embodied carbon capex, opex, people-ex

Slide 45

Slide 45

EXTEND

Slide 46

Slide 46

Why it works 3 years primary 3 years secondary 3 years tertiary 9 year design lifetime Recertified hardware approach – facilitate secondary and potentially tertiary use stages for technology assets in various forms

Slide 47

Slide 47

Why it works 3 years primary 3 years secondary STORAGE 9 year design lifetime 5 years primary 3 years secondary 5 years primary 3 years primary 2 yrs primary 3 years primary 4 years secondary 3 yrs secondary 4 years secondary 3 years tertiary 10-12 years In fact, anything that keeps technology running longer will be beneficial, as long as the technology is still useful for something by somebody, plus maintainable & serviceable. SO use those actual criteria to evaluate ALL technology: workload performance, ongoing maintenance complexity & ongoing service costs.

Slide 48

Slide 48

How it works (2) Step 3 - Optimize Step 2 - Quantify Step 1 - Audit Audit systems, servers, and applications. Match per-unit, perdevice carbon inventory, performance, and capacity. Report, review, and optimize - changes might be hardware, software, operations, or design. buy new hardware $$- extend life of existing hw $0 re-purpose existing hw $+ add recertified hardware $-

Slide 49

Slide 49

A WIDER LOOK

Slide 50

Slide 50

https://www.npr.org/transcripts/1048050024

Slide 51

Slide 51

Slide 52

Slide 52

GARBAGE WASTE

Slide 53

Slide 53

Slide 54

Slide 54

Slide 55

Slide 55

Slide 56

Slide 56

Slide 57

Slide 57

CLOSE THE CARBON LOOP

Slide 58

Slide 58

https://www.npr.org/transcripts/917060248 Tim & Gabe

Slide 59

Slide 59

Slide 60

Slide 60

Tim & Gabe Tradewater Refridgerant Finders

Slide 61

Slide 61

Slide 62

Slide 62

THANK YOU

Slide 63

Slide 63

Slide 64

Slide 64

Slide 65

Slide 65

Call to Action • Reach out to us to get involved • Engage us to evaluate / quantify your data center, systems, and server carbon footprints • www.flaxcomputing.com • Evaluate your own servers, share the results with us data @ flaxcomputing.com • If you have servers you don’t want any more, send to: Flax Computing, Suite A2 530 West Street Braintree, MA 02184 • If you want us to arrange a pickup instead, contact us at servers @ flaxcomputing.com Erik Riedel, PhD, Chief Engineering Officer, Flax Computing Twitter: @er1p, @RiedelAtWork email: erik @ flaxcomputing.com

Slide 66

Slide 66

CATCH US AGAIN SOON OCP REGIONAL SUMMIT – PRAGUE, CZ – 19-20 APRIL 2023 KUBECON EUROPE – AMSTERDAM, NL – 18-21 APRIL 2023 MASS STORAGE SYSTEMS & TECH – SANTA CLARA – 21-23 MAY 2023 STORAGE DEVELOPER CONFERENCE – 18-21 SEPTEMBER 2023 OCP GLOBAL SUMMIT – SAN JOSE, CA – 17-19 OCTOBER 2023 KUBECON NORTH AMERICA – CHICAGO, IL – 6-9 NOVEMBER 2023