Paris Container Day 2018
Les Conteneurs: Pièces et Main-d’Oeuvre
· Paris, France
At Datadog we help thousands of organisations monitor their infrastructure and applications. In this session, we’ll dive deeper into the several hundred trillion data points we’ve gathered to extract information about the real-world use of containers and explore trends in container use. Furthermore, we’ll discuss the top applications being used in containers and, using the data, provide insight into what and how to monitor and understand this brave new containerised world!
CONTAINERS: PARTS AND LABOUR DANIEL MAHER, DATADOG @phrawzty
CONTAINERS: PARTS AND LABOUR DANIEL MAHER, DATADOG @phrawzty DOCKER DOCKER DOCKER
IS THE DOCKER FAD OVER?
DANIEL MAHER DOCS & TALKS DEVOPSDAYS GLOBAL GREAT OUTDOORS GOURMAND SUITS FOR NO REASON @phrawzty
DATADOG SAAS-BASED MONITORING TRILLIONS OF POINTS/DAY WE’RE HIRING: www.datadoghq.com/careers @datadoghq
Docker Adoption - Docker pulls?
https://www.datadoghq.com/docker-adoption/
Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Docker Adoption
Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Adopter : the average number of containers running during the month was at least 50% the number of distinct hosts run, or there were at least as many distinct containers as distinct hosts run during the month. Docker Adoption
Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Adopter : the average number of containers running during the month was at least 50% the number of distinct hosts run, or there were at least as many distinct containers as distinct hosts run during the month. Abandoner : a currently active company that used Docker in the past, but hasn't used it at all in the last month. Docker Adoption
WHO’S ADOPTING DOCKER?
WHAT’S RUNNING?
NGINX Redis Postgres FluentD Elasticsearch Mongo MySQL etcd RabbitMQ HAproxy % Customers Running a Tech in Containers 0 % 10 % 20 % 30 % 40 %
Redis Postgres Elasticsearch MySQL MongoDB etcd RabbitMQ % Customers Running Data Stores in Containers 0 % 10 % 20 % 30 % 40 %
HOW DENSELY PACKED?
ENTER THE ORCHESTRATORS
ORCHESTRATORTION IS NORMAL
CONTAINERS INCREASE COMPLEXITY HOW DO WE MONITOR THEM?
Alcohol: The cause of, and solution to, all of life’s problems. HOMER SIMPSON
Alcohol: The cause of, and solution to, all of life’s problems. HOMER SIMPSON CONTAINERS
Side Car Containers
AS COMPLEXITY INCREASES FUNDAMENTALS BECOME MORE IMPORTANT
4 QUALITIES OF GOOD METRICS NOT ALL METRICS ARE EQUAL
MUST BE WELL UNDERSTOOD
SUFFICIENT GRANULARITY
1 second Peak 46% 1 minute Peak 36% 5 minutes Peak 12%
TAGGED & FILTERABLE
Query Based Monitoring “What’s the average throughput of application:nginx per version ?” “Alert me when role:web-app running application:postgres hosted in region:eu-west-1 behaves differently than region:eu-west-2 ”
LONG-LIVED
M T W TH F M T W TH F M T W TH F M T W TH F
M T W TH F M T W TH F M T W TH F M T W TH F OUTAGE? TUESDAY HOLIDAY?
SUMMARY 1. Both Docker adoption and system complexity continue to grow 2. The fundamentals of monitoring are therefore more important than ever
MERCI ! DANIEL MAHER @phrawzty [email protected]
Recording
Resources
Buzz and feedback
[ #ContainerDayFR ] "Monitoring Containers: Follow the Data" via @phrawzty of @datadoghq it's now in the conference room 1 ! pic.twitter.com/w6ZFbrsRJ1 — Paris Container Day (@ContainerDayFR) June 26, 2018
@ContainerDayFR
Interesting, big corporations are actually leading adoption when it comes to @docker ! #ContainerDayFR via @phrawzty pic.twitter.com/swfTsnXXht — Julie Robles (@JuLovesNewStuff) June 26, 2018
@JuLovesNewStuff
Thanks to everyone that came to my #ContainerDayFR talk. Great Q&A session after, too. If y'all have any questions please don't hesitate to reach out. Also, here's the public part of the study I was referring to: https://t.co/8TqWgI5Nqx — Dan 🇪🇺🇨🇦 (@phrawzty) June 26, 2018
@phrawzty