© Mapbox, © OpenStreetMap

Speaker

Carlos Sanchez

Carlos Sanchez

Principal Scientist at Adobe

A Coruña, Spain

Actions

Carlos Sanchez is a Principal Scientist at Adobe Experience Manager, specializing in software automation, from build tools to Continuous Delivery and Progressive Delivery. Involved in Open Source for over 20 years, he is the author of the Jenkins Kubernetes plugin and a member of the Apache Software Foundation amongst other open source groups, contributing to several projects, such as Kubernetes, Jenkins or Apache Maven.

Area of Expertise

  • Information & Communications Technology

Topics

  • Kubernetes
  • DevOps
  • progressive delivery

Unleashing the Power of Init and Sidecar Containers in Kubernetes

This session dives deep into the power of init and sidecar containers, the issues they solve and why they are very useful when managing Kubernetes workloads.

We will explore real-world use cases that show how these tools can:
* Simplify complex deployments: Break down intricate deployments into manageable steps.
* Enhance security: Isolate security critical tasks within your pods and ongoing security measures.
* Facilitate rapid and isolated changes: when everyone is interested in updating the same service, separation of concerns is critical for rapid development.
* Boost application functionality: Utilize sidecar containers to inject essential functionalities like logging, monitoring, and networking capabilities without modifying your main application code.

Our goal is to share our experience and challenges managing thousands of environments in Kubernetes, how we manage init and sidecar containers and what problems they solve for us.

Tuning Argo Rollouts for Thousands of Workloads

Argo Rollouts makes Progressive Delivery easy to adopt, but some times things do not work as expected. Are the steps correctly set? are the analysis metrics right for the workloads?

At Adobe Experience Manager we deploy over 10k customer services to Kubernetes. Changes can occur multiple times per day both internal and from code. A new feature can work fine for 99% of customers but still affect the other 1%, and detecting this just from tests is costly. Enter Argo Rollouts, which allows deploying new versions to a subset of users before rolling them to the totality of the users, and rolling them back if not matching some key metrics, using techniques like canary deployments.

We will show our learnings deploying Argo Rollouts to manage over 10k workloads using canaries, how do we balance speed and safety for our customers, and some of the issues that we have faced when adopting it.

We Moved one Java Product to Kubernetes and This Is What We Learned

Join us to learn the challenges we faced and the solutions we implemented moving Adobe Experience Manager, an existing product built on top of many OSS projects, to a Cloud Native environment implemented around Kubernetes.

Moving to a Cloud Native architecture required changes in culture, processes and technologies. Some functionality was decomposed and partially reimplemented as Cloud Native services. The need to scale triggered a microservice architecture to support the existing app, and to scale the development organization. This drove the creation of services that work together to provide the full product. The multi tenancy aspects require considering the isolation between tenants, at multiple levels of the stack.

We will dig into specific details that require attention when migrating to a Cloud Native environment, like resource management, decomposition of services or availability amongst others, sharing also when we took the wrong decisions.

Optimizing Resource Usage in Kubernetes

Moving to Kubernetes opens the door to a world of possibilities, the amount of workloads that can be run and the flexibility it provides. However this comes at a cost on managing the resources used by many applications and teams. Java applications can be specially challenging when running in containers.

At Adobe Experience Manager we run our cloud service on more than 40 clusters. We make extensive use of standard Kubernetes capabilities to reduce resource usage and we have also built some solutions at several levels of the stack to improve it.

From autoscaling to workload hibernation, from automated resource requests to Kubernetes Jobs, we have experimented with and implemented several features that decrease our resource usage and lower the cost of running many Kubernetes clusters at scale. Both at workload resource level and also at achieving higher density clusters that reduce the number of clusters we need and the operating costs.

Progressive Delivery in Kubernetes

Progressive Delivery makes it easier to adopt Continuous Delivery, by deploying new versions to a subset of users before rolling them to the totality of the users, and rolling them back if not matching some key metrics, using techniques like feature flags and canary deployments.

For workloads running on Kubernetes it is very easy to adopt Progressive Delivery using Argo Rollouts. At Adobe Experience Manager we deploy over 10k customer services to Kubernetes. Changes can occur multiple times per day both internal and from code. A new feature can work fine for 99% of customers but still affect the other 1%, and detecting this just from tests is costly.

We will show how to implement a Progressive Delivery pipeline with Argo Rollouts to improve the reliability of the service and prevent regressions. It allows the protection of the service and automation of roll backs to a previous version if needed. This allows for faster delivery with more confidence.

Debugging Envoy Tunnels

Envoy is a powerful proxy that can be used to connect services in a secure way, with encryption and mutual authentication, using certificates. It can be used to connect services running in Kubernetes with external infrastructure, such as on-premise services, databases, etc.

At Adobe Experience Manager Cloud Service we use Envoy to connect pods running in Kubernetes with customer dedicated infrastructure, such as on-premise services, databases, etc. This allows, for example, different pods to have their own dedicated egress ip instead of the cluster's, or connections from pods to multiple customer on-premise services using VPN.

We will show how we are using Envoy to connect pods with external infrastructure, and how we debug issues when the tunnels are not working as expected.

DevFest Cyprus

December 2024 Nicosia, Cyprus

DevFest Tashkent

December 2024 Tashkent, Uzbekistan

KubeCon + CloudNativeCon North America 2024 Sessionize Event

November 2024 Salt Lake City, Utah, United States

CNCF-hosted Co-located Events North America 2024 Sessionize Event

November 2024 Salt Lake City, Utah, United States

Devoxx Morocco

October 2024 Marrakesh, Morocco

Infobip Shift 2024 Sessionize Event

September 2024 Zadar, Croatia

JavaZone

September 2024 Oslo, Norway

ContainerDays Conference 2024 Sessionize Event

September 2024 Hamburg, Germany

WeAreDevelopers World Congress 2024 Sessionize Event

July 2024 Berlin, Germany

Nordic Testing Days

June 2024 Tallinn, Estonia

CNCF-hosted Co-located Events Europe 2024 Sessionize Event

March 2024 Paris, France

SCALE

March 2024 Pasadena, California, United States

FOSDEM

February 2024 Brussels, Belgium

DevFest Sousse/Monastir

November 2023 Monastir, Tunisia

CNCF-hosted Co-located Events North America 2023 Sessionize Event

November 2023 Chicago, Illinois, United States

Open Source Summit Europe

September 2023 Bilbao, Spain

jPrime

May 2023 Sofia, Bulgaria

Devoxx UK

May 2023 London, United Kingdom

Devoxx Greece

May 2023 Athens, Greece

Devoxx Morocco

October 2022 Agadir, Morocco

Devfest Tbilisi 2019 Sessionize Event

September 2019 Tbilisi, Georgia

I Code Java

July 2019 Johannesburg, South Africa

Jenkins User Conference China

July 2019 Beijing, China

Continuous Delivery Summit

June 2019 Shanghai, China

KubeCon

December 2018 Seattle, Washington, United States

DevOps Pro

November 2018 Moscow, Russia

Agile Testing Days USA

June 2018 Boston, Massachusetts, United States

Joker

November 2017 Saint Petersburg, Russia

Agile testing Days Asia

March 2017 Bengaluru, India

JavaOne

September 2016 San Francisco, California, United States

MesosCon North America

June 2016 Denver, Colorado, United States

Carlos Sanchez

Principal Scientist at Adobe

A Coruña, Spain

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top