Speaker

Benjamin Bengfort

Benjamin Bengfort

Open source hacker and data nerd, currently building AI agents with Rotational Labs

Saint Paul, Minnesota, United States

Actions

Dr. Benjamin Bengfort is the co-founder and CEO of Rotational Labs. Benjamin is an experienced systems engineer, programmer, and data scientist. Driven by a desire to build large systems with many users that have a global impact, he takes pride in solutions where many small interactions combine to create complex dynamics. As the CEO of Rotational Labs, his goal is to apply advanced distributed computing, networking, open-source software, education, and machine learning to solutions that allow us to collaborate more effectively around the world to solve big problems.

Area of Expertise

  • Business & Management
  • Information & Communications Technology

Topics

  • Advanced Distributed Systems Architecture
  • distributed consensus
  • distributed systems
  • Data Visualization
  • Computer Science
  • Programming
  • Go Programming Language
  • Python Programming Language
  • JavaScript
  • Hadoop
  • Database Design
  • Database Architectures
  • Data Replication

Smart Global Replication using Reinforcement Learning

There are many great reasons to replicate data across Kubernetes clusters in different geographic regions: e.g. for disaster recovery and to ensure the best possible user experiences. Unfortunately, global replication is not easy; not just because of the difficulty in consistency reasoning that it introduces, but also due to the increased cost of provisioning multiple volumes that exponentially duplicate ingress and egress.

Wouldn't it be great if our systems could learn the optimal placement of storage blocks so that total replication was not necessary? Wouldn't it be even better if our replication messaging was reduced ensuring communication only between the minimally necessary set of storage nodes?

We show a system that uses multi-armed bandits to perform such an optimization; dynamically adjusting how data is replicated based on usage. We demonstrate the savings achieved and system performance using a real world system: the TRISA Global Travel Rule Compliance Directory.

KubeCon + CloudNativeCon North America 2023 Sessionize Event

November 2023 Chicago, Illinois, United States

Benjamin Bengfort

Open source hacker and data nerd, currently building AI agents with Rotational Labs

Saint Paul, Minnesota, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top