Speaker

Abhishek Gupta

Abhishek Gupta

Principal PM, Azure Cosmos DB at Microsoft

New Delhi, India

Actions

Abhishek is a Product Manager in the Azure Cosmos DB team at Microsoft. Over the course of his career, he has worn multiple hats including engineering, consulting and product management. Most of his work has revolved around open-source technologies including distributed data systems and cloud-native app dev platforms. He is also an open-source contributor, speaker, and author.

Area of Expertise

  • Information & Communications Technology

Topics

  • Apache Kafka
  • Redis
  • Apache Cassandra
  • golang
  • Cloud Computing
  • Cloud Native
  • CNCF
  • Big Data
  • Kubernetes
  • strimzi
  • Database
  • NoSQL
  • Go
  • Rust
  • rustlang
  • gRPC
  • Streaming
  • Kafka Connect
  • AWS CDK
  • AWS Databases
  • AWS Lambda
  • AWS Data
  • AWS ECS

Harnessing the power of Redis and Apache Kafka to crunch high-velocity time series data

Redis is at the heart of modern data architectures. Thanks to Redis Modules, we have a multi-model database with capabilities such as Graph, JSON, SQL, etc. Once such module is RedisTimeSeries, that brings first-class support for time series data in Redis (no need to use Sorted Sets anymore!). This talk is all about how to combine the power of RedisTimeSeries and Apache Kafka to build scalable solutions that handle time series data.

Time Series databases are used to solve a variety of real-world problems such as monitoring fleet of apps/infrastructure, analytics for thousands of IoT device data, and much more. Apache Kafka is an open-source event streaming platform with large-scale production deployments across a wide range of organisations and industries. One of its key benefit is the rich ecosystem of projects consisting of client APIs, connectors and stream processing capabilities.

Given the value of Kafka as a platform, it's worth exploring how it can work together with RedisTimeSeries and the implications at an architectural level. This talk will cover use cases and integration patterns. These include topics such as streaming real-time data from external systems into Kafka and landing them into RedisTimeSeries for aggregation and analysis. For visual interpretation of this data, what options do we have in terms of integrating RedisTimeSeries with downstream systems? We also need to think about long term retention of the raw input data and kind of architectures that help facilitate this.

To better illustrate these concepts, we will also dive into an end to end implementation of a data pipeline on Azure and see it in action.

Using Kafka with Rust: from Zero to "One"

Rust is a fast, memory-efficient language with a rich type system and a set of tools to make you productive. The Kafka Java client is by far the most mature and popular, but the Rust community is catching up.

This introductory, yet hands-on talk covers the nuts and bolts of how to talk to Kafka using Rust. Don't worry if you're not familiar with Rust! The live-coding session will cover some of the Rust basics as we walk through Kafka specific concepts such producer/consumer APIs, committing offsets, rebalancing etc. in the context of the Rust client.

Hopefully, you will walk away with a good overview and ideas for applying Rust to your Kafka use-cases.

Kafka Summit Europe 2021 Sessionize Event

May 2021

RedisConf 2021 Sessionize Event

April 2021

Abhishek Gupta

Principal PM, Azure Cosmos DB at Microsoft

New Delhi, India

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top