Maulin Vasavada
Engineering leader at Venmo
Actions
Maulin Vasavada is leading Venmo's data platforms team. He is also a recent Apache Cassandra contributor (CEP-9). He has strong experience building large-scale financial systems, shipping and logistics software, and software release management systems. Previously, he worked for eBay and as a consultant for Sun Microsystems.
Tightening security in Apache Cassandra
Apache Cassandra's is used by all sizes of organizations serving varied technical and business domains and with double digit e-Commerce growth in recent years, Security has become a top priority for the e-Commerce companies. In this session we will talk about enhanced security posture of Apache Cassandra in 4.1, offering great flexibility and supporting security industry standards to fit variety of needs.
Marching toward a trillion Kafka messages per day: Running Kafka at scale at PayPal
At PayPal, our Kafka journey, which started with a handful of isolated Kafka clusters, now has us marching at a rapid pace towards a trillion messages per day in a true multi-tenant Kafka environment with thousands of brokers. To enable that tremendous growth -- which today is reflected by 30% quarter-on-quarter increases in traffic volume -- we’ve had to overcome a wide variety of challenges, including:
Deploying the tooling required to operate multiple Kafka clusters at scale
Monitoring and operating a large fleet of brokers across multiple availability zones
Identifying the right set of metrics to monitor and then finding a way to automate remediation
Troubleshooting customer issues related to broker connectivity and data loss
Planning and optimizing capacity within budget constraints
Managing a polyglot client stack with a diverse set of Kafka client libraries
And of course, doing all of the above while ensuring compliance with the stringent data security requirements mandated for FinTech companies
In this talk, we will describe the Kafka deployment model at PayPal and how we addressed these challenges to implement event streaming at enterprise scale. Independent of the scale of your Kafka deployment – be it a large enterprise already using Kafka, a midsize company in the midst of transforming your Big Data platform, or a small but rapidly growing company just getting started with Kafka – this talk will provide you with knowledge of the ins and outs of operating Kafka at scale, learn the challenges you can expect, and understand how you can address them will help you pave the way for your own Kafka journey.
Securing almost a trillion Kafka messages per day at PayPal
How do you handle almost a trillion Kafka messages per day while adhering to stringent security and compliance standards? Very carefully. As one of the world’s largest fintech companies, PayPal processes a rapidly growing deluge of data each day. Much of that data flows as event streams on Apache Kafka, powering analytics that are at the center of business and product decisions.
Kafka traffic is growing by leaps and bounds -- we’re seeing more than 30% growth quarter-on-quarter. In keeping that data secure and meeting compliance goals, we faced numerous challenges, including:
- Working with PayPal’s internal Certificate Authority and Key Management System, which controls the certificate and key lifecycle for all applications in our environment including Kafka
- Ensuring that all interactions between any two applications (including Kafa clients and brokers) use Mutual Auth TLS, and doing so at a scale that is not practical with the default, file-based TLS capabilities provided by Kafka
- Supporting authorization with SASL across various language stacks
If you’re in a similar position, looking for effective ways to secure Kafka traffic at scale in accordance with enterprise security policies, join us at this session. You’ll learn more about challenges we faced (and ones you’ll likely encounter too), some innovative ways we solved them, and important tips and lessons that you can apply to keep your Kafka traffic safe and your compliance department happy.
Maulin Vasavada
Engineering leader at Venmo
Actions
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top