400 Billion Messages a Day with Kafka at Paypal
PayPal is one of the biggest Kafka users in the industry; it manages and maintains over 40 production Kafka clusters in three geodistributed data centers and supports 400 billion Kafka messages a day. We will explore the management and monitoring PayPal applies to Kafka, from client-perceived statistics to configuration management, failover, and data loss auditing.
Maulin Vasavada is a software developer and an architect on the Kafka team at PayPal, building a suite of components for Kafka as a service. He has strong experience building large-scale financial systems, shipping and logistics software, and software release management systems. Previously, he worked for eBay and as a consultant for Sun Microsystems.
Kevin Lu is a software engineer at PayPal developing various Kafka components. He holds a degree in computer science from the University of California, Berkeley. Kevin first discovered his passion for coding in high school, when he developed plug-ins for Minecraft.
Na Yang is a member of technical stuff at PayPal, where she focuses on building a scalable streaming infrastructure platform. Previously, she built various big data and distributed systems at MapR and Quova. Outside of work, she likes to spend time hiking with her kids.
- Not Interested