Passioned follower of [scala]ble architectures, big data architect and consultant, #odjug coorganizer.

Passioned follower of [scala]ble architectures, big data architect and consultant, #odjug coorganizer.
The story is about pain and enjoy or how we built realtime data platform with 2.5M events per second. What challenges we faced and which lessons were learned. Step by step we will introduce technologies we use like Spark, Presto, Kafka, AWS and EMR and best practices we come up to like monitoring, deployment and scaling.