Vijayant Soni

Apache Spark™ is a widely used open source distributed computing engine. It is one of the main components of Uber’s data stack. Spark is the primary batch compute engine at Uber. Like any other framework, Spark comes with its own set of tradeoffs. Problem Statement Users who have worked with Spark understand that writing optimized Spark applications is not a straightforward task and requires a lot of configuration tuning, as well as code-level optimizations.