COMMUNITY DAY

ITALY

Building Data Lake Platform fully serverless

Data platforms are notorious for needing infrastructure that needs to run 24x7x365. We took on a challenge to implement a self service Data Lake platform using only Serverless cloud services. This session will present a story of the endeavour from business requirements, design to implementation in an enterprise setup, and it will cover: when to platform data lakes aka centralise vs decentralise, how to ensure the data lakes remains usable, how to enhance developer experience via self service mechanisms, and when should you use a data lake over other data products like data warehouse.

Anurag Kale