Track3: Data Craftsmanship

Using Streaming Data for Predictive Analytics with Databricks

Explore the transformative power of streaming data with this hands-on workshop using Databricks.

Join our workshop to learn how to construct your own Delta Live Tables (DLT) pipeline, streamlining and automating data ingestion, transformation, and serving using streaming data. The session will culminate with the deployment of a Machine Learning model for real-time predictions and a demonstration of a Power BI dashboard to monitor predictions and model performance. Finally, participants will learn how to address data drift by triggering model retraining with fresh data directly from the dashboard.

Learning goal

By the end of the workshop, participants will learn to construct their own Delta Live Tables pipeline on Databricks, streamlining and automating data ingestion, transformation, and serving.

Pre-requisites

Basic PySpark & Databricks knowledge is needed. High level understanding of Machine Learning Models’ concepts (training, deployment, serving) is a plus.

  • Konstantinos Ninas

    Konstantinos received his Master of Science in Business Analytics from the Athens University of Economics and Business. He is an experienced ERP Business Consultant with a diverse domain knowledge and experience across multiple industries such as Retail, Pharmaceutical, Insurance and more. Konstantinos has been with the team since 2023.

  • Panagiotis Goumenakis

    Panagiotis received his Master of Science in Big Data and Analytics from the University of Piraeus and his BSc in Mathematics from University of Surrey. Before joining D ONE, he was employed as a ML Engineer for a European cloud-based Neobank and also as a R&D Engineer in the sector of Maritime Software Solutions. He has been with the team since 2023.