Saurabh Shubham

senior data engineer · berlin, germany

summary

Senior Data Engineer with 7+ years of experience across manufacturing data platforms, sales-data pipelines, and backend services. Build Python and SQL ETL/ELT pipelines with Dagster, Airflow, dbt, and DLT. Work spans CDC, lakehouse and graph database systems, cloud delivery, infrastructure as code, feature flags, and production observability.

experience

GROPYUS berlin, germany

Senior Data Engineer aug 2022 — present

  • Build Python and SQL ETL/ELT pipelines for production planning, element lifecycle tracking, manufacturing reporting, and operational monitoring.
  • Orchestrate CDC, PostgreSQL, lakehouse, and graph database workflows with Dagster, Airflow, dbt, and DLT; release tested changes through Azure CI/CD.
  • Implement anomaly detection for data pipelines and monitor them with Prometheus, Grafana, and operational alerts, supporting improvements to robot and manufacturing efficiency.
  • Use Terraform, Docker, Kubernetes, and Unleash feature flags to support platform delivery and controlled releases.

Sigmoid bengaluru, india

Software Development Engineer jun 2021 — jul 2022

  • Built Python, PySpark, and Pandas ETL pipelines that transformed consumer-goods sales data into reporting datasets.
  • Orchestrated data workflows with Airflow on Google Cloud, managed infrastructure with Terraform, and worked with MySQL data stores.

Amdocs pune, india

Software Engineer jun 2019 — jun 2021

  • Developed CRM backend features in Java and Spring, taking requirements through implementation and integration.
  • Built REST and SOAP service integrations backed by Oracle databases.

selected project

regulation check

EU AI Act readiness application · independent project

  • Built a FastAPI and PostgreSQL application, packaged it with Docker, and automated testing and deployment with GitHub Actions.

technical skills

languages and frameworks
Python, SQL, Java, Spring, FastAPI
data engineering
ETL/ELT, CDC, Dagster, Airflow, dbt, DLT, PySpark, Pandas, lakehouse
cloud and delivery
Microsoft Azure, Google Cloud, Terraform, Docker, Kubernetes, GitHub Actions, CI/CD, Git
observability and controls
Prometheus, Grafana, alerting, Unleash feature flags
storage and interfaces
PostgreSQL, MySQL, Oracle, graph databases, REST APIs, SOAP APIs

education

recognition