Senior Data Engineer (m/f/d)
- Deichmann
- 45478 Mülheim an der Ruhr, Germany
- 05/04/2024
Full time
Data Engineering
Business Intelligence
Software Engineering
DevOps
Job Description
Wissollstraße 15, 45478 Mülheim an der Ruhr Plan your commute
Job details
Job details
Data Intelligence & Analytics
We are the Data Intelligence & Analytics Unit of Deichmann SE and the experts when it comes to data, analyzes and machine learning . With our innovative, analytical data products, developed in close cooperation with our experts from the specialist areas, we anchor a "data-driven” mindset - be it in the context of omnichannel, eCommerce, marketing, pricing, purchasing or logistics. We use modern technologies and concepts - always with the aim of making our business better and our customers happier.
Tasks:
Agile development of data products and pipelines in the central data lakehouse, together with data scientists, data analysts and stakeholders from IT and the specialist departments
Development and automation of data flows (batch and streaming), new interfaces and further development of the data lakehouse architecture
Use of State-of-the-art technologies such as Spark, Databricks, Airflow and other components within the Microsoft Azure Cloud
Operation and continuous improvement of the data platform and data processes, including through the introduction of data quality and process monitoring
Close coordination with the data and IT teams within Deichmann SE
Agile development of data products and pipelines in the central data lakehouse, together with data scientists, data analysts and stakeholders from IT and the specialist departments
Development and automation of data flows (batch and streaming), new interfaces and further development of the data lakehouse architecture
Use of State-of-the-art technologies such as Spark, Databricks, Airflow and other components within the Microsoft Azure Cloud
Operation and continuous improvement of the data platform and data processes, including through the introduction of data quality and process monitoring
Close coordination with the data and IT teams within Deichmann SE
Profile:
Relevant professional experience in the areas of data engineering, ETL development, software engineering or big data
Strong operational focus, a pragmatic hands-on mentality and a strong ability to work in a team
Excellent knowledge of Spark and Python
Very good knowledge of SQL and Data warehouse concepts
Good knowledge of CI/CD and the use of test frameworks
Experience with big data scenarios and cloud services
Great interest in cutting-edge concepts such as data mesh, cloud data lakehouses and stream analytics
Very good knowledge of English and basic knowledge of German
Relevant professional experience in the areas of data engineering, ETL development, software engineering or big data
Strong operational focus, a pragmatic hands-on mentality and a strong ability to work in a team
Excellent knowledge of Spark and Python
Very good knowledge of SQL and Data warehouse concepts
Good knowledge of CI/CD and the use of test frameworks
Experience with big data scenarios and cloud services
Great interest in cutting-edge concepts such as data mesh, cloud data lakehouses and stream analytics
Very good knowledge of English and basic knowledge of German