The following tasks are the responsibility of the Azure Data Engineer :

 

Mapping the data in data sources

Profiling and determining the data quality of the data in data sources

Contribute to the evaluation and further elaboration & fine-tuning of the underlying data platform architecture

Further design and development of Data Lake as an integral part of the new Data Platform

Creating high-performance data pipelines to integrate new data sources into Data Lake or further layers of the platform

Design of the necessary data models in the correct layers of the platform to integrate the data

Architecture documentation , available datasets and technical solutions

Migration of legacy processes (on prem SQL Server DWH) to Azure native solutions in the target architecture

Translating complex business issues into concrete Data/BI solutions

Optimizing the performance of developments and data structures (indexes, partitions, compression, in-memory tables, ...)

Performing unit and integration tests

Writing technical documentation

 

 

 

The proposed candidate must have at least 7 years of experience in implementation projects on the Microsoft Data Platform. An extensive knowledge of both on-premise and Azure SQL technology is a must.

 

The following techniques/technologies are required:

 

SQL Server databases (SQL Server 2016 e.v.)

Azure Synapse Analytics

Azure Data Factory

Azure Databases (Serverless pools & MI must have + Dedicated pools plus)

Azure Data Lake Storage (ADLS2)

SQL Server Integration Services (SSIS - nice to have to support migration to ADF)

T-SQL

DAX (more)

Power BI (plus)

SQL Server Analysis Services Tabular (SSAS) (plus)

Knowledge of Data Lake concepts and architecture is a strong plus

Have a thorough experience in:

 

End-to-end Azure SQL en on-premise projecten

Azure Data Platform migrations

Building automated ETL/ELT processes using ADF

Relational, Dimensional & Data Vault modelleren

Building optimized OLAP Tabular cubes and writing DAX (plus)

Optimizing developments and data structures

Profiling and research into data quality

Mapping data sources

Very good knowledge of both national languages 鈥嬧��(mother tongue) as well as English.

 

Azure Data Factory

Azure Synapse Analytics

Spark

SQL

SQL Server