Azure Data Engineer

Stanowisko: Azure Data Engineer

Miejsce pracy: Warszawa, Lublin

Data dodania: 22.07.2022

DCG is a modern technology company, gathering in its ranks IT related professionals. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position:

Azure Data Engineer

Responsibilities:

  • Implementing data ingestion pipelines from multiple data sources using Azure Data Factory, Azure Databricks and other ETL tools
  • Developing Big Data and non-Big Data cloud-based enterprise solutions in Spark and Python and related frameworks/libraries
  • Developing scalable and re-usable, self-service frameworks for data ingestion and processing
  • Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data
  • Processing performance analysis and optimization
  • Bringing best practices in following areas: Design & Analysis, Cost-wise scalability, Automation (Pipelining, IaC), Testing, Monitoring, Documentation
  • Autonomously working in cross-project environment and bringing seniority in whole organization

 

Requirements:

  • At least 2 years of experience in Azure development
  • Python experience at least 2 years
  • Experience in building ETL/ Data Warehouse transformation process
  • Very good knowledge of SQL
  • Hands-on experience designing and delivering solutions using Azure DataLake
  • Direct experience of building data pipelines using Azure Data Factory, Azure Databricks or Azure Synapse
  • Experience working with structured and unstructured data
  • Experience in working with Agile (preferably Scrum)
  • Experience in cloud-based solutions
  • Very good knowledge of English (at least B2+)
  • Strong communication skills and self-management
  • Knowledge of data management principles
  • PySpark knowledge
  • Big data related topics (Hadoop stack, HDInsight) knowledge

 

Offer:

  • Private medical care
  • Life insurance
  • Trainings & Learning opportunities
  • Competitive salary adequate to experience and skills

Przed wyslaniem CV/dokumentów aplikacyjnych, uprzejmie prosimy kandydatów o zapoznanie się z klauzulą informacyjną.

Po zapoznaniu się z klauzulą informacyjną podaną przez Administratora Danych dobrowolnie wyrażam zgodę na przetwarzanie przez Ogłoszeniodawcę moich danych osobowych, zawartych w mojej ofercie pracy, dla potrzeb procesu tej rekrutacji oraz dla realizacji przyszłych projektów rekrutacyjnych.

Agencja doradztwa personalnego (nr licencji 4642)

Dane spółki: Diverse CG Sp. z o.o. Sp.k., ul. Towarowa 28, 00-839 Warszawa                                                     

REGON: 141316780

NIP: 5222877930

KRS: 0000733458

Obserwuj nas: