Azure Data Engineer with Python

Stanowisko: Azure Data Engineer with Python

Miejsce pracy: Warszawa, Lublin - 100% remote

Data dodania: 04.11.2022

DCG is a modern technology company, gathering in its ranks IT related professionals. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position:

Azure Data Engineer with Python

Responsibilities:

  • Implementing data ingestion pipelines from multiple data sources using Azure Data Factory, Azure Databricks and other ETL tools
  • Developing Big Data and non-Big Data cloud-based enterprise solutions in Spark and Python and related frameworks/libraries
  • Developing scalable and re-usable, self-service frameworks for data ingestion and processing
  • Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data
  • Processing performance analysis and optimization
  • Bringing best practices in following areas: Design & Analysis, Cost-wise scalability, Automation (Pipelining, IaC), Testing, Monitoring, Documentation
  • Autonomously working in cross-project environment and bringing seniority in whole organization

 

Requirements:

  • Very good knowledge of English (at least B2+)
  • Big data related topics (Hadoop stack, HDInsight) knowledge
  • PySpark knowledge
  • Knowledge of data management principles
  • Strong communication skills and self-management
  • Experience in cloud-based solutions
  • Experience in working with Agile (preferably Scrum)
  • Experience working with structured and unstructured data
  • Direct experience of building data pipelines using Azure Data Factory, Azure Databricks or Azure Synapse
  • Hands-on experience designing and delivering solutions using Azure DataLake
  • Very good knowledge of SQL
  • Experience in building ETL/ Data Warehouse transformation process
  • Python experience at least 3 years
  • At least 3-4 years of experience in Azure development

 

Offer:

  • Private medical care
  • Sports card
  • Trainings & Learning opportunities
  • Ability to work 100% remotely

Przed wyslaniem CV/dokumentów aplikacyjnych, uprzejmie prosimy kandydatów o zapoznanie się z klauzulą informacyjną.

Po zapoznaniu się z klauzulą informacyjną podaną przez Administratora Danych dobrowolnie wyrażam zgodę na przetwarzanie przez Ogłoszeniodawcę moich danych osobowych, zawartych w mojej ofercie pracy, dla potrzeb procesu tej rekrutacji oraz dla realizacji przyszłych projektów rekrutacyjnych.

Agencja doradztwa personalnego (nr licencji 4642)

Dane spółki: Diverse CG Sp. z o.o. Sp.k., ul. Towarowa 28, 00-839 Warszawa                                                     

REGON: 141316780

NIP: 5222877930

KRS: 0000733458

Obserwuj nas:

UE