Data Engineer with Airflow

Stanowisko: Data Engineer with Airflow

Miejsce pracy: 100% remote

Data dodania: 28.01.2025

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Data Engineer with Airflow

Responsibilities:

  • Participate in the migration process from Tableau Prep to Airflow, ensuring a seamless and efficient transition
  • Develop, maintain, and optimize data pipelines and workflows using Python and Airflow
  • Write and optimize complex SQL queries for large datasets, including joins and window functions, to support data transformation and reporting needs
  • Collaborate closely with data engineers and analysts in a Kanban environment to ensure the quality and reliability of data solutions
  • Ensure proper documentation of data workflows, processes, and pipelines to facilitate team collaboration and maintenance
  • Troubleshoot and resolve issues related to data workflows, pipelines, and integrations
  • Implement best practices for data management, pipeline optimization, and performance tuning

 

Requirements:

  • Proficiency in Python with a strong focus on data engineering workflows
  • Advanced knowledge of SQL, including experience with large joins and window functions
  • Hands-on experience with Airflow for orchestrating workflows and data pipelines
  • English proficiency at C1 or higher for effective communication in an international team
  • Ability to perform live coding during the recruitment process (Python and SQL)
  • Experience working with Snowflake or similar cloud-based data warehouses
  • Familiarity with DBT (Data Build Tool) for transforming data in warehouses
  • Experience with AWS S3 or other cloud storage solutions

 

Offer:

  • Private medical care
  • Co-financing for the sports card
  • Training & learning opportunities
  • Constant support of dedicated consultant
  • Employee referral program

Przed wyslaniem CV/dokumentów aplikacyjnych, uprzejmie prosimy kandydatów o zapoznanie się z klauzulą informacyjną.

Po zapoznaniu się z klauzulą informacyjną podaną przez Administratora Danych dobrowolnie wyrażam zgodę na przetwarzanie przez Ogłoszeniodawcę moich danych osobowych, zawartych w mojej ofercie pracy, dla potrzeb procesu tej rekrutacji oraz dla realizacji przyszłych projektów rekrutacyjnych.

Agencja doradztwa personalnego (nr licencji 4642)

Dane spółki: DCG Sp. z o.o., ul. Towarowa 28, 00-839 Warszawa                                                     

REGON: 141316780

NIP: 5222877930

KRS: 0001067305

Obserwuj nas:
UE