Data Engineer

Stanowisko: Data Engineer

Miejsce pracy: Warszawa

Data dodania: 28.05.2021

DCG is a modern technology company, gathering in its ranks IT related professionals. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position:

Data Engineer

Responsibilities:

  • Integrate third party provider data (via Files, APIs, Events…)
  • Upgrade vendor components through their major and minor patches
  • Maintain connectivity with internal customer applications sourcing their data referential information via our WebServices, APIs, ETLs
  • Reduce platform complexity by reducing point to point connections and favoring API connectivity
  • Work in an agile environment directly in contact with our data mangement counterparts and SMEs in France
  • Build tools and services to reduce manual work carried out by either our support team or our Data Management team
  • Build Data quality controls to monitor all our third-party data and data sent to our customers
  • Integrate and maintain data referentials in our Dataplatform
  • Build and maintain CI/CD Pipelines, shared libraries (data pipeline development, data quality, data lineage) and shared services (REST API, data viz, monitoring, scheduling)
  • Design and maintain APIs

Requirements:

  • Scripting: Shell/bash, Powershell
  • Scheduling management - Control M API (ideally)
  • Experience working with data of various formats (np. Avro, Parquet, JSON, CSV)
  • SQL expertise, knowledge of Microsoft SQL
  • very good knowledge of C#
  • .NET Webservices
  • ETL management
  • API building/maintenance
  • Git CD/CI
    Azure Dev Ops
  • Informatica - IDQ
  • Financial knowledge around MDM
  • Neoxam NDH would be fantastic
  • Spark/Scala or Python
  • Kubernetees, Docker, Kafka

Offer:

  • Private medical care
  • Constant support of dedicated consultant
  • Team-building events organised by DCG
  • Competitive salary adequate to experience and skills

Przed wyslaniem CV/dokumentów aplikacyjnych, uprzejmie prosimy kandydatów o zapoznanie się z klauzulą informacyjną.

Po zapoznaniu się z klauzulą informacyjną podaną przez Administratora Danych dobrowolnie wyrażam zgodę na przetwarzanie przez Ogłoszeniodawcę moich danych osobowych, zawartych w mojej ofercie pracy, dla potrzeb procesu tej rekrutacji oraz dla realizacji przyszłych projektów rekrutacyjnych.

Agencja doradztwa personalnego (nr licencji 4642)

Dane spółki: Diverse CG Sp. z o.o. Sp.k., ul. Towarowa 28, 00-839 Warszawa                                                     

REGON: 141316780

NIP: 5222877930

KRS: 0000733458

Obserwuj nas: