Senior Data Engineer

Stanowisko: Senior Data Engineer

Miejsce pracy: Gdańsk

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Senior Data Engineer

Responsibilities:

  • Building distributed and highly parallelized BigData processing pipeline which process massive amount of data (both structured and unstructured) in near real-time
  • Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
  • Work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment

 

Requirements:

  • Experience in Scala and Spark minimum 5 years of experience
  • Knowledge of Big Data Ecosystem (Hadoop stack: YARN, EMR, Sqoop, Hive, etc.)
  • Experience with Kafka at a basic level
  • Experience with Impala
  • Knowledge of Jenkins, JIRA, Bitbucket and Git
  • Experience in Snowflake in AWS environment
  • Experience of implementing data security capabilities such as encryption and anonymization
  • Excellent communication skills and experience of distributed global teams
  • Data driven thinking capabilities
  • Experience in using Agile methods

Nice to have:

  • Strong knowledge about Unit testing
  • Code versioning strategy & Branching strategy
  • Familiar with Agile/Safe framework
  • Prior Financial Service experience is considered a plus

 

Offer:

  • Private medical care
  • Co-financing for the sports card
  • Constant support of dedicated consultant
  • Employee referral program

Agencja doradztwa personalnego (nr licencji 4642)

Dane spółki: DCG Sp. z o.o.,

Siedziba główna: ul. Towarowa 28, 00-839 Warszawa

Oddział: Aleja Grunwaldzka 50A, 80-241 Gdańsk

REGON: 141316780

NIP: 5222877930

KRS: 0001067305

Obserwuj nas:
UE