Senior Spark/Scala Developer

Responsibilities:

• Working with Spark/Scala to define and maintain data ingestions and transformation
• Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time
• Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
• Working closely with analysts and business stakeholders to develop analytics models
• Collaboration with DevOps, QA and Product Management
• Providing detailed information about progress during PI Demo sessions

Requirements:

• Experience in Scala - minimum 4 years
• Experience with distributed data processing engines like Spark
• Experience with Hadoop ecosystem (Hive, Oozie, map reduce, ect)
• Proficient in SQL
• Previous experience in creating data flows
• Communicative English
• Code versioning strategy & Branching strategy (BitBucket / GIT)
• Familiar with AWS foundation - certification would be a value
• Familiar with Agile/Safe framework and ways of working
• Expierence in other programming languages like Python, Java, Shell
• Basic overview with Linux ecosystem - nice to have

Offer:

• Private medical care
• Co-financing for the sport card
• Training & learning opportunities
• Constant support of dedicated consultant
• Team-building events organized by DCG
• Employee referral program