Senior Scala Engineer

Responsibilities:

• Big Data Processing Pipeline: Design and build a distributed, highly parallelized pipeline capable of processing massive amounts of structured and unstructured data in near real-time
• Data Transformation: Leverage Apache Spark to enrich and transform corporate data, enabling efficient data searching, visualization, and advanced analytics
• Collaboration: Work closely with DevOps, QA, and Product Management teams within a Continuous Delivery environment to ensure seamless integration and deployment of solutions

Requirements:

• Minimum 5 years of a professional experience
• Proven experience in programming with Scala and working with Apache Spark
• Experience with Spark and Spark SQL
• Strong knowledge of the Hadoop stack, including: YARN, EMR, Sqoop, Hive
• Proficiency in Impala for querying and managing large datasets
• Familiarity with Jenkins, JIRA, Bitbucket, and Git for CI/CD and project management
• Excellent communication abilities and experience working with distributed global teams
• Ability to analyze and drive decisions based on data
• Experience in using Agile methodologies for project management and delivery
• Familiarity with Snowflake data warehousing solutions is a significant advantage
• Experience in implementing data security features such as encryption and anonymization
• Experience with Kafka - nice to have 
• Prior experience in the financial services sector - nice to have

Offer:

• Private medical care
• Co-financing for the sport card
• Training & learning opportunities
• Constant support of dedicated consultant
• Team-building events organized by DCG
• Employee referral program