Senior Data Engineer

Responsibilities:

• Work with various clients globally, delivering software systems and best practices for scalable and robust solutions.
• Engineer data platforms for scale, performance, reliability, and security.
• Design and build big data streaming capabilities.
• Integrate data sources and optimize data processing.
• Develop infrastructure in cooperation with Platform & Reliability engineers.
• Work alongside analysts to enhance the data experience.
• Onboard and mentor new engineers for clients and internal teams. 

Requirements:

• 6+ years in a senior developer role using Python, with hands-on experience in building data processing pipelines
• Proven ability to work independently and effectively in a distributed team
• Strong proficiency in programming languages such as Python and/or Scala
• Expertise in data processing frameworks and libraries (e.g., Spark, SQL)
• Strong expertise in cloud data platforms/warehouses like Databricks or Snowflake
• Experience with DynamoDB, S3/Athena
• In-depth knowledge of database systems (relational and NoSQL), data modeling, and data warehousing concepts
• Proficiency in designing and implementing ETL/ELT processes and data integration workflows using tools like Apache Airflow, AWS Glue
• Extensive experience in big data engineering on a terabyte scale, including streaming technologies and near-real-time processing
• Strong experience with cloud technologies and data pipelines, specially with AWS
• Proficiency with Docker and hands-on experience with Kubernetes
• Experience working with VCS like Git
• Ability to work with different stakeholders and drive consensus within the team
• English level: B2, C1
• Readiness to work with the US Timezone (up to 9PM CET)

Nice to have:

• Understanding of big data and DevOps technologies (Kafka, Spark, Helm, Terraform).
• Experience in CI/CD for the data environment
• Experience in testing for data processing
• ML models operationalization (e.g., in Docker, Kubernetes)

Offer:

• Private medical care
• Co-financing for the sport card
• Training & learning opportunities
• Constant support of dedicated consultant
• Employee referral program