Senior Data Engineer

Responsibilities:

You will be:

• Responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems
• Building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies
• Evaluating and translating technical design to workable technical solutions/code and technical specifications at par with industry standards
• Driving creation of re-usable artifacts
• Establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation
• Working closely with analysts/data scientists to understand impact to the downstream data models
• Writing efficient and well-organized software to ship products in an iterative, continual release environment
• Contributing and promoting good software engineering practices across the team
• Communicating clearly and effectively to technical and non-technical audiences
• Defining data retention policies
• Monitoring performance and advising any necessary infrastructure changes

Requirements:

• 5+ years’ experience as a data engineer
• 2+ years’ experience with AWS
• Strong SQL skills
• Python scripting proficiency
• Hands-on experience in building data processing pipelines
• Experience in structuring and modelling data in both relational and non-relational forms
• Strong expertise in cloud data platforms/warehouses like Databricks or Snowflake
• Extensive experience in big data engineering on a terabyte scale, including streaming technologies and near-real-time processing
• Experience working with VCS like Git
• Ability to work with different stakeholders and drive consensus within the team
• English level: B2, C1
• Readiness to work with the US Timezone (up to 9PM CET)

Nice to have:

• Proficiency in designing and implementing ETL/ELT processes and data integration workflows using tools like Apache Airflow, AWS Glue
• Understanding of big data and DevOps technologies (Kafka, Spark, Helm, Terraform)
• Experience in CI/CD for the data environment
• Experience in testing for data processing
• ML models operationalization (e.g., in Docker, Kubernetes)

Offer:

• Private medical care
• Co-financing for the sport card
• Training & learning opportunities
• Constant support of dedicated consultant
• Employee referral program