Senior Data Engineer

Responsibilities:

• Work with various clients globally, delivering software systems and best practices for scalable and robust solutions.
• Engineer data platforms for scale, performance, reliability, and security.
• Integrate data sources and optimize data processing.
• Proactively address challenges, resolve blockers, and drive effective communication across distributed teams.
• Continuously seek opportunities to enhance data systems and ensure alignment with evolving business needs.
• Onboard and mentor new engineers for clients and internal teams

Requirements:

• 5+ years in a senior developer role, with hands-on experience in building data processing pipelines
• Proficiency with GCP services, especially BigQuery and BigQuery SQL, for large-scale data processing and optimization
• Extensive experience with Apache Airflow, including DAG creation, triggers, and workflow optimization
• Knowledge of data partitioning, batch configuration, and performance tuning for terabyte-scale processing
• Strong Python and/or Scala proficiency, with expertise in modern data libraries and frameworks (e.g., Databricks, Snowflake, Spark, SQL)
• Experience with unit testing, pre-commit checks, and strict type enforcement for data pipelines
• Deep understanding of relational and NoSQL databases, data modelling, and data warehousing concepts
• English level: B2, C1

Nice to have:

• Expertise in optimizing BigQuery performance using tools like Query Profiler and addressing compute resource bottlenecks
• Prior experience developing or testing custom operators in Apache Airflow
• Familiarity with Docker, Kubernetes, Helm, Terraform, Kafka, and CI/CD pipelines for data environments

Offer:

• Private medical care
• Co-financing for the sport card
• Training & learning opportunities
• Constant support of dedicated consultant
• Employee referral program