Ingestion Operations Engineer

Responsibilities:

• Ingest data into Hadoop using the ARC Ingestion Framework
• Prepare and test configurations for new data sources
• Maintain and support data sources already ingested in the production environment
• Work collaboratively within an Agile / Scrum team
• Troubleshoot and resolve issues related to data ingestion processes
• Manage configurations and version control using Git
• Work in Unix / Linux environments and use SQL for data validation and analysis
• Ensure smooth integration of data from multiple sources, including cloud-based environments
• Continuously improve ingestion processes and contribute to automation where possible

Requirements:

• Proficiency in Unix / Linux environments
• Good knowledge of SQL
• Experience with Git for version control
• Strong analytical and rational thinking skills
• Excellent troubleshooting abilities
• Experience in testing and validating configurations
• Ability to work effectively in an Agile / Scrum team

Nice to have:

• Experience with Jenkins for CI/CD pipelines
• Basic knowledge of Python
• Familiarity with Jira, Confluence, Helix / Remedy
• Experience working with Hadoop
• Knowledge of AWS cloud services
• Experience with Robot Framework for test automation

Offer:

• Private medical care
• Co-financing for the sports card
• Constant support of dedicated consultant
• Employee referral program