AI Engineer (RAG & On Prem LLMs)

Responsibilities:

• Architect, implement, and optimize end-to-end Retrieval Augmented Generation (RAG) pipelines for enterprise use cases in on-premises environments
• Design and integrate retrieval mechanisms (e.g. vector databases such as Neo4j) with generative models (e.g. LLAMA 3.2, Mistral)
• Fine-tune and optimize retrieval and generation components to achieve high accuracy and low latency
• Implement and customize inference servers using vLLM and LiteLLM for efficient and scalable LLM serving
• Integrate open-source large language models with proprietary data sources and enterprise APIs
• Design GPU-optimized, scalable on-prem infrastructure for model training and inference, ensuring security and data governance compliance
• Collaborate with DevOps teams to containerize workflows using Docker and Kubernetes and automate MLOps pipelines
• Apply performance optimization techniques such as quantization, pruning, and dynamic batching
• Monitor system performance, troubleshoot bottlenecks, and ensure high availability
• Work closely with data engineers and business stakeholders to translate business requirements into technical AI solutions in telco environments

Requirements:

• At least 3 years of professional experience in ML/NLP roles, including 2+ years working with RAG systems
• Proven experience deploying and operating LLM‑based solutions in on‑prem or hybrid environments
• Hands‑on experience with vLLM, LiteLLM, and open‑source LLMs such as LLAMA 3.2, DeepSeek, or Mistral
• Strong Python skills and experience with frameworks such as PyTorch, Hugging Face Transformers, and LangChain
• Experience with vector databases (e.g. Neo4j)
• Familiarity with Linux‑based systems and Red Hat OpenShift
• Strong problem‑solving and analytical skills
• Ability to clearly communicate complex AI concepts to non‑technical stakeholders
• Bachelor's, Master's, or PhD degree in Computer Science, Artificial Intelligence, or a related field
• Knowledge of English (B2+/C1)

Offer:

• Private medical care co-financing
• Sports card
• Training & learning opportunities
• Life insurance co-financing