AI Developer

About the role

The senior AI Developer will design, train, fine‑tune, optimize and deploy large language models for on‑premise, offline and air‑gapped environments, building end‑to‑end RAG pipelines, MCP integrations and backend services while collaborating with distributed teams.

About the company

Salvo Software is a global firm that provides cost‑effective software solutions to help enterprises and startups navigate digital transformation.

Requirements

• Strong experience in Python for backend and ML development
• Expertise with ML frameworks such as PyTorch or TensorFlow, scikit‑learn, and pandas
• Solid knowledge of Postgres or MySQL for data storage
• Experience with Docker, Git, and DevOps best practices
• Hands‑on expertise with LLM training, fine‑tuning, and optimization
• Experience with Hugging Face Transformers & Datasets
• Familiarity with XML/XSD and Office document parsing tools
• Experience deploying models with vLLM, TGI, or Ollama
• Understanding of quantization techniques (GGUF, GPTQ, AWQ)
• Experience working with GPU optimization and the CUDA stack
• Ability to build solutions for offline, on‑prem, and air‑gapped environments
• Hands‑on experience designing and implementing RAG pipelines, including embedding models, vector stores (FAISS, Chroma, Weaviate, or pgvector), and retrieval optimization strategies
• Experience building or integrating MCP (Model Context Protocol) servers to connect LLMs with external tools, APIs, and structured data sources
• Experience building agentic systems using MCP in production or near‑production environments (preferred)
• Familiarity with advanced RAG techniques such as HyDE, re‑ranking, or multi‑hop retrieval (preferred)
• Experience managing ML model registries in offline environments (preferred)
• Familiarity with AWS for hybrid deployments (preferred)
• Experience with secure environments, restricted networks, or enterprise compliance requirements (preferred)
• Strong ownership mindset and problem‑solving ability (preferred)
• Ability to work effectively in distributed teams across time zones (preferred)
• Clear communication when discussing complex technical topics with both technical and non‑technical stakeholders (preferred)