[Remote] Staff AI Engineer

Note: The job is a remote job and is open to candidates in USA. Machinify is a leading healthcare intelligence company specializing in AI-powered solutions for health plans. They are seeking a Staff AI Engineer to design and build LLM applications while integrating foundation models and ensuring production-grade infrastructure.

Responsibilities

• Design and build LLM applications: RAG pipelines, agents, tool-use systems, structured generation, multi-step workflows
• Own prompt engineering and evaluation — write evals before you write prompts, and treat both as code
• Integrate foundation models (Claude, GPT, Gemini, open-weight Llama/Qwen/Mistral) and know when to reach for which
• Build the unglamorous infrastructure that makes LLMs production-grade: caching, streaming, retries, fallbacks, cost controls, observability, guardrails
• Fine-tune or distill models when prompting hits a wall (LoRA/QLoRA, SFT, DPO)
• Partner with product and design on UX patterns specific to AI (latency masking, streaming UIs, confidence display, human-in-the-loop)

Skills

• 3+ years of software engineering, with at least 1 year shipping LLM-based features in production
• Strong Python and TypeScript; comfortable in a real codebase, not just notebooks
• Deep practical knowledge of the LLM stack: prompting techniques, function calling, structured outputs, context management, embedding models, vector search
• Have built and maintained an eval suite — and have opinions on why most public benchmarks are misleading
• Comfortable with at least one orchestration approach (custom, LangGraph, Inngest, Temporal) and one vector store (pgvector, Pinecone, Turbopuffer, Weaviate)
• Cost- and latency-aware: can read a token bill and a trace and know where to cut
• Clear communicator who can push back when 'just add AI' isn't the right answer
• Experience with agent frameworks and MCP (Model Context Protocol)
• Fine-tuning experience on open-weight models, or work with inference servers like vLLM/TGI/SGLang
• Background in security, evals, or red-teaming for LLM systems
• Contributions to open-source AI tooling

Benefits

• Work from anywhere in the US! Machinify is digital-first.
• Top Medical/Dental/Vision offerings
• FSA/HSA
• Tuition reimbursement
• Competitive salary, 401(k) with company match
• Unlimited PTO
• Additional health and wellness benefits and perks
• Flexible and trusting environment where you’ll feel empowered to do your best work
• Meaningful equity
• Healthcare

Company Overview