AI Infrastructure / Product Engineer

About the Role

Join a healthtech team applying AI to legal workflows. You will bridge AI research and product development, building the evaluations, services, and features needed to bring applied AI into dependable production systems.

What You'll Do

• Build repeatable benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost.

• Create dashboards that make system performance changes visible to the team.

• Turn research prototypes into production retrieval, drafting, document, and agent workflows.

• Develop backend services, APIs, and internal tools to support testing and releases.

• Deploy and operate cloud infrastructure, including monitoring, databases, and delivery pipelines.

• Work with AI research while staying connected to product and user needs.

What We're Looking For

• At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.

• Strong Python skills and hands-on experience deploying software to the cloud.

• Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.

• Experience with APIs, databases, backend services, deployment pipelines, and monitoring or performance dashboards.

• Ability to turn experimental code or ambiguous ideas into usable, maintainable products.

• Full-stack experience is a plus. Helpful technologies include FastAPI, Docker, React, Next.js, Postgres, and vector databases.

• Familiarity with LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation is valuable.

Compensation & Benefits

Annual base salary is $180,000 to $260,000 USD, depending on skills, experience, and role scope. Visa sponsorship is not available.

Location

Remote within the United States.

Originally posted on Himalayas