Expert Talent Pool, Agents and Reinforcement Learning
Clera · Remote (-11, -10, -9.5, -9, -8, -7, -6, -5, -4, -3.5, -3, -2, -1, 0, 1, 2, 3, 3.5, 4, 4.5, 5, 5.5, 5.75, 6, 6.5, 7, 8, 8.75, 9, 9.5, 10, 10.5, 11, 12, 12.75, 13, 14 timezones)
Posted January 21, 1970
AI Summary
This is a remote expert-network role supporting AI human-data projects focused on agents and reinforcement learning. The work involves designing RL training environments, verifiers, reward functions, and test harnesses, translating business workflows (ERP, CRM, finance, operations) into measurable scenarios, and grading or repairing agent trajectories. It suits experienced engineers who want to shape how AI agents are trained and evaluated.
Job Description
About the Role
Join an expert network supporting AI human-data projects focused on agents and reinforcement learning. You will design training environments and evaluation systems, and assess agent behavior as projects become available.
What You'll Do
Design reinforcement learning environments, including Python and Docker setups, state spaces, tool integrations, and scoring mechanisms.
Build robust verifiers and reward functions that resist agent gaming.
Translate real-world business workflows in areas such as ERP, CRM, finance, and operations into measurable scenarios.
Integrate tools and REST APIs, and build test harnesses using pytest or similar tools.
Lead agent demonstration and computer-use programs, setting standards for trace collection quality.
Grade and repair agent trajectories, and mentor contributors on evaluation practices.
What We're Looking For
At least 5 years of experience in software engineering, QA automation, machine learning, reinforcement learning, or business systems and operations paired with hands-on agent or RL data work.
Strong Python skills and experience building tools or services used by others.
Experience designing environments, verifiers, reward functions, or test harnesses that evaluate software or agent behavior, using tools such as pytest, Playwright, Selenium, or Gymnasium-style environments.
Hands-on experience with agent or RL data, such as demonstrations, trajectory grading, trace collection, or computer-use demos.
Experience with REST APIs and Docker.
Experience leading or reviewing data, evaluation, or demonstration work is valuable, as is expertise modeling workflows in business systems such as Salesforce or ERP platforms.
A degree in computer science, engineering, or a related field is relevant.
Compensation & Benefits
Compensation is $80 to $200 per hour, depending on project, field, and level. Pay is based on hours worked.
Location
Remote. Projects typically run from one week to several months.
Compensation Range: $166.4K - $416K
Originally posted on Himalayas
More jobs at Clera
Expert Talent Pool, Agents and RL (Associate)
Clera · Remote (-11, -10, -9.5, -9, -8, -7, -6, -5, -4, -3.5, -3, -2, -1, 0, 1, 2, 3, 3.5, 4, 4.5, 5, 5.5, 5.75, 6, 6.5, 7, 8, 8.75, 9, 9.5, 10, 10.5, 11, 12, 12.75, 13, 14 timezones) · Remote · $73k - $146k
Expert Talent Pool, Annotation Associate
Clera · Remote (-11, -10, -9.5, -9, -8, -7, -6, -5, -4, -3.5, -3, -2, -1, 0, 1, 2, 3, 3.5, 4, 4.5, 5, 5.5, 5.75, 6, 6.5, 7, 8, 8.75, 9, 9.5, 10, 10.5, 11, 12, 12.75, 13, 14 timezones) · Remote · $31k - $73k
Legal Expert (US Law), AI Evaluation
Clera · Remote (United States) · Remote · $166k - $229k
Head of Growth
Clera · Remote (-11, -10, -9.5, -9, -8, -7, -6, -5, -4, -3.5, -3, -2, -1, 0, 1, 2, 3, 3.5, 4, 4.5, 5, 5.5, 5.75, 6, 6.5, 7, 8, 8.75, 9, 9.5, 10, 10.5, 11, 12, 12.75, 13, 14 timezones) · Remote · €100k - €120k
Computational and Experimental Scientist
Clera · Remote (United States) · Hybrid · $36k - $60k
See how well your resume matches this job before you apply
Run a free ATS check