Data Science & Analytic Methodology SME
micro1 · Remote (-11, -10, -9.5, -9, -8, -7, -6, -5, -4, -3.5, -3, -2, -1, 0, 1, 2, 3, 3.5, 4, 4.5, 5, 5.5, 5.75, 6, 6.5, 7, 8, 8.75, 9, 9.5, 10, 10.5, 11, 12, 12.75, 13, 14 timezones)
Posted January 21, 1970
Job Description
Role Title: Data Science & Analytic Methodology SME
Role Type: Contractor
Location: Remote
micro1 is engaging Data Science & Analytic Methodology SMEs to contribute expertise to a customer's high-impact project focused on advanced analytic pipelines and large language models (LLMs). In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Map scaled-analysis and pipeline-integration scenarios to an established taxonomy across key evaluation areas.
- Author detailed analytic cases that reflect authentic deployment patterns, including automated triage, enrichment, and analysis-at-scale, as well as representative failure modes in real-world settings.
- Evaluate and grade responses based on criteria such as source handling, reasoning, understanding of limitations, and practical utility.
- Identify and flag instances of model over-refusal that could hinder legitimate analytic workflows or disrupt pipeline continuity.
- Document challenging edge cases, emerging methodology concerns, and provide actionable recommendations for continuous improvement.
- Contribute clear, insightful written and verbal feedback that supports iterative, high-quality project outcomes.
Preferred Qualifications
- Demonstrated experience integrating LLMs—such as government GPT variants—into complex data or analytic pipelines.
- Proven capability in conducting analysis at scale, with an understanding of automation failure modes and relevant evaluation metrics.
- Track record of teaching, mentoring, or technical leadership in data science or related analytic disciplines.
- Expertise in authoring clear, concise technical documentation and conveying complex concepts through strong written English.
- Exposure to the design of evaluation frameworks or benchmark systems.
- Familiarity with defense, intelligence, or government analytic domains is highly valued.
- Ability to operate effectively in distributed, international project environments with minimal clearance constraints.
Originally posted on Himalayas
More jobs at micro1
US Macroeconomist
micro1 · Remote (United States) · Remote · $104k - $146k
Gaming & Gambling Attorney
micro1 · Remote (-11, -10, -9.5, -9, -8, -7, -6, -5, -4, -3.5, -3, -2, -1, 0, 1, 2, 3, 3.5, 4, 4.5, 5, 5.5, 5.75, 6, 6.5, 7, 8, 8.75, 9, 9.5, 10, 10.5, 11, 12, 12.75, 13, 14 timezones) · Remote · $291k - $832k
Junior Lawyer
micro1 · Remote (-11, -10, -9.5, -9, -8, -7, -6, -5, -4, -3.5, -3, -2, -1, 0, 1, 2, 3, 3.5, 4, 4.5, 5, 5.5, 5.75, 6, 6.5, 7, 8, 8.75, 9, 9.5, 10, 10.5, 11, 12, 12.75, 13, 14 timezones) · Remote · $104k - $166k
Paid Photo Contributor Opportunity (Hawaii-based)
micro1 · Remote (United States) · Remote · $291k - $291k
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
micro1 · Remote (Canada, United States) · Remote · $62k - $125k
See how well your resume matches this job before you apply
Run a free ATS check