Back to jobs
    Clera logo

    Senior Software Engineer, Model Evaluation

    EmployerCleraOn-site - San Francisco, California, United StatesPosted 2026-11-19
    This listing's locations
    On-site - San Francisco, California, United States
    Employment
    Full-time
    Compensation
    USD 180,000–250,000 per year

    Role description

    About the Role

    Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

    What You'll Do

    • Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
    • Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.
    • Train and fine-tune models, using evaluation results to guide experiments.
    • Identify agent failures, improve production systems, and measure whether changes work.
    • Help establish the team's research and evaluation practices.

    What We're Looking For

    • At least 3 years of experience, operating at a senior or staff level.
    • Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.
    • Practical experience training and fine-tuning models, not only using models through APIs.
    • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
    • Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

    Compensation & Benefits

    Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.

    Location

    Hybrid in San Francisco, California, United States.