NodJobsNodJobs

Member of Technical Staff, AI Researcher (New Stealth Startup)

Red Cell Partners Β· Remote (USA)

πŸ‡ΊπŸ‡Έ Remote (US)Principal27d ago

At a glance

Where
Remote β€” open to applicants in the United States
Pay
Not disclosed by Red Cell Partners
Level
Principal
Experience
5+ years
Visa
U.S. citizenship is required.
Posted
October 22, 2026
Last confirmed open
57m ago
At Red Cell Partners
21 open remote roles β€” mostly Software Development (7), DevOps & Sysadmin (3), Finance & Legal (3). Pay is listed on 15 of them ($135,000 – $440,000/yr).
How to apply
Directly on Red Cell Partners's own site β€” no NodJobs account needed.

About the role

This role designs evaluation frameworks, reward models, and feedback systems for frontier AI models and agents for a new stealth startup's platform, blending research with production-quality engineering. It suits a candidate with 5+ years of relevant technical experience and hands-on work in AI agents, evaluations, or reinforcement learning.

What you'll do

  • Design and build evaluation frameworks, benchmarks, and methodologies for frontier LLMs, AI agents, multimodal models, and RL environments.
  • Develop reward models, programmatic verifiers, graders, and other feedback systems that make model behavior measurable and improvable.
  • Design and run controlled supervised fine-tuning and reinforcement learning experiments measuring dataset effects on capability, generalization, and alignment.
  • Research and define what makes evaluations representative of real-world work and operational environments.
  • Build systems for producing high-quality human data, including expert task design, annotation methods, data-quality signals, and data-attribution techniques.
  • Translate research questions into lightweight, rigorous experiments that generate actionable findings.
  • Prototype quickly, evaluate results, diagnose failure modes, and convert findings into improved benchmarks, datasets, or technical systems.
  • Move promising methods from experimentation into scalable, production-quality implementations.
  • Work across research, engineering, product, and operations to advance a shared technical roadmap.
  • Contribute to the broader technical community through benchmarks, open-source tools, research, and technical writing.

What you'll need

  • 5+ years of relevant experience in machine learning, AI, computer science, data science, software engineering, or a related technical field.
  • Demonstrated ability to operate at the intersection of AI research and software engineering.
  • Strong Python skills and experience building reliable, scalable software.
  • Hands-on experience with AI agents, model evaluations, reinforcement learning, post-training, or related systems.
  • Strong understanding of frontier AI methods, including benchmarks, evaluation techniques, agent harnesses, post-training approaches, and training-data design.
  • Experience building or working with reward models, automated verifiers, graders, or other model-feedback systems.
  • Experience designing evaluations or experiments measuring model capability, generalization, alignment, or agent performance.
  • Ability to build research prototypes and develop them into maintainable, production-quality systems.
  • Strong analytical, problem-solving, written communication, and technical documentation skills.
  • Communicates complex technical concepts clearly to technical and nontechnical stakeholders.
  • High agency, sound technical judgment, and a strong sense of ownership.
  • Comfortable operating in a fast-moving environment where priorities and technical approaches may evolve.
  • U.S. citizenship is required.

Nice to have

  • An advanced degree in machine learning, AI, computer science, data science, or a related field.
  • Equivalent research and engineering experience, including technical, open-source, or published output, is encouraged.

Benefits listed by Red Cell Partners

  • Career track opportunity with potential for rapid advancement as the firm grows
  • Employer-paid comprehensive health care including medical, dental, and vision
  • Paid maternity and paternity leave for 14 weeks at normal pay
  • Unlimited PTO, with management approval
  • Opportunities for professional development and continued learning
  • Optional 401(k), FSA, and equity incentives
  • Mental health benefits through Tara Mind
  • Cost-effective GLP-1 solutions through Crux

Tools & skills mentioned

PythonAI agentsmodel evaluationsreinforcement learningpost-trainingreward modelsbenchmarksagent harnessestraining-data design

Summarized by NodJobs from Red Cell Partners's posting. Read the full posting on Red Cell Partners's site β†’

NodJobs is free for job seekers β€” we never charge to apply, and this role takes you straight to the company's own application.

Similar live jobs