Member of Technical Staff, AI Researcher (New Stealth Startup)
Red Cell Partners Β· Remote (USA)
πΊπΈ Remote (US)Principal27d ago
At a glance
- Where
- Remote β open to applicants in the United States
- Pay
- Not disclosed by Red Cell Partners
- Level
- Principal
- Experience
- 5+ years
- Visa
- U.S. citizenship is required.
- Posted
- October 22, 2026
- Last confirmed open
- 57m ago
- At Red Cell Partners
- 21 open remote roles β mostly Software Development (7), DevOps & Sysadmin (3), Finance & Legal (3). Pay is listed on 15 of them ($135,000 β $440,000/yr).
- How to apply
- Directly on Red Cell Partners's own site β no NodJobs account needed.
About the role
This role designs evaluation frameworks, reward models, and feedback systems for frontier AI models and agents for a new stealth startup's platform, blending research with production-quality engineering. It suits a candidate with 5+ years of relevant technical experience and hands-on work in AI agents, evaluations, or reinforcement learning.
What you'll do
- Design and build evaluation frameworks, benchmarks, and methodologies for frontier LLMs, AI agents, multimodal models, and RL environments.
- Develop reward models, programmatic verifiers, graders, and other feedback systems that make model behavior measurable and improvable.
- Design and run controlled supervised fine-tuning and reinforcement learning experiments measuring dataset effects on capability, generalization, and alignment.
- Research and define what makes evaluations representative of real-world work and operational environments.
- Build systems for producing high-quality human data, including expert task design, annotation methods, data-quality signals, and data-attribution techniques.
- Translate research questions into lightweight, rigorous experiments that generate actionable findings.
- Prototype quickly, evaluate results, diagnose failure modes, and convert findings into improved benchmarks, datasets, or technical systems.
- Move promising methods from experimentation into scalable, production-quality implementations.
- Work across research, engineering, product, and operations to advance a shared technical roadmap.
- Contribute to the broader technical community through benchmarks, open-source tools, research, and technical writing.
What you'll need
- 5+ years of relevant experience in machine learning, AI, computer science, data science, software engineering, or a related technical field.
- Demonstrated ability to operate at the intersection of AI research and software engineering.
- Strong Python skills and experience building reliable, scalable software.
- Hands-on experience with AI agents, model evaluations, reinforcement learning, post-training, or related systems.
- Strong understanding of frontier AI methods, including benchmarks, evaluation techniques, agent harnesses, post-training approaches, and training-data design.
- Experience building or working with reward models, automated verifiers, graders, or other model-feedback systems.
- Experience designing evaluations or experiments measuring model capability, generalization, alignment, or agent performance.
- Ability to build research prototypes and develop them into maintainable, production-quality systems.
- Strong analytical, problem-solving, written communication, and technical documentation skills.
- Communicates complex technical concepts clearly to technical and nontechnical stakeholders.
- High agency, sound technical judgment, and a strong sense of ownership.
- Comfortable operating in a fast-moving environment where priorities and technical approaches may evolve.
- U.S. citizenship is required.
Nice to have
- An advanced degree in machine learning, AI, computer science, data science, or a related field.
- Equivalent research and engineering experience, including technical, open-source, or published output, is encouraged.
Benefits listed by Red Cell Partners
- Career track opportunity with potential for rapid advancement as the firm grows
- Employer-paid comprehensive health care including medical, dental, and vision
- Paid maternity and paternity leave for 14 weeks at normal pay
- Unlimited PTO, with management approval
- Opportunities for professional development and continued learning
- Optional 401(k), FSA, and equity incentives
- Mental health benefits through Tara Mind
- Cost-effective GLP-1 solutions through Crux
Tools & skills mentioned
PythonAI agentsmodel evaluationsreinforcement learningpost-trainingreward modelsbenchmarksagent harnessestraining-data design
Summarized by NodJobs from Red Cell Partners's posting. Read the full posting on Red Cell Partners's site β
NodJobs is free for job seekers β we never charge to apply, and this role takes you straight to the company's own application.
Similar live jobs
ML Engineer, Retrieval & Grounded Generation
Red Cell Partners
πΊπΈ Remote (US)AI & Machine Learning$135,000 β $170,000/yr
9d ago
Staff Machine Learning Engineer, Compliance Automation (Platform)
Coinbase
πΊπΈ Remote (US)AI & Machine Learning$218,025 β $256,500/yr
20d ago
Staff Machine Learning Engineer
Coinbase
πΊπΈ Remote (US)AI & Machine Learning$218,025 β $256,500/yr
1mo ago
Staff Machine Learning Engineer
πΊπΈ Remote (US)AI & Machine Learning$189,308 β $389,753/yr
23d ago
Staff AI Operations Lead
Honeycomb
πΊπΈ Remote (US)AI & Machine Learning$225,000 β $265,000/yr
1mo ago
Senior Software Engineer, Enterprise AI
Instacart
πΊπΈ Remote (US)AI & Machine Learning$166,000 β $175,000/yr
19d ago