ML Engineer, Retrieval & Grounded Generation
Red Cell Partners ยท Remote, USA
๐บ๐ธ Remote (US)$135,000 โ $170,000/yr9d ago
At a glance
- Where
- Remote โ open to applicants in the United States
- Pay
- $135,000 โ $170,000/yr โ as listed by Red Cell Partners
- Experience
- 5+ years
- Travel
- Travel up to 25% to customer sites, DEFCON AI HQ, and vendor facilities as required
- Posted
- November 9, 2026
- Last confirmed open
- 57m ago
- At Red Cell Partners
- 21 open remote roles โ mostly Software Development (7), DevOps & Sysadmin (3), Finance & Legal (3). Pay is listed on 15 of them ($135,000 โ $440,000/yr).
- How to apply
- Directly on Red Cell Partners's own site โ no NodJobs account needed.
About the role
Owns system quality for an AI-enabled decision-support product at DEFCON AI, covering the test plan, automated coverage, and independent evidence that delivery matches specified acceptance criteria. Suits a senior QA or test automation engineer with 5+ years of hands-on test ownership and a clear point of view on testing practice.
What you'll do
- Own and maintain the system test plan covering functional, integration, performance, and load testing as a formal deliverable
- Translate product-defined acceptance criteria into executable tests
- Review acceptance criteria with product before development begins and flag ambiguous or unverifiable requirements
- Hold engineering, platform, and partner teams accountable to acceptance criteria and define evidence required before a change is complete
- Work day to day with engineering while reporting independently on what testing shows
- Plan and coordinate customer user acceptance testing and track findings to resolution
- Build and maintain automated test suites and integrate them into CI/CD as release gates
- Establish, hold, and report against an automated coverage standard
- Build performance and load tests validating the system under expected user load
- Maintain regression coverage across releases
- Build and maintain labeled evaluation sets with limited subject-matter expert time
- Design and run sampled audits confirming automated decisions were correct
- Measure and report what the system misses as well as what it gets right
- Measure and report the trend of user overrides of system recommendations
- Document how each committed measure is computed, on what data, and what evidence accompanies a release
- Maintain the version inventory of builds, models, configurations, and thresholds
- Produce test reports, evaluation records, and rollback criteria for each release
- Work with platform engineering to ensure test environments closely match production
- Gate releases so none ship without the evidence its acceptance requires
- Produce a version inventory and release evidence trail reconstructable for each release
What you'll need
- 5+ years in software quality engineering, test automation, or software engineering with substantial dedicated test ownership
- A clear point of view on how testing should be done
- Strong coding ability in a test automation language and framework, such as Python with pytest, or JavaScript or TypeScript with Playwright, Cypress, or Selenium
- Ability to read and reason about application code under test
- Routine use of AI-assisted development with informed judgment about its output
- Demonstrated experience building automated test suites and integrating them into CI/CD as release gates
- Experience owning a test plan through review and acceptance
- Habit of testing against the requirement rather than the implementation
- Experience with performance and load testing, including what results do and do not demonstrate
- Working statistical literacy, including sampling design and measurement confidence
- Experience measuring what a system misses, not only what it gets right
- Willingness to report unwanted results and keep measurement independent of those evaluated
- Ability to gate work owned by people who do not report to you and maintain credibility with engineers
- Clear, audit-ready written documentation
- Willingness to hold a release and explain the reason to people who want it shipped
- US citizenship required
- Active US Secret clearance, or favorable investigation and CAC eligibility from the start
- Elevated security requirements apply to portions of the work
- Willingness to travel up to 25% to customer sites, DEFCON AI HQ, and vendor facilities
Nice to have
- Active Top Secret clearance
- Experience in government DevSecOps, RMF, or ATO environments and producing test evidence for formal accreditation or audit
- Contract and API testing, test data management, and building test infrastructure others can extend
- Using language models to generate and maintain test coverage and keep generated tests meaningful
- Performance tools such as JMeter, k6, Locust, or comparable
- Validating machine learning or model output, including groundedness and citation checking, and analyzing user disagreement with recommendations
- Experience in systems where incorrect results carry real cost and testing had to satisfy an outside reviewer
- Model cards, NIST AI RMF, or comparable responsible AI practice
- Section 508 and WCAG accessibility verification
Benefits listed by Red Cell Partners
- Fully remote, results-based work environment
- Competitive salary, bonus, and equity package
- 100% employer-paid comprehensive health insurance including medical, dental, and vision for employee and family
- Unlimited PTO with manager approval
- Flexible work environment where the employee manages their work day
- 14 weeks of fully paid parental leave
- Career track opportunity with potential for rapid advancement
- Paid maternity and paternity leave for 14 weeks at normal pay
- Opportunities for professional development and continued learning
- Optional 401K, FSA, and equity incentives
- Mental health benefits through Tara Mind
- Cost-effective GLP-1 solutions through Crux
Tools & skills mentioned
PythonpytestJavaScriptTypeScriptPlaywrightCypressSeleniumCI/CDJMeterk6Locust
Summarized by NodJobs from Red Cell Partners's posting. Read the full posting on Red Cell Partners's site โ
NodJobs is free for job seekers โ we never charge to apply, and this role takes you straight to the company's own application.
Similar live jobs
Member of Technical Staff, AI Researcher (New Stealth Startup)
Red Cell Partners
๐บ๐ธ Remote (US)AI & Machine Learning
27d ago
Senior Software Engineer, AI Platform
Vanta
๐บ๐ธ Remote (US)AI & Machine Learning
15d ago
Senior AI Data & Analytics Engineer II
Samsara
๐บ๐ธ Remote (US)AI & Machine Learning$137,445 โ $231,000/yr
1mo ago
Senior Software Engineer, AI Developer Experience
Vanta
๐บ๐ธ Remote (US)AI & Machine Learning
23d ago
Staff Machine Learning Engineer, Ads Forecasting & Scenarios
๐บ๐ธ Remote (US)AI & Machine Learning$230,000 โ $322,000/yr
20d ago
Senior Staff Applied Scientist, Science Platform
๐บ๐ธ Remote (US)AI & Machine Learning$232,500 โ $325,500/yr
16d ago