NodJobsNodJobs

ML Engineer, Retrieval & Grounded Generation

Red Cell Partners ยท Remote, USA

๐Ÿ‡บ๐Ÿ‡ธ Remote (US)$135,000 โ€“ $170,000/yr9d ago

At a glance

Where
Remote โ€” open to applicants in the United States
Pay
$135,000 โ€“ $170,000/yr โ€” as listed by Red Cell Partners
Experience
5+ years
Travel
Travel up to 25% to customer sites, DEFCON AI HQ, and vendor facilities as required
Posted
November 9, 2026
Last confirmed open
57m ago
At Red Cell Partners
21 open remote roles โ€” mostly Software Development (7), DevOps & Sysadmin (3), Finance & Legal (3). Pay is listed on 15 of them ($135,000 โ€“ $440,000/yr).
How to apply
Directly on Red Cell Partners's own site โ€” no NodJobs account needed.

About the role

Owns system quality for an AI-enabled decision-support product at DEFCON AI, covering the test plan, automated coverage, and independent evidence that delivery matches specified acceptance criteria. Suits a senior QA or test automation engineer with 5+ years of hands-on test ownership and a clear point of view on testing practice.

What you'll do

  • Own and maintain the system test plan covering functional, integration, performance, and load testing as a formal deliverable
  • Translate product-defined acceptance criteria into executable tests
  • Review acceptance criteria with product before development begins and flag ambiguous or unverifiable requirements
  • Hold engineering, platform, and partner teams accountable to acceptance criteria and define evidence required before a change is complete
  • Work day to day with engineering while reporting independently on what testing shows
  • Plan and coordinate customer user acceptance testing and track findings to resolution
  • Build and maintain automated test suites and integrate them into CI/CD as release gates
  • Establish, hold, and report against an automated coverage standard
  • Build performance and load tests validating the system under expected user load
  • Maintain regression coverage across releases
  • Build and maintain labeled evaluation sets with limited subject-matter expert time
  • Design and run sampled audits confirming automated decisions were correct
  • Measure and report what the system misses as well as what it gets right
  • Measure and report the trend of user overrides of system recommendations
  • Document how each committed measure is computed, on what data, and what evidence accompanies a release
  • Maintain the version inventory of builds, models, configurations, and thresholds
  • Produce test reports, evaluation records, and rollback criteria for each release
  • Work with platform engineering to ensure test environments closely match production
  • Gate releases so none ship without the evidence its acceptance requires
  • Produce a version inventory and release evidence trail reconstructable for each release

What you'll need

  • 5+ years in software quality engineering, test automation, or software engineering with substantial dedicated test ownership
  • A clear point of view on how testing should be done
  • Strong coding ability in a test automation language and framework, such as Python with pytest, or JavaScript or TypeScript with Playwright, Cypress, or Selenium
  • Ability to read and reason about application code under test
  • Routine use of AI-assisted development with informed judgment about its output
  • Demonstrated experience building automated test suites and integrating them into CI/CD as release gates
  • Experience owning a test plan through review and acceptance
  • Habit of testing against the requirement rather than the implementation
  • Experience with performance and load testing, including what results do and do not demonstrate
  • Working statistical literacy, including sampling design and measurement confidence
  • Experience measuring what a system misses, not only what it gets right
  • Willingness to report unwanted results and keep measurement independent of those evaluated
  • Ability to gate work owned by people who do not report to you and maintain credibility with engineers
  • Clear, audit-ready written documentation
  • Willingness to hold a release and explain the reason to people who want it shipped
  • US citizenship required
  • Active US Secret clearance, or favorable investigation and CAC eligibility from the start
  • Elevated security requirements apply to portions of the work
  • Willingness to travel up to 25% to customer sites, DEFCON AI HQ, and vendor facilities

Nice to have

  • Active Top Secret clearance
  • Experience in government DevSecOps, RMF, or ATO environments and producing test evidence for formal accreditation or audit
  • Contract and API testing, test data management, and building test infrastructure others can extend
  • Using language models to generate and maintain test coverage and keep generated tests meaningful
  • Performance tools such as JMeter, k6, Locust, or comparable
  • Validating machine learning or model output, including groundedness and citation checking, and analyzing user disagreement with recommendations
  • Experience in systems where incorrect results carry real cost and testing had to satisfy an outside reviewer
  • Model cards, NIST AI RMF, or comparable responsible AI practice
  • Section 508 and WCAG accessibility verification

Benefits listed by Red Cell Partners

  • Fully remote, results-based work environment
  • Competitive salary, bonus, and equity package
  • 100% employer-paid comprehensive health insurance including medical, dental, and vision for employee and family
  • Unlimited PTO with manager approval
  • Flexible work environment where the employee manages their work day
  • 14 weeks of fully paid parental leave
  • Career track opportunity with potential for rapid advancement
  • Paid maternity and paternity leave for 14 weeks at normal pay
  • Opportunities for professional development and continued learning
  • Optional 401K, FSA, and equity incentives
  • Mental health benefits through Tara Mind
  • Cost-effective GLP-1 solutions through Crux

Tools & skills mentioned

PythonpytestJavaScriptTypeScriptPlaywrightCypressSeleniumCI/CDJMeterk6Locust

Summarized by NodJobs from Red Cell Partners's posting. Read the full posting on Red Cell Partners's site โ†’

NodJobs is free for job seekers โ€” we never charge to apply, and this role takes you straight to the company's own application.

Similar live jobs