SAP · AI
ABOUT THE ROLE
Join an early-stage B2B SaaS team building an orchestration platform for enterprise SAP transformations. You will establish software quality practices and evaluation systems for AI-generated implementation artifacts, helping teams catch failures before they reach customer deliverables.
WHAT YOU'LL DO
- Build and maintain trusted end-to-end, integration, and regression test coverage across the platform.
- Create evaluation harnesses, golden datasets, and scoring criteria to assess AI-generated artifacts and detect regressions from model or prompt changes.
- Define and document release quality gates, and ensure critical failures block releases.
- Improve CI reliability by addressing flaky tests, slow pipelines, and unclear failures.
- Perform exploratory and release testing on customer-facing workflows that are not covered by automation.
- Triage defects through verified fixes and share recurring failure patterns with the team.
WHAT WE'RE LOOKING FOR
- At least 5 years of experience in QA, SDET, or test engineering for production software.
- Experience designing test frameworks and owning automated coverage, rather than only running an existing suite.
- Python and/or TypeScript automation experience, including a modern end-to-end framework such as Playwright or Cypress, plus API testing.
- Experience building and maintaining CI/CD pipelines.
- Comfort creating quality practices from scratch in an early-stage environment with changing priorities and undefined scope.
- Experience testing systems with non-deterministic outputs; product