Skip to content

Quality

Task validation and expert review.

Reference solutions, verifier checks and calibrated review.

Quality assurance

Task checks and data review.

Tasks and environments

  • Reference solution

    Every task ships with a reference solution that passes its own verifier.

  • Verifier checks

    Graders are checked against correct solutions and invalid outputs.

  • Red-teamed

    Red-teamers try to game every task and grader before hand-off.

  • Open-weight runs

    Open-weight models are run on every task; pass rates are reported and failure traces reviewed.

Expert data

  • Gold items

    Gold items are mixed into every batch.

  • Second review

    A higher-tier engineer gives a second review.

  • Agreement checks

    Reviewers are checked for agreement.

  • Calibration rounds

    Calibration rounds are run on the client's guidelines.

Expert work is reviewed against the client's AI-use policy for each task.

RL tasks ship in the Harbor task format used by public coding benchmarks, or in the client's format. Client work is never published or reused.

Safeguards

Data privacy and contributor terms.

Data privacy

  • Every engineer signs an NDA.
  • Teams can work inside your platform and tools.
  • Teams for competing labs are kept separate.
  • Client work is never published or reused.
  • Engineers never bring material from former employers.

Contributor terms

  • NxtWave contracts, verifies and pays every engineer as vendor of record in India.
  • Pay is agreed before work starts and paid on time.

Tell us what you are training.