Quality
Task validation and expert review.
Reference solutions, verifier checks and calibrated review.
Quality assurance
Task checks and data review.
Tasks and environments
Reference solution
Every task ships with a reference solution that passes its own verifier.
Verifier checks
Graders are checked against correct solutions and invalid outputs.
Red-teamed
Red-teamers try to game every task and grader before hand-off.
Open-weight runs
Open-weight models are run on every task; pass rates are reported and failure traces reviewed.
Expert data
Gold items
Gold items are mixed into every batch.
Second review
A higher-tier engineer gives a second review.
Agreement checks
Reviewers are checked for agreement.
Calibration rounds
Calibration rounds are run on the client's guidelines.
Expert work is reviewed against the client's AI-use policy for each task.
RL tasks ship in the Harbor task format used by public coding benchmarks, or in the client's format. Client work is never published or reused.
Safeguards
Data privacy and contributor terms.
Data privacy
- Every engineer signs an NDA.
- Teams can work inside your platform and tools.
- Teams for competing labs are kept separate.
- Client work is never published or reused.
- Engineers never bring material from former employers.
Contributor terms
- NxtWave contracts, verifies and pays every engineer as vendor of record in India.
- Pay is agreed before work starts and paid on time.