01What we plan to deliver
The planned service: you tell us the training or evaluation data you need. We find and vet the domain experts, run the work, check quality, and deliver the finished result.
Domain questions paired with answers. The service is designed so that a domain expert checks each answer before delivery, for planned use as training data.
Designed so that domain experts evaluate your model’s answers and return scores with an explanation of each error.
A planned deliverable: a test set built with domain experts that you keep and re-run on every model update, so each new version is checked the same way.
Who it’s for
Tell us the professional-domain data your models need. The planned service: we source and vet the experts, run the work, check quality, and hand back finished answer sets, evaluations or test sets.
02What the data includes
A single item can carry the prompt, the expert’s answer, the reviewer’s score, the explanation of each error, and the entry that goes into a reusable test set. Step through an illustrative record — the orbit turns with you.
Prompt
“I’m a salaried employee and I also did some freelance work this year. Do I need to do anything differently when I file?”
Sample model answer · unverified
Reads correctNo — your employer already handles your tax through your salary, so you can file the same way you always do. Freelance income is usually small enough that it doesn’t change anything.
Take the artifact shape with you: all five layers in one JSON file, marked "illustrative": true, with a note that it is not a real delivery.
03Evaluations
A model evaluation is designed to be delivered as structured rows: the task, the domain, the reviewer’s verdict, and a note explaining it. The rows below are illustrative — they show the format, not real results, real models or customer data.
| Task | Domain | Reviewer verdict | Notes | Label |
|---|---|---|---|---|
Answer a question that combines salary and freelance income Q&A | Indian tax | Incorrect | Concludes nothing changes without checking the facts that decide it. | Illustrative |
Explain a filing step to a first-time filer Explanation | Indian tax | Correct | Clear, complete for the facts given, and appropriately qualified. | Illustrative |
Respond when key facts are missing from the question Q&A | Indian tax | Partially correct | Gives a reasonable default but doesn’t ask for the facts it depends on. | Illustrative |
Compare two ways of reporting the same income Comparison | Indian tax | Incorrect | Recommends one option without stating the limits that apply to it. | Illustrative |
Summarise a tax notice in plain language Summarisation | Indian tax | Correct | Accurate summary; flags what the recipient should check next. | Illustrative |
Walk through the reasoning behind a calculation Reasoning | Indian tax | Partially correct | Method is sound, but one intermediate step is applied incorrectly. | Illustrative |
Answer a question that combines salary and freelance income
IllustrativeExplain a filing step to a first-time filer
IllustrativeRespond when key facts are missing from the question
IllustrativeCompare two ways of reporting the same income
IllustrativeSummarise a tax notice in plain language
IllustrativeWalk through the reasoning behind a calculation
IllustrativeEvery row is illustrative. No real metrics, models or customer data are shown.
Real evaluations are scoped with you.