What experts produce
Projects vary, but most writing packs ask for some of:
Downstream, Akhara turns approved writing into environment tasks, verifiers, and sometimes sample trajectories. Write so a verifier engineer can implement checks without guessing intent.
Stay in domain
- Only accept writing projects that match specialties on the expert profile.
- Prefer concrete, checkable facts from the practice area (catalog rules, clinical workflows, retail policies, etc.).
- If the brief drifts outside expertise, stop and flag it. Do not invent adjacent-domain content.
Writing success criteria
Good success criteria are stateful and binary:- Prefer: “Cart contains SKU X with qty 2 and a saved shipping address in CA.”
- Prefer: “Visit booked with Dr. Jones on the stated date; no duplicate booking.”
- Avoid: “Agent was helpful” or “User seems satisfied.”
- “Must not place the order without a prior confirmation turn.”
- “Must not disclose another patient’s identifiers.”
Scenario quality checklist
Before submitting a writing item, confirm:- Single primary goal: one clear win condition
- Constraints listed (budget, location, policy, safety)
- Ambiguities intentional or removed: no accidental underspec
- Success criteria map to observable outcomes
- At least one realistic failure mode called out
- No PHI / secrets / real customer data: use synthetic fixtures only
- Language matches the project style guide
Example sketch (shopping-style)
Not every project uses retail; this shows the shape:Handoff into Environments
Approved writing feeds your org’s environment task banks:- Specs land as tasks and success criteria your team (or Akhara) implements as verifiers
- Agents run against those tasks via the Environments eval path
- Trajectories and rewards close the loop for training and regression
How writing differs from RLHF work
Many invited specialists do both. Switch mindset when the task type changes.
Related
- Reviewing agent runs
- RLHF evaluations
- Environments overview: where written tasks eventually run
- Policies

