FAQ
What is Expert Review for?
What is Expert Review for?
Expert Review is how enterprises bring their own domain specialists into Akhara workflows: audit and review of agent runs and hard cases, plus RLHF evaluations (preferences, rankings, safety flags, rationales) and domain writing (scenarios and success criteria for RL environments). See the introduction.
How do experts get access?
How do experts get access?
Your organization invites them. They create or open an account at talent.akhara.ai, then complete profile setup. See Create your account.
What kind of work will I get?
What kind of work will I get?
Work from projects your org assigned: RLHF evaluations and/or domain writing, inside the specialties on your profile.
How is work routed?
How is work routed?
Routing uses specialties, languages, credentials, availability, and project assignment. Keep your profile current.
Can I use ChatGPT to help write rationales or tasks?
Can I use ChatGPT to help write rationales or tasks?
No. External LLMs on task content are prohibited. See Policies.
What if a task is outside my specialty?
What if a task is outside my specialty?
Decline or release it. Do not improvise out-of-domain labels or scenarios.
When do I get paid?
When do I get paid?
When the engagement pays through the portal: typically bi-weekly after approval. Track status on Earnings. See Payments. Some enterprises pay outside the portal.
Can I do RLHF and writing at the same time?
Can I do RLHF and writing at the same time?
Yes, if your availability covers both deadlines and your org assigned both. Set preferences on your profile.
How is quality measured?
How is quality measured?
Agreement with gold/calibration items, lead review, completion rate, and rationale quality. See Performance in the portal.
I cannot hit a deadline
I cannot hit a deadline
Tell your project lead or support immediately. Early release beats silent abandonment.
I found a platform bug
I found a platform bug
Email [email protected] with steps, browser/OS, and screenshots.