Expert network · Paid AI evaluation tasks for engineers
Hashlist
Hashlist, a Helsinki engineering marketplace (Gigarator Oy, founded 2020), runs a Data Operations Platform where engineers and domain experts take briefs from AI labs and build tasks for them: an agent prompt, a sandboxed environment, reference solutions, deliberately wrong answers, grading criteria and verifier tests. Its task templates are embedded and automotive software (ARM Cortex-M boards under QEMU and Renode, Eclipse automotive tooling) and desktop apps. Signup is open, and each brief states its own pay before you start.
Is Hashlist legit?
Researched October 2026 · 5 sourcesMostly. Hashlist is a registered Finnish company (Gigarator Oy, since 2020) with carmaker clients, and its data platform's terms spell out how tasks are reviewed and paid. The platform is new, so its payment record is unproven. You are paid only when a reviewer accepts your task: rejected work is not paid and Hashlist keeps it, and each withdrawal is sent by hand, possibly after ID and tax checks. It pays Per accepted task; each brief sets its own rate (platform-stated).
Joined through its own application (it publishes no job postings)
Gigarator Oy, trading as Hashlist, is registered in Helsinki (business ID 3153482-2, on the Finnish trade register since 14 September 2020). Its engineering marketplace says 100,000+ engineers are registered and names carmakers such as Stellantis, Toyota, CARIAD and Continental as clients. Its startup profile lists about EUR 1 million of seed funding and 1 to 10 staff.
Each brief states a US dollar payment per accepted task. Accepted pay lands on your in-app balance; you request a withdrawal to PayPal or a bank account (IBAN) and an administrator sends it by hand, aiming for 10 business days. A USD 50 minimum and ID or tax checks may apply, and bank fees are yours.
No Trustpilot, Glassdoor or Reddit reviews of the data platform found (2026-10-14)
Worldwide for adults who can legally take paid independent work, except sanctioned countries; Hashlist may limit the platform to the countries where it offers it (DOP Terms 3).
What people praise
- Every task gets a written reason from Hashlist's reviewer, whether it is accepted or rejected, so you learn why.
- Signup is free and open with an email or a Google account; a new account goes straight into the app, with no application form first (tried 14 Oct 2026).
- The company behind it has run an engineering marketplace since 2020 for carmakers such as Stellantis and Toyota.
What people complain about
- Rejected tasks are not paid, and the reviewer may credit less than the brief stated, for example for partial work.
- Hashlist owns everything you build from the moment you create it, including the work in a task it rejects.
- Withdrawals are reviewed and sent by hand, may wait for ID, tax or payment-account checks, and can carry a USD 50 minimum.
- The data platform is new (its terms date from 25 September 2026) and we found no independent worker reviews of it yet.
Best for: Embedded, automotive and systems engineers who can build a complete AI evaluation task (environment, reference solution, verifier tests) and want to be paid per accepted task. Not for: Anyone who wants hourly pay for time spent, pay for work that is not accepted, or a platform with a long record of paying contributors.
Honest catches
- Pay here is platform-stated, not measured live from a job feed, so treat it as a benchmark rather than a guaranteed rate.
Sources for this review
- Hashlist DOP: Terms of Service (Gigarator Oy, last updated 25 September 2026; read 14 Oct 2026)
- Hashlist DOP: sign-up page (account created 14 Oct 2026)
- Finnish Trade Register (YTJ): Gigarator Oy, business ID 3153482-2 (read 14 Oct 2026)
- Hashlist: company site (100,000+ engineers registered; read 14 Oct 2026)
- The Hub: Hashlist startup profile (founded 2020, seed, clients; read 14 Oct 2026)
What Hashlist pays
Platform-stated · as of 2026-07-25Researched rate card, platform-stated, as of 2026-07-25
Hashlist publishes no rates outside its app (read 2026-10-14). Each brief states a US dollar amount per successful submission (or a custom rate) with an hour estimate, and pay is earned only when Hashlist accepts the task. All amounts are in US dollars (DOP Terms 8.5).
| Role | Kind of work | Researched pay |
|---|---|---|
| AI evaluation task builder (embedded and automotive software) | Agentic & RL Envs | Per accepted task, set per brief |
| Reference solutions and verifier tests for AI tasks | Coding | Per accepted task, set per brief |
Live Hashlist roles
Hashlist does not publish a public job feed.
You apply on Hashlist directly, then get matched to work from your account.
Join Hashlist (opens in new tab)Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.
Get new Agentic & RL Envs roles by email
Hashlist has no public job feed we can watch, so we'll email you new Agentic & RL Envs roles from the platforms that do, with real pay. Free, unsubscribe anytime.
Similar roles hiring now
Hashlist has no public job board. These live roles hire for the same kind of work on other verified platforms, refreshed daily.
AI Agent Evaluator (opens the job details)
micro1 · Agentic & RL Envs · Remote· 1w agoDetails
$25–$45/hr
Application Users - Linux Ubuntu 24.04 Expert - Professionals (opens the job details)
Mercor · Agentic & RL Envs · Remote· 1mo agoDetails
$60–$70/hr
FreeCAD / Mechanical CAD Expert, AI Computer-Use Trainer (opens the job details)
SuperAnnotate (SME) · Agentic & RL Envs · Remote· 1mo agoDetails
up to $30/hr
VBT Task Author (opens the job details)
Turing · Agentic & RL Envs · Remote· 1d agoDetails
Senior Software Engineer – Open Source & SWE-Bench Evaluation (opens the job details)
Anyone AI · Agentic & RL Envs · Remote· 1w agoDetails
$65/hrEveryday AI Agent Tester (opens the job details)
micro1 · Agentic & RL Envs · Remote· 1w agoDetails
$25–$45/hr
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.
The work Hashlist hires for
Each links to what the work involves, who hires for it, and what it pays across the market.
New to this? Start with the learning guides or compare pay across every platform.
Frequently asked questions
Is Hashlist legit?
Mostly. Hashlist is a registered Finnish company (Gigarator Oy, since 2020) with carmaker clients, and its data platform's terms spell out how tasks are reviewed and paid. The platform is new, so its payment record is unproven. You are paid only when a reviewer accepts your task: rejected work is not paid and Hashlist keeps it, and each withdrawal is sent by hand, possibly after ID and tax checks.
Is Hashlist a scam?
No. Hashlist is a real company. We found no reports of scams using Hashlist's name (searched 14 October 2026). The paid-task platform is dop.hashlist.com and account questions go to team@hashlist.com. Nothing in its terms charges you to join or take a brief, so never pay anyone for access.
Does Hashlist pay?
Yes. Hashlist is an established engineering marketplace (Gigarator Oy, Helsinki, with offices in San Francisco and Detroit) whose supplier side serves carmakers such as Stellantis and Toyota Motor Europe. Its data platform for AI tasks is new and has no independent worker reviews yet, so its payment record is unproven. Payouts: Withdrawal on request to PayPal or a bank account (IBAN), reviewed and sent by hand within about 10 business days; a USD 50 minimum may apply, and fees and currency conversion are yours (DOP Terms 9).
How much does Hashlist pay?
Per accepted task; each brief sets its own rate. Hashlist publishes no rates outside its app (read 2026-10-14). Each brief states a US dollar amount per successful submission (or a custom rate) with an hour estimate, and pay is earned only when Hashlist accepts the task. All amounts are in US dollars (DOP Terms 8.5).
Is Hashlist worth it?
Hashlist pays Per accepted task; each brief sets its own rate (platform-stated). It rewards credentialed experts who clear its assessment far more than open generalist work. Worker sentiment: No Trustpilot, Glassdoor or Reddit reviews of the data platform found (2026-10-14).
How does Hashlist pay out?
Withdrawal on request to PayPal or a bank account (IBAN), reviewed and sent by hand within about 10 business days; a USD 50 minimum may apply, and fees and currency conversion are yours (DOP Terms 9).
Where can you work for Hashlist?
Worldwide for adults who can legally take paid independent work, except sanctioned countries; Hashlist may limit the platform to the countries where it offers it (DOP Terms 3).
Compare Hashlist with
Premium, invite-only RLHF and expert data for frontier labs.
$18–$140/hr general; medical & finance experts $250–$500/hrThird-party reports
NVIDIA Inception expert-data startup pairing PhD, MD and JD experts with AI labs.
$35-250/hrPlatform-stated
Short of experts at Hashlist? See how we source them from the market's data.