← all hypothesesAI Hiring Vendor Annual Impact-Assessment Evidence Ledger for Heads of Talent
ranked [TRIANGULATED] filter 7.5/15 spread ±1.0 signals: 3 independent
What is this?
Continuous compliance-evidence ledger for Heads of Talent at 500-1500 person US (Colorado-deployer) and EU AI Act high-risk-system deployer tech firms running AI screening/sourcing vendors (HireVue, Eightfold, Paradox). Buyer pastes 5-15 quantified vendor assertions from the active contract and renewal collateral. AE's adversarial council locks each into a falsifiable form. Throughout the year, the talent head enters small-batch resolution events from their ATS: human-reviewer-vs-AI agreement samples (30-100 reqs, 2-4 week cycle), funnel pass-through rates, time-to-hire lift on cohorts, recruiter override frequency. AE grades each locked claim as evidence arrives and accumulates a vendor miss-pattern feeding the annual Colorado AI Act / EU AI Act impact-assessment filing the deployer is legally obligated to produce. Subscription is justified by ongoing regulatory-evidence accumulation per deployed vendor, not vendor-shopping cadence. Demographic parity is tracked as long-horizon signal; primary grading uses claims testable at small N within AE's weekly loop.
Why did we consider it?
AE's falsifiable-claim infrastructure is a near-exact structural fit for legally-mandated AI hiring impact assessments, giving a solo UK operator a defensible £100-300K ARR path on a non-discretionary regulatory clock.
What breaks?
- Enterprise Risk Mismatch: High-stakes legal compliance (highlighted by Mobley v. Workday) requires indemnified, SOC2-certified vendors, not solo weekend operators.
- Workflow Friction: Heads of Talent will not manually extract and input ATS data batches every 2-4 weeks; they require automated API integrations.
- Buyer Misalignment: Pitching a regulatory compliance ledger to Talent leaders instead of Legal/Risk officers targets the wrong budget and incentive structure.
What did we learn?
Still in evaluation (phase: ranked). No verdict yet.
Filter scores
Five axes, each scored 0-3. Three independent runs by different model perspectives. Median shown.
| Axis | What it measures |
|---|
| data moat | Does this product accumulate proprietary data that compounds? |
| 10x model test | Does a better model make this more valuable, or redundant? |
| fast feedback loops | Can outputs be graded against reality in <30 days? |
| solo founder feasible | Can a solo operator build and run this without a team? |
| AI providers cant eat it | Do hyperscalers have structural reasons NOT to build this? |
Composite median: 7.5 / 15. Graduation threshold: 9.0. IQR across runs: 1.0.
Evidence
Signal A — Primary source
The increasing adoption of AI systems in hiring has raised concerns about algorithmic bias and accountability, prompting regulatory ...
Signal B — Competitor with documented gap
Produces a point-in-time vendor assessment aligned to ISO 42001 or NIST AI RMF, but does not provide continuous evidence accumulation from ongoing ATS resolution events, small-batch claim grading, or longitudinal vendor miss-pattern tracking over the contract lifecycle.
Signal D — Demand proxy
{"found":true,"summary":"Multiple signals show HR/TA leaders actively seeking frameworks for continuous AI hiring vendor evaluation, evidence portability, and compliance with emerging mandates (NYC Local Law 144, Colorado AI Act, EU AI Act). Discussions explicitly call for moving beyond one-time audits to ongoing evidence accumulation.","sources":["https://digidai.github.io/2026/05/11/hr-ai-evidence-portability/","https://www.linkedin.com/pulse/your-ai-recruiting-agent-might-brilliant-also-illegal-glen-cathey-ydvae","https://www.linkedin.com/posts/mollybyrtus_if-youre-a-founder-or-hiring-leade…
Evaluation history
| When | Stage | Phase |
|---|
| 2026-05-14 00:49 | evidence_search | ranked |
| 2026-05-13 21:13 | evidence_search | ranked |
| 2026-05-13 20:55 | evidence_search | ranked |
| 2026-05-13 20:49 | evidence_search | ranked |
| 2026-05-13 20:43 | evidence_search | ranked |
| 2026-05-13 20:37 | evidence_search | ranked |
| 2026-05-13 20:25 | evidence_search | ranked |
| 2026-05-13 20:18 | evidence_search | ranked |
| 2026-05-13 20:12 | evidence_search | ranked |
| 2026-05-13 20:07 | evidence_search | ranked |
| 2026-05-13 20:00 | evidence_search | ranked |
| 2026-05-13 19:55 | evidence_search | ranked |
| 2026-05-13 19:36 | filter_score | scored |
| 2026-05-13 19:30 | filter_score | scored |
| 2026-05-13 19:24 | filter_score | scored |
| 2026-05-13 19:19 | evidence_search | argument |
| 2026-05-13 19:12 | audience_simulation | argument |
| 2026-05-13 19:06 | red_team_kill | argument |
| 2026-05-13 19:00 | steelman | argument |
| 2026-05-13 18:56 | genesis | argument |