← all hypotheses

AI Hiring Vendor Annual Impact-Assessment Evidence Ledger for Heads of Talent

ranked [TRIANGULATED] filter 7.5/15 spread ±1.0 signals: 3 independent
What is this?
Continuous compliance-evidence ledger for Heads of Talent at 500-1500 person US (Colorado-deployer) and EU AI Act high-risk-system deployer tech firms running AI screening/sourcing vendors (HireVue, Eightfold, Paradox). Buyer pastes 5-15 quantified vendor assertions from the active contract and renewal collateral. AE's adversarial council locks each into a falsifiable form. Throughout the year, the talent head enters small-batch resolution events from their ATS: human-reviewer-vs-AI agreement samples (30-100 reqs, 2-4 week cycle), funnel pass-through rates, time-to-hire lift on cohorts, recruiter override frequency. AE grades each locked claim as evidence arrives and accumulates a vendor miss-pattern feeding the annual Colorado AI Act / EU AI Act impact-assessment filing the deployer is legally obligated to produce. Subscription is justified by ongoing regulatory-evidence accumulation per deployed vendor, not vendor-shopping cadence. Demographic parity is tracked as long-horizon signal; primary grading uses claims testable at small N within AE's weekly loop.
Why did we consider it?
AE's falsifiable-claim infrastructure is a near-exact structural fit for legally-mandated AI hiring impact assessments, giving a solo UK operator a defensible £100-300K ARR path on a non-discretionary regulatory clock.
What breaks?
  • Enterprise Risk Mismatch: High-stakes legal compliance (highlighted by Mobley v. Workday) requires indemnified, SOC2-certified vendors, not solo weekend operators.
  • Workflow Friction: Heads of Talent will not manually extract and input ATS data batches every 2-4 weeks; they require automated API integrations.
  • Buyer Misalignment: Pitching a regulatory compliance ledger to Talent leaders instead of Legal/Risk officers targets the wrong budget and incentive structure.
What did we learn?
Still in evaluation (phase: ranked). No verdict yet.

Filter scores

Five axes, each scored 0-3. Three independent runs by different model perspectives. Median shown.

AxisWhat it measures
data moatDoes this product accumulate proprietary data that compounds?
10x model testDoes a better model make this more valuable, or redundant?
fast feedback loopsCan outputs be graded against reality in <30 days?
solo founder feasibleCan a solo operator build and run this without a team?
AI providers cant eat itDo hyperscalers have structural reasons NOT to build this?
Composite median: 7.5 / 15. Graduation threshold: 9.0. IQR across runs: 1.0.

Evidence

Signal A — Primary source

The increasing adoption of AI systems in hiring has raised concerns about algorithmic bias and accountability, prompting regulatory ...

Signal B — Competitor with documented gap

Produces a point-in-time vendor assessment aligned to ISO 42001 or NIST AI RMF, but does not provide continuous evidence accumulation from ongoing ATS resolution events, small-batch claim grading, or longitudinal vendor miss-pattern tracking over the contract lifecycle.

Signal D — Demand proxy

{"found":true,"summary":"Multiple signals show HR/TA leaders actively seeking frameworks for continuous AI hiring vendor evaluation, evidence portability, and compliance with emerging mandates (NYC Local Law 144, Colorado AI Act, EU AI Act). Discussions explicitly call for moving beyond one-time audits to ongoing evidence accumulation.","sources":["https://digidai.github.io/2026/05/11/hr-ai-evidence-portability/","https://www.linkedin.com/pulse/your-ai-recruiting-agent-might-brilliant-also-illegal-glen-cathey-ydvae","https://www.linkedin.com/posts/mollybyrtus_if-youre-a-founder-or-hiring-leade…

Evaluation history

WhenStagePhase
2026-05-14 00:49evidence_searchranked
2026-05-13 21:13evidence_searchranked
2026-05-13 20:55evidence_searchranked
2026-05-13 20:49evidence_searchranked
2026-05-13 20:43evidence_searchranked
2026-05-13 20:37evidence_searchranked
2026-05-13 20:25evidence_searchranked
2026-05-13 20:18evidence_searchranked
2026-05-13 20:12evidence_searchranked
2026-05-13 20:07evidence_searchranked
2026-05-13 20:00evidence_searchranked
2026-05-13 19:55evidence_searchranked
2026-05-13 19:36filter_scorescored
2026-05-13 19:30filter_scorescored
2026-05-13 19:24filter_scorescored
2026-05-13 19:19evidence_searchargument
2026-05-13 19:12audience_simulationargument
2026-05-13 19:06red_team_killargument
2026-05-13 19:00steelmanargument
2026-05-13 18:56genesisargument