AI Bias Audit Procedure
For AI tools that fall into the "high risk" class under Annex III of the EU Artificial Intelligence Act (Regulation 2024/1689) — CV screening, recruitment, educational assessment, credit scoring — KolayDönüştür runs the bias audit procedure required by Articles 9 and 15.
1. Scope
Tools requiring a bias audit: AI CV Writer, AI Cover Letter, CV/Job Matcher, AI Quiz & Exam Generator. The list is kept up to date.
2. Frequency
Twice a year (March / September), after every major model change, and ad hoc following a serious complaint.
3. Methodology
A/B tests over synthetic test sets balanced for gender, age, ethnicity, education level and region. We measure demographic parity, equalized odds and calibration. Critical threshold: a gap above 5%.
4. Data set
500+ profiles built for the Turkish HR market (ages 18-65, 81 provinces, 16 sectors, Turkish and English). Open-source NEU CV Corpus plus synthetic augmentation.
5. Reporting
Results are published as a PDF in the report archive within 30 days: an anonymised summary plus the raw metric table.
6. Mitigation
If a threshold is exceeded: (a) revise the system prompt, (b) post-processing rerank, (c) change the model if needed, (d) add a further warning to the tool page.
7. Human oversight (AI Act Article 14)
CV and recruitment output is presented as a draft; no automated decision is produced. A human makes the final call about a candidate.
8. Complaint channel
Suspected bias: [email protected] — we reply within 14 business days and trigger an audit within 60 days.
9. Transparency
High-risk tool pages carry a "High-Risk AI — Annex III" badge showing the model, the provider and the date of the last audit.
10. Child protection (GDPR Art. 8)
Users under 18 cannot use CV or job-search AI tools without parental consent.
Latest Audit
Date: No baseline yet (the first audit is planned for September 2026, after the v1.0 release).
Next cycles: September 2026 and March 2027.
Baseline report (synthetic, preliminary): AI_BIAS_AUDIT_2026_05.md.
Report archive: New reports will be announced on this page as they are published.
Note for EU Users
To stay compliant with EU AI Act Article 6 and Annex III, high-risk AI tools (CV screening and recruitment, educational assessment, credit scoring) may be temporarily blocked for EU IP addresses. When blocked, the server returns HTTP 451 (Unavailable for Legal Reasons) and access requests are reviewed via [email protected].
References: AI Act 2024/1689 Articles 9, 13, 14, 15 · ISO/IEC 24028 · NIST AI RMF · Last updated: 21 May 2026