Protect Your Business: Risk Guardrails
AI risk management is not a technical discipline, it is a governance discipline. Whether you manage a team of five or an organization of five thousand, the AI tools entering your workflows carry real risks: bad outputs, biased decisions, data leaks, regulatory fines, and reputational damage. This lesson gives you the frameworks professionals actually use to identify, assess, and manage those risks. No coding required. No data science background needed. Just structured thinking applied to the AI tools you are already using or about to adopt.
7 Things You Need to Know About AI Risk Frameworks
- An AI risk framework is a structured method for identifying what could go wrong with AI use and deciding what to do about it, the same logic as any business risk management process.
- The two most referenced frameworks globally are the NIST AI Risk Management Framework (AI RMF) and the EU AI Act's risk classification system. You do not need to memorize them, you need to know how to apply their logic.
- Risk in AI has four main categories: performance risk (the AI is wrong), privacy risk (the AI exposes data), compliance risk (the AI violates a law or policy), and reputational risk (the AI embarrasses you or your organization).
- High-risk AI uses, like hiring decisions, credit scoring, or medical triage, require more oversight and documentation than low-risk uses like drafting marketing copy or summarizing meeting notes.
- Most professionals are already managing AI risk informally. Frameworks just make that process visible, repeatable, and defensible to auditors, regulators, or leadership.
- AI risk is not static. A tool that is safe today may become risky when the vendor updates the model, when your use case changes, or when new regulations take effect.
- Your organization does not need a dedicated AI team to implement basic risk management. A single informed manager using a structured checklist can meaningfully reduce exposure.
What Is an AI Risk Management Framework?
A risk management framework is a repeatable process for asking: what could go wrong, how likely is it, how bad would it be, and what are we going to do about it? Applied to AI, that means examining the tools you use. ChatGPT, Microsoft Copilot, Workday's AI features, HireVue, Salesforce Einstein, through a structured lens before and during deployment. The goal is not to prevent all AI use. The goal is to make deliberate choices about which risks are acceptable and which require controls.
Historical Record
NIST
The NIST AI RMF was published in January 2023, organizing AI risk management into four functions: Govern, Map, Measure, and Manage.
NIST's AI Risk Management Framework has become a foundational standard for organizations implementing AI governance across industries.
- Govern: Who is responsible for AI decisions in your organization? Are there written policies?
- Map: Which AI tools are active in your team or department right now, including free tools employees brought in themselves?
- Measure: What evidence do you have that those tools perform accurately, fairly, and securely in your specific context?
- Manage: What controls are in place, human review, usage restrictions, vendor contracts, data handling rules?
- Revisit: When did you last review your AI tools for new risks or changed capabilities?
Start With a Shadow AI Audit
The NIST AI RMF at a Glance
| NIST Function | Plain-Language Meaning | Typical Owner | Example Action |
|---|---|---|---|
| Govern | Set the rules and accountability structures for AI use | Senior leadership, Legal, HR | Publish an AI Acceptable Use Policy |
| Map | Identify AI uses and their associated risks | Department managers, Operations | Audit which AI tools your team uses and for what tasks |
| Measure | Evaluate how well risks are understood and how significant they are | Risk, Compliance, or IT teams | Test an AI hiring tool for demographic bias using sample data |
| Manage | Prioritize and treat risks through controls or decisions | Department managers, Procurement | Require human review of all AI-generated candidate rankings |
The EU AI Act Risk Tiers: A Practical Classification Tool
The EU AI Act, which entered into force in August 2024, classifies AI systems by the level of risk they pose to people. Even if your organization operates outside the EU, this classification logic is the most widely adopted framework for deciding how much scrutiny an AI use case deserves. The four tiers are: Unacceptable Risk (banned outright), High Risk (heavily regulated), Limited Risk (transparency obligations), and Minimal Risk (no specific obligations). The tier determines how much documentation, testing, and human oversight is legally required, and practically advisable.
For a non-technical professional, the EU AI Act tiers function as a prioritization tool. If you are using AI to draft social media posts, you are in the Minimal Risk tier, proceed with standard editorial judgment. If you are using AI to screen job applications, rank sales candidates, or assess employee performance, you are in the High Risk tier, and you need documented processes, bias testing, and human oversight before that output drives a real decision. The tier tells you how much process to build around the tool.
- Unacceptable Risk. Banned: AI that manipulates people subliminally, exploits vulnerabilities, enables mass social scoring by governments, or performs real-time biometric surveillance in public spaces.
- High Risk. Heavily Regulated: AI used in hiring and HR, credit and insurance decisions, educational assessment, critical infrastructure, law enforcement, and medical devices.
- Limited Risk. Transparency Required: Chatbots must disclose they are AI. Deepfakes must be labeled. Users must know when they are interacting with a machine.
- Minimal Risk. No Specific Obligations: Spam filters, AI writing assistants, recommendation engines for entertainment, image editing tools.
| Risk Tier | Examples Relevant to Non-Technical Professionals | Required Controls | Applies to Your Work If... |
|---|---|---|---|
| Unacceptable (Banned) | Real-time facial recognition of employees without consent; AI that manipulates customers psychologically | Not permitted, full stop | You are considering a tool that profiles people without their knowledge |
| High Risk | AI resume screeners (HireVue, Workday), AI performance scoring, AI credit decisions, AI in student grading | Human oversight, bias audits, documentation, registration in EU database | AI output directly affects someone's job, money, education, or safety |
| Limited Risk | AI chatbots on your website, AI customer service agents, AI-generated marketing videos | Disclose AI involvement to users; label synthetic content | Your customers or employees interact with AI without always knowing it |
| Minimal Risk | ChatGPT for drafting emails, Canva AI for design, Grammarly AI for editing, Copilot for summarizing reports | None mandated, but internal good practices still apply | AI assists your work but a human makes all final decisions |
The EU AI Act Affects You Even Outside Europe
Applying a Risk Framework: A Worked Example
Prompt
I am an HR manager at a 200-person professional services firm. We are considering using an AI-powered resume screening tool called Findem to filter job applications before a human recruiter reviews them. Help me draft a basic risk assessment using the EU AI Act risk tiers and the NIST AI RMF framework. I need to identify the key risks, classify the risk level, and suggest three practical controls we should put in place before going live.
AI Response
**AI Risk Assessment: Findem Resume Screening Tool** **EU AI Act Classification: HIGH RISK** AI-assisted hiring tools that influence employment decisions fall explicitly under Annex III of the EU AI Act as high-risk systems. This means you are legally required (within EU scope) to conduct conformity assessments, maintain technical documentation, ensure human oversight, and register the system before deployment. **Key Risks Identified** 1. **Bias Risk**: The model may have been trained on historical hiring data that reflects past discrimination by gender, age, ethnicity, or educational institution. If Findem's training data over-indexes on a particular candidate profile, qualified applicants from underrepresented groups may be filtered out before a human ever sees their application. 2. **Accuracy Risk**: Resume screening models can misread formatting, abbreviations, or non-traditional career paths. A highly qualified candidate who changed industries or has employment gaps may score poorly for reasons unrelated to job performance. 3. **Transparency Risk**: Candidates have no visibility into how they are being scored. If a rejected candidate asks why they were not progressed, you may not be able to explain the AI's reasoning. 4. **Vendor Dependency Risk**: You do not control the underlying model. If Findem updates its algorithm, your screening criteria may shift without your knowledge. **Three Practical Controls Before Go-Live** 1. **Human Review Requirement**: No candidate should be permanently rejected based on AI scoring alone. Require a recruiter to review all candidates flagged for rejection before a decision is finalized. 2. **Bias Audit**: Before full deployment, run a sample of 50-100 past successful hires through the tool and check whether it would have screened them in. Segment results by gender and ethnicity if your data permits. 3. **Candidate Disclosure**: Add a line to your job postings stating: 'Applications are initially reviewed with the assistance of AI screening technology. All final decisions are made by human recruiters.'
The Four Categories of AI Risk Every Professional Must Know
Frameworks like NIST and the EU AI Act give you structure, but every professional should be able to recognize AI risk in plain terms without consulting a policy document. There are four categories that cover the vast majority of real-world AI incidents affecting non-technical professionals. Understanding them lets you spot risk during a vendor demo, a team meeting, or a procurement decision, not just during a formal compliance review.
These four categories are not mutually exclusive. A single AI tool can carry multiple risk types simultaneously. A customer-facing chatbot, for example, might pose performance risk (it gives wrong answers), privacy risk (it stores customer conversations), compliance risk (it violates GDPR if it collects personal data without consent), and reputational risk (a screenshot of a bad response goes viral). Identifying which categories apply to a given tool is the first step in deciding what controls to build.
| Risk Category | Definition | Real Example | Early Warning Sign |
|---|---|---|---|
| Performance Risk | The AI produces inaccurate, incomplete, or irrelevant outputs that lead to bad decisions | Copilot summarizes a 40-page contract and omits a key liability clause; a lawyer relies on the summary and misses it | Outputs that sound authoritative but cannot be traced to a verifiable source |
| Privacy Risk | The AI exposes, stores, or transmits personal or confidential data inappropriately | An employee pastes client financial data into ChatGPT to generate a report; that data is used to train the model under older terms of service | Staff using free-tier AI tools with no enterprise data agreements |
| Compliance Risk | AI use violates a law, regulation, industry standard, or internal policy | An AI tool ranks job candidates in a way that produces disparate impact on a protected class, triggering EEOC scrutiny | AI making or heavily influencing decisions in regulated domains: hiring, lending, healthcare, education |
| Reputational Risk | AI outputs damage trust with customers, employees, regulators, or the public | A marketing team publishes AI-generated copy that contains a factual error about a competitor; the competitor shares it publicly | AI-generated content published without human review |
Free Tier AI Tools and Your Confidential Data
Part 1 Practice Task: Map the AI Risk in Your Current Workflow
Goal: Create a one-page AI risk map for your current role that identifies the tools you use, classifies their risk level using EU AI Act tiers, and flags the highest-priority risk for each tool.
1. Open a blank document or spreadsheet. Create five columns: Tool Name, What I Use It For, EU AI Act Tier (Minimal / Limited / High / Unacceptable), Primary Risk Category (Performance / Privacy / Compliance / Reputational), and Immediate Action Needed. 2. List every AI-assisted tool you have used in the past 30 days. Include obvious tools (ChatGPT, Copilot, Grammarly) and less obvious ones (LinkedIn's AI features, Zoom's meeting summary, Salesforce Einstein, any AI in your HR or project management software). 3. For each tool, write one sentence describing exactly how you use it, for example: 'I use ChatGPT to draft first versions of client proposals before I edit and send them.' 4. Using the EU AI Act tier descriptions from the reference table above, assign each tool a risk tier. When in doubt between two tiers, choose the higher one. 5. For each tool, identify which of the four risk categories is most relevant to your specific use case. Use the Four Core AI Risk Categories table as your reference. 6. In the final column, write one concrete action you could take this week to reduce the primary risk, for example: 'Verify all statistics in AI-drafted reports before sending' or 'Switch to ChatGPT Team plan to enable data opt-out.'
Part 1 Cheat Sheet
- AI risk framework = structured process for asking what could go wrong, how bad, and what to do about it.
- NIST AI RMF has four functions: Govern, Map, Measure, Manage, a cycle, not a one-time checklist.
- EU AI Act has four tiers: Unacceptable (banned), High Risk (heavily regulated), Limited Risk (disclose AI use), Minimal Risk (no mandated controls).
- Hiring tools, performance scoring, credit decisions, and student assessment = HIGH RISK under EU AI Act.
- Writing assistants, design tools, meeting summarizers = MINIMAL RISK under EU AI Act.
- Four universal risk categories: Performance, Privacy, Compliance, Reputational.
- Free-tier AI tools may not have enterprise data protections, verify before using with confidential information.
- EU AI Act scope is global: if you touch EU customers or employees, it may apply to you.
- Shadow AI (tools employees bring in without approval) is a real and common risk, audit before you manage.
- A single AI tool can carry multiple risk types at the same time.
Key Takeaways from Part 1
- AI risk management is a governance skill, not a technical one. Any informed professional can apply these frameworks.
- The NIST AI RMF and EU AI Act provide the two most widely used structures for classifying and responding to AI risk.
- Your risk management priority should be proportional to the risk tier: high-stakes decisions using AI demand the most scrutiny.
- The four risk categories, performance, privacy, compliance, reputational, give you a fast mental model for assessing any new AI tool.
- Knowing what AI is actually running in your team right now is the prerequisite for managing any of it responsibly.
Part 1 covered the foundational vocabulary and the major frameworks. NIST AI RMF, ISO 42001, and the EU AI Act's risk tiers. Now the work gets practical. Knowing a framework exists is not the same as knowing how to apply it. This section walks through the operational mechanics: how to run a risk assessment meeting, how to classify your AI tools using a decision table, and how to document risk decisions in a way that satisfies auditors, legal teams, and senior leadership.
- Risk identification is a team sport, legal, HR, IT, and operations must all be in the room, not just the person who bought the AI tool.
- The NIST AI RMF breaks risk management into four functions: GOVERN, MAP, MEASURE, MANAGE, each with specific outputs your organization should produce.
- Likelihood and impact are the two axes of every risk matrix, a high-likelihood, low-impact risk is treated differently than a low-likelihood, catastrophic-impact risk.
- Residual risk is what remains after controls are applied, frameworks require you to document it, not eliminate it entirely.
- Third-party AI tools (ChatGPT, Copilot, Gemini) still create organizational risk, vendor risk management applies to AI just as it does to any SaaS product.
- Documentation is not bureaucracy, it is your legal defense, your audit trail, and your institutional memory when staff turn over.
- Risk assessments are not one-time events, they require a review trigger tied to model updates, regulatory changes, or significant incidents.
Running a Risk Assessment: The GOVERN and MAP Functions
NIST's GOVERN function is about building the infrastructure before you assess anything. It means assigning ownership, who is accountable for each AI system in use? It means setting policy, what data can AI tools access? It means training staff on what responsible use looks like in your specific context. Without GOVERN outputs in place, MAP assessments produce findings that nobody acts on. Think of GOVERN as the organizational wiring that makes the rest of the framework run. Most teams skip it. That is why most AI risk programs stall after the first risk register is created.
The MAP function is where you inventory and classify AI use cases. For non-technical teams, this means answering four questions about every AI tool in use: What decisions does it influence? Who is affected by those decisions? What data does it process? And what happens if it produces a wrong output? MAP does not require technical expertise, it requires structured conversations with the people closest to each workflow. A hiring manager knows more about AI screening risk than a software engineer does. A loan officer knows more about credit-decision AI than a data scientist does. MAP is your chance to surface that knowledge.
- GOVERN outputs: AI use policy, ownership registry, training records, escalation procedures
- MAP outputs: AI inventory spreadsheet, use-case descriptions, stakeholder impact analyzis, data flow summary
- Key MAP question for every tool: 'If this AI gives a wrong answer, who gets hurt and how badly?'
- Include shadow AI, tools employees are using without formal approval (personal ChatGPT accounts, browser AI extensions)
- Assign a risk owner, not just a tool owner, these are different people with different accountabilities
- Document the business purpose of each AI use case, vague entries like 'productivity' are not auditable
Start Your AI Inventory in 30 Minutes
| NIST AI RMF Function | What It Produces | Who Leads It | How Often |
|---|---|---|---|
| GOVERN | AI use policy, ownership registry, training program | Legal / Compliance / HR | Annually + when policy changes |
| MAP | AI inventory, use-case descriptions, stakeholder impact analyzis | Business unit leads + Risk team | Quarterly or when new tools are added |
| MEASURE | Risk scores, performance metrics, bias audit results | Risk team + IT / vendor | Ongoing; formal review semi-annually |
| MANAGE | Mitigation plans, incident response records, residual risk sign-offs | Risk owner per AI system | Continuous; escalation as needed |
Scoring Risk: The MEASURE Function in Plain Language
MEASURE is where risk becomes a number, or at least a color. Most organizations use a 5x5 risk matrix: likelihood on one axis (rare to almost certain), impact on the other (negligible to catastrophic). You score each identified risk, plot it on the matrix, and get a heat map that tells you where to focus. For AI systems, common impact dimensions include financial harm, reputational damage, legal liability, operational disruption, and harm to individuals. A chatbot that occasionally gives wrong product information scores differently than an AI screening tool that rejects qualified job applicants.
Beyond the basic matrix, MEASURE includes performance monitoring, tracking whether the AI tool is actually doing what it claims to do. This is not just an IT task. A marketing manager using AI to score leads should periodically check whether high-scored leads are actually converting. An HR team using AI to screen resumes should audit whether screened-out candidates differ systematically by gender or ethnicity. These are business-level checks, not technical ones. You do not need to inspect the model's code. You need to inspect its outputs against real-world results.
- List all AI-influenced decisions in your scope, be specific ('AI ranks job applicants by resume match score' not 'AI helps with hiring').
- For each decision, identify the population affected, applicants, customers, employees, patients, students.
- Score likelihood of a harmful output on a 1-5 scale using historical data or expert judgment.
- Score impact of a harmful output on a 1-5 scale across financial, legal, reputational, and individual harm dimensions.
- Multiply scores to get a raw risk rating, anything above 12 on a 25-point scale typically triggers a mitigation requirement.
- Document the rationale for each score, 'we gave this a 3 for impact because the decision is reversible within 48 hours' is an auditable statement.
- Assign a review date, risk scores change when tools are updated, regulations shift, or incidents occur.
| AI Use Case | Likelihood (1-5) | Impact (1-5) | Raw Score | Risk Tier | Suggested Control |
|---|---|---|---|---|---|
| AI drafts external marketing emails | 2 | 2 | 4 | Low | Human review before send; brand guidelines in prompt |
| AI summarizes internal meeting notes | 1 | 1 | 1 | Minimal | No sensitive data in recordings; staff awareness training |
| AI scores inbound sales leads | 3 | 3 | 9 | Medium | Quarterly audit of conversion rates by lead score; bias check |
| AI screens job applications | 3 | 4 | 12 | High | Human review of all rejections; regular demographic disparity audit |
| AI recommends employee performance ratings | 2 | 5 | 10 | High | Manager override required; legal review of outputs; annual bias audit |
| AI processes customer financial data for credit decisions | 4 | 5 | 20 | Critical | Regulatory compliance review; explainability requirement; external audit |
What 'Residual Risk' Means for Your Sign-Off
Prompt
I manage risk for a mid-sized HR consulting firm. We recently started using an AI tool that screens incoming job applications for our clients and ranks candidates by fit score. I need to brief our executive team on the risk profile of this tool. The audience is non-technical, they are senior partners and a general counsel. Write a one-page risk summary that covers: what the tool does, what the main risks are, what controls we have in place, and what residual risk leadership needs to accept. Keep it plain and direct.
AI Response
AI Applicant Screening Tool. Risk Summary for Leadership What the tool does: The AI reviews submitted resumes and cover letters, scores each candidate against the job description, and produces a ranked shortlist. Our recruiters use this shortlist to decide who advances to a phone screen. The tool does not make final hiring decisions, that remains with our team and the client. Main risks: • Bias in outputs: If the AI was trained on historical hiring data, it may systematically underrank candidates from certain demographic groups. This creates legal exposure under equal employment opportunity law. • Incorrect rejections: Qualified candidates may be screened out due to formatting issues, unconventional career paths, or gaps the AI weights negatively. • Client liability: If a client faces a discrimination claim tied to our process, our firm may share legal exposure. • Transparency: We cannot fully explain why the AI assigned a specific score, this limits our ability to defend decisions if challenged. Controls currently in place: • All AI rejections are reviewed by a senior recruiter before candidates are notified. • We conduct a quarterly audit comparing pass rates across gender and ethnicity where data is available. • Our client contracts include a disclosure that AI-assisted screening is used. Residual risk requiring leadership acceptance: Despite these controls, some bias risk remains, our audit sample sizes are small, and recruiter review does not catch all errors. General Counsel should assess whether our current disclosures satisfy applicable state and federal requirements. Leadership is asked to formally accept this residual risk or authorize additional controls.
The MANAGE Function: Controls, Incidents, and Vendor Risk
MANAGE is where risk assessment becomes risk action. It covers three areas: implementing controls before harm occurs, responding to incidents when harm does occur, and managing the risk introduced by third-party AI vendors. Controls are not always technical. They include human review gates, usage restrictions, mandatory training, contractual clauses with vendors, and audit schedules. The right control depends on the risk tier, a low-risk AI tool drafting internal summaries does not need the same controls as an AI system influencing compensation decisions.
Vendor risk is underestimated by most non-technical teams. When your organization uses ChatGPT Plus, Microsoft Copilot, or Google Gemini, you are relying on a third party's model, infrastructure, and data practices. You do not control model updates, and a model update can change output behavior without notice. You may not know exactly what data is used to train or fine-tune the model. Your AI risk policy needs to address this explicitly: what data can employees submit to external AI tools? What are the contractual data protection obligations of each vendor? These are governance questions, not IT questions.
| Control Type | Example | Risk Tier It Addresses | Who Implements It |
|---|---|---|---|
| Human-in-the-loop review | Manager must approve all AI-generated performance feedback before it reaches employees | High / Critical | Business unit manager |
| Usage restriction | AI tools may not process personally identifiable information without DPA in place | Medium and above | Legal / Compliance |
| Audit schedule | Quarterly review of AI output accuracy and demographic disparity in screening tools | Medium and above | Risk team + HR |
| Vendor assessment | Annual review of vendor data handling, model update notifications, and security certifications | All tiers | Procurement + Legal |
| Incident log | Documented record of AI errors, complaints, and corrective actions taken | All tiers | Risk owner |
| Employee training | Staff complete AI acceptable use training before accessing enterprise AI tools | All tiers | HR + L&D |
| Prompt governance | Approved prompt templates for high-risk use cases; prohibited prompt list for sensitive topics | High / Critical | Risk team + business leads |
Model Updates Are a Risk Event
Goal: Create a working risk register for the AI tools your team currently uses, formatted for review by a manager or compliance officer.
1. Open a blank document or spreadsheet and create eight columns: Tool Name, Use Case Description, Data Processed, Decision Influenced, Population Affected, Likelihood Score (1-5), Impact Score (1-5), Current Controls. 2. List every AI tool your team uses, include commercial tools like ChatGPT, Copilot, Grammarly AI, and Canva AI, as well as any built-in AI features in your existing software (Salesforce Einstein, HubSpot AI, LinkedIn Recruiter AI). 3. For each tool, write a one-sentence use case description that names the specific task, not just the category, 'drafts first versions of client proposal introductions' rather than 'writing assistance.' 4. Score likelihood (1=rare, 5=almost certain) and impact (1=negligible, 5=catastrophic) for the primary risk associated with each tool. Write a one-line rationale for each score in a notes cell. 5. In the Current Controls column, list what your team actually does today to catch errors or limit harm, even informal practices like 'manager reads before sending' count. 6. Highlight any row where Likelihood × Impact exceeds 9 in red, these are your priority items requiring a formal mitigation plan.
AI Risk Management Cheat Sheet
- GOVERN: Build the policy and ownership structure before assessing anything, without it, findings have no home.
- MAP: Inventory every AI tool in use, including shadow AI; ask 'who gets hurt if this is wrong?' for each one.
- MEASURE: Use a 5x5 likelihood-impact matrix; score each AI use case; document your rationale.
- MANAGE: Apply controls proportional to risk tier; log incidents; assess vendor risk annually.
- Residual risk must be formally accepted by a named person, it is a governance decision, not a technical one.
- Model updates from vendors are risk events, monitor change logs and re-test after major releases.
- Human-in-the-loop controls are the most common mitigation for high-risk AI use cases in non-technical organizations.
- Bias audits are a business responsibility, not an IT one, the people closest to the workflow must own them.
- Documentation is your legal defense, vague entries ('AI helps productivity') are not auditable.
- Review triggers: revisit risk assessments when tools are updated, regulations change, or an incident occurs.
Key Takeaways from Part 2
- The four NIST AI RMF functions. GOVERN, MAP, MEASURE, MANAGE, each produce specific, auditable outputs that non-technical teams can own.
- Risk scoring is a structured conversation, not a technical calculation, business judgment drives the likelihood and impact scores that matter most.
- Vendor risk applies to off-the-shelf AI tools like ChatGPT and Copilot, your acceptable use policy must define what data employees can submit.
- Controls do not need to be technical, human review gates, audit schedules, and training programs are valid and often the right fit for non-technical environments.
- Every risk register entry needs a named owner, a score with a rationale, and a review date, anything less is decoration, not governance.
Putting an AI risk framework into practice means translating policy language into daily decisions. This section gives you the reference tools to do exactly that, a cheat sheet you can pull up before a vendor meeting, a prompt you can run this afternoon, and a task that produces a real deliverable by end of week.
- Risk frameworks are living documents, they require scheduled reviews, not one-time setup.
- The NIST AI RMF uses four core functions: GOVERN, MAP, MEASURE, MANAGE.
- The EU AI Act classifies AI systems into four risk tiers: unacceptable, high, limited, and minimal.
- Human oversight is a non-negotiable requirement in every major framework for high-risk AI use.
- Vendor contracts should explicitly reference which risk controls the vendor is responsible for.
- Incident response plans for AI failures are distinct from general IT incident plans, they must address model drift and bias events.
- Documentation is your audit trail, if a decision isn't recorded, regulators and courts treat it as if it didn't happen.
Operationalizing Your Risk Register
A risk register is the backbone of any AI governance program. It is a living log of every AI system your organization uses, what decisions it touches, who owns it, and what controls are in place. Most teams start with a spreadsheet. That is fine. The discipline matters more than the tool. Each row represents one AI use case, a hiring screening tool, a customer chatbot, an automated invoice processor. Columns capture risk level, data types involved, the human review process, and the last date the entry was audited.
Ownership is the most common failure point. Risk registers decay when nobody is accountable for keeping them current. Assign a named individual, not a department, to each AI system in the register. That person is responsible for flagging changes: a new model version, a new data source, a new use case the tool wasn't originally approved for. Quarterly reviews should be calendared as recurring meetings, not aspirational intentions.
- Include every AI tool, even free consumer tools employees use for work tasks.
- Flag any system that influences hiring, lending, healthcare, legal, or law enforcement decisions as high-risk by default.
- Record the AI vendor's name, model version (if known), and data processing location.
- Note whether the system uses your organization's proprietary data for training.
- Link each entry to the relevant policy, contract clause, or compliance requirement.
- Set a 90-day maximum between reviews for high-risk systems; 180 days for low-risk.
Start Small, Scale Fast
| AI Use Case | Risk Tier | Data Sensitivity | Owner | Human Review Required | Last Audited |
|---|---|---|---|---|---|
| Resume screening tool | High | Personal / Protected | HR Director | Yes, before any rejection | Quarterly |
| Customer service chatbot | Limited | Contact info only | CX Manager | Escalation path required | Bi-annual |
| Internal meeting summarizer | Minimal | Internal only | IT Lead | No, spot checks sufficient | Annual |
| Automated loan pre-screening | High | Financial / Personal | Compliance Officer | Yes, mandatory before approval | Quarterly |
| Marketing copy generator | Minimal | None | Marketing Lead | Editorial review before publish | Annual |
Vendor Risk and Third-Party AI Controls
When an AI system causes harm, 'the vendor did it' is not a legal defense. Your organization is accountable for outcomes produced by tools it chooses to deploy. This means vendor selection is a risk decision, not just a procurement decision. Before signing any contract for an AI-powered service, your team needs answers to specific questions about how the model was trained, what bias testing was done, how errors are reported, and what happens to your data after processing.
Third-party AI risk is accelerating as vendors embed AI into products that didn't previously have it. CRM platforms, HR software, accounting tools. You may not have chosen an AI product; it may have arrived in a software update. Governance programs must include a process for discovering these embedded AI features, not just evaluating standalone AI tools. Ask your software vendors directly: 'What AI features have been added in the last 12 months, and what data do they process?'
- Request the vendor's AI transparency documentation or model card before signing.
- Confirm in writing whether your data is used to train or fine-tune the vendor's models.
- Ask for the vendor's incident notification timeline, how quickly will they tell you if their model fails or is compromised?
- Verify that the vendor's subprocessors (third parties they use) are also disclosed.
- Include a right-to-audit clause in contracts for any high-risk AI application.
- Establish what happens to your data if you terminate the contract.
| Question to Ask Vendor | Why It Matters | Red Flag Answer |
|---|---|---|
| Is our data used to train your model? | Proprietary data leakage risk | 'We may use data to improve services' |
| What bias testing has been conducted? | Discrimination and compliance risk | 'The model is regularly updated' |
| How do you notify clients of model changes? | Drift and performance risk | 'Changes are in the release notes' |
| Where is data processed and stored? | Data sovereignty and GDPR risk | Vague or multi-region non-answer |
| What is your AI incident response SLA? | Accountability and liability risk | No defined timeline provided |
The EU AI Act Vendor Obligation
Prompt
I'm a compliance manager evaluating a new AI-powered recruitment platform for our 500-person company. We operate in the US and EU. Help me create a vendor risk questionnaire with 10 specific questions I should ask before signing the contract. Focus on data privacy, bias and fairness, model transparency, incident response, and regulatory compliance. Make the questions direct and specific, not vague.
AI Response
**Vendor AI Risk Questionnaire. Recruitment Platform** **Data Privacy** 1. Is our candidate data used to train, fine-tune, or improve your AI models? If yes, can we opt out, and what are the terms? 2. Where is candidate data stored and processed? List all countries and subprocessors with data access. **Bias and Fairness** 3. What bias audits have been conducted on your screening algorithms, and can you share the most recent results or summary findings? 4. Which protected characteristics (race, gender, age, disability) does your bias testing cover, and how frequently is testing repeated after model updates? **Model Transparency** 5. Do you provide a model card or technical documentation describing how your AI makes candidate ranking or filtering decisions? 6. Can candidates or our HR team request an explanation for why a specific candidate was ranked or filtered out? **Incident Response** 7. What is your contractual SLA for notifying clients of AI model failures, data breaches, or significant performance changes? 8. Have you experienced any AI-related incidents in the past 24 months? If yes, provide a summary of the issue and resolution. **Regulatory Compliance** 9. How does your platform comply with the EU AI Act's requirements for high-risk AI in employment contexts, including required technical documentation and human oversight provisions? 10. Are you registered with any regulatory body or certification scheme relevant to AI in recruitment (e.g., ISO 42001, EEOC guidance compliance)? *Tip: Request written responses. Verbal assurances during sales calls are not contractually binding.*
Incident Response and Continuous Monitoring
AI systems fail in ways that traditional software doesn't. A conventional software bug produces an error message. An AI model can quietly drift, producing increasingly biased, inaccurate, or harmful outputs over time without triggering any system alert. This is called model drift, and it is the governance risk most organizations are least prepared for. Your incident response plan must include triggers specific to AI: a spike in user complaints about outputs, a demographic disparity in decisions, or a vendor notification that the underlying model has been updated.
Continuous monitoring doesn't require a data science team. It requires defined checkpoints and assigned reviewers. For a customer-facing chatbot, that might mean a monthly sample review of 50 conversations by the CX manager. For a hiring tool, it means quarterly analyzis of decision outcomes by demographic group, something HR can run with basic reporting tools. The goal is to catch problems before they become regulatory events or public incidents.
| AI Incident Type | Early Warning Sign | Immediate Action | Responsible Role |
|---|---|---|---|
| Model drift / accuracy decline | Increase in user corrections or complaints | Pause automated decisions; manual review | System Owner |
| Bias event | Demographic disparity in outcomes | Escalate to Legal and HR; document immediately | Compliance Officer |
| Data breach via AI vendor | Vendor notification or anomaly detected | Invoke vendor SLA; notify DPO within 72 hrs (GDPR) | Privacy / Legal Lead |
| Unauthorized AI use by employee | Discovery of unapproved tool with org data | Offboard data; policy enforcement | IT / HR |
| Regulatory inquiry | Regulator requests AI decision records | Produce risk register and audit trail | Compliance Officer / Legal |
Silence Is Not Compliance
Goal: Produce a completed first row of your organization's AI Risk Register, with risk tier assigned, human review process defined, and rationale documented, ready to share with your manager or compliance team.
1. Open a free tool. Google Sheets, Microsoft Excel, or Notion, and create a new blank document titled 'AI Risk Register [Your Organization Name]'. 2. Create these column headers in row 1: AI Tool / Use Case | Risk Tier (High / Limited / Minimal) | Data Types Processed | Named Owner | Human Review Process | Vendor Data Training (Yes / No / Unknown) | Last Review Date. 3. Identify one AI tool your team currently uses, a writing assistant, a scheduling tool, a chatbot, or any AI-powered feature in existing software. 4. Open ChatGPT (free at chat.openai.com) or Claude (free at claude.ai) and paste this prompt: 'I use [tool name] for [describe the use case]. Based on the EU AI Act and NIST AI RMF risk tiers, what risk level should I assign this use case, and what human oversight steps would be appropriate? Keep the answer practical and under 200 words.' 5. Use the AI's response to fill in the Risk Tier and Human Review Process columns for your first entry. Fill in the remaining columns based on what you know about the tool. 6. Add a 'Notes' column and paste the AI's full response there as your documentation of the risk rationale.
Quick Reference Cheat Sheet
- NIST AI RMF core functions: GOVERN → MAP → MEASURE → MANAGE.
- EU AI Act risk tiers: Unacceptable (banned) → High (strict controls) → Limited (transparency only) → Minimal (no requirements).
- High-risk AI domains include: hiring, credit, healthcare, education assessment, law enforcement, critical infrastructure.
- Every AI system in use needs a named human owner, not a team, a person.
- Vendor contracts must address: data training use, incident SLA, subprocessors, right to audit.
- Risk registers require scheduled reviews: 90 days for high-risk, 180 days for low-risk systems.
- Model drift is silent, build active monitoring checkpoints, not passive alert systems.
- GDPR breach notification: 72 hours. Don't investigate for weeks before escalating.
- Documentation is your audit trail. If it isn't written down, it didn't happen.
- Embedded AI in existing software is a governance gap, audit your current vendors annually for new AI features.
Key Takeaways
- An AI risk register is your governance foundation, start with your three highest-stakes AI systems and build from there.
- Vendor accountability is your responsibility. Ask hard questions before signing, and put the answers in the contract.
- AI incidents include silent failures like model drift and bias events, not just system crashes or data breaches.
- Continuous monitoring can be done by non-technical staff through defined review checkpoints and sampling processes.
- Regulatory timelines are real and short, 72-hour GDPR breach notifications apply to AI-related data incidents.
- Free AI tools like ChatGPT and Claude can help you draft risk assessments, questionnaires, and policy language right now.
This lesson requires Pro+
Upgrade your plan to unlock this lesson and all other Pro+ content on the platform.
You're currently on the Free plan.
