Overland Park Health Partners: Standing Up an AI Management System.
Overland Park Health Partners is a fictional 1,850-person regional healthcare network deploying a patient-facing chatbot and Microsoft 365 Copilot. The Board has directed the company to formalize its AI governance, and my job is to build an AI Management System (AIMS) aligned to ISO/IEC 42001. Explore each deliverable below — and if you have questions or critiques of my approach, I'd genuinely welcome the conversation.
-
Overland Park Health Partners, LLC (fictional) — a regional healthcare network headquartered in Overland Park, KS.
Size: ~1,850 employees · 22 clinics across KS, MO, and NE · telehealth in 8 states
AI in scope: OPHP Assist (patient-facing chatbot built on Azure OpenAI with RAG) and Microsoft 365 Copilot for ~400 corporate staff
Regulatory context: HIPAA/HITECH, state privacy and AI laws
The challenge: Known shadow-AI use, a suspended AI resume-screening pilot, and a Board mandate to stand up formal AI governance — with no prior AI policy beyond a one-page memo.
-
The AIMS applies to the governance, risk management, development, deployment, operation, and monitoring of artificial intelligence systems used by Overland Park Health Partners in the delivery of patient-facing digital services and internal corporate productivity, specifically the OPHP Assist virtual assistant and the OPHP Copilot Program, across all OPHP locations and supporting corporate functions.
-
The core of the AIMS: identifying, scoring, and treating the risks of OPHP's two AI deployments. Fifteen risks across security, privacy, safety, and compliance — from prompt injection and RAG poisoning to Copilot oversharing and hallucinated medical guidance — each scored for likelihood and impact, assigned a treatment, and mapped to ISO/IEC 42001 Annex A controls and the NIST AI RMF.
-
The rules of the road for AI at OPHP — approved tools, prohibited uses, and a one-glance data table answering the question every employee actually has: "can I put this in that tool?" Written to enable safe use, not just forbid unsafe use, with a protected self-reporting path and a bright-line rule: no PHI in any AI tool, period. Primary treatment for the shadow-AI and data-leakage risks in the risk assessment.
-
The why behind the what. Short entries on the judgment calls that shaped this program — why PHI stayed out of the chatbot's architecture entirely, why one risk was accepted instead of mitigated, why "no PHI in any AI tool" beats a nuanced matrix for v1.0, and why patient harm is scored separately from company harm.
Overland Park Health Partners, LLC is a fictional organization created to demonstrate ISO/IEC 42001 AI Management System (AIMS) implementation. All names, systems, and data are invented.
Company Profile & Context:
Quick Facts:
Industry: Healthcare services — regional network of outpatient clinics and telehealth
Headquarters: Overland Park, Kansas
Footprint: 22 outpatient clinics across Kansas, Missouri, and Nebraska; telehealth in 8 states
Employees: ~1,850 | Annual revenue: ~$410M
IT/Security: ~60 IT staff including a 6-person security team; CISO reports to the CIO
Regulatory context: HIPAA/HITECH, state privacy and AI statutes.
The Business Situation:
OPHP operates in a competitive regional healthcare market where patient experience and operational efficiency are key differentiators. Leadership has approved an "AI-enabled operations" initiative with two goals: reduce patient call-center wait times and improve internal staff productivity. At the same time, the Board's Audit & Risk Committee has flagged AI as an emerging risk area following industry incidents involving chatbot misinformation and inadvertent disclosure of protected health information (PHI). The CISO has been directed to establish an AI Management System aligned with ISO/IEC 42001 and the NIST AI Risk Management Framework.
AI Systems Landscape
OPHP Assist — Patient-Facing Virtual Assistant. A chatbot on the OPHP website and patient portal, built on Azure OpenAI with retrieval-augmented generation (RAG) over a curated knowledge base of clinic locations, hours, insurance acceptance, and scheduling policies. It integrates with the appointment scheduling system via API and is explicitly not permitted to provide medical advice. OPHP is both the developer of the RAG application layer and a customer of the underlying third-party model. OPHP Copilot Program. Microsoft 365 Copilot licensed to roughly 400 corporate and administrative staff for drafting, summarization, and spreadsheet work. Key risks include data exposure through over-permissive file sharing and PHI entering prompts.
What's not in scope — yet. An AI resume-screening pilot was suspended pending legal review of algorithmic hiring rules, and an internal survey confirmed unsanctioned "shadow AI" use of free consumer tools by staff. Both shaped the scoping decisions documented in the AIMS Scope Statement.
Why This Scenario
I built OPHP to reflect the reality most mid-size organizations face: no AI engineers on staff, third-party AI services rather than home-built models, regulated data everywhere, and governance starting from a single "don't paste patient data into ChatGPT" memo. That's the environment where AI governance work actually happens.
AI Management System Scope:
This document defines the boundaries of the AI Management System per ISO/IEC 42001 Clauses 4.1–4.4 — which AI systems, business units, processes, and locations the AIMS governs, and what's excluded and why.
Scope Statement:
The AIMS applies to the governance, risk management, development, deployment, operation, and monitoring of artificial intelligence systems used by Overland Park Health Partners in the delivery of patient-facing digital services and internal corporate productivity — specifically the OPHP Assist virtual assistant and the OPHP Copilot Program — across all OPHP locations and supporting corporate functions.
OPHP’s AI Roles:
Using ISO/IEC 22989 role definitions: for OPHP Assist, the company is both an AI producer (it developed the RAG application layer) and an AI customer of the third-party foundation model. For M365 Copilot, it is purely an AI customer/deployer. OPHP does not train or provide foundation models. This distinction matters because it drives which Annex A controls apply and which risks are managed through supplier oversight versus direct operational control.
In Scope:
Both AI systems and their supporting configuration (RAG knowledge base, guardrails, scheduling API integration, Copilot tenant and permissions model); the IT, Security, Digital Experience, and corporate functions that build or use them; and the core AIMS processes — AI risk assessment, impact assessment, supplier management, change management, incident response, data quality, training, monitoring, internal audit, and management review.
Excluded — With Justification:
Third-party foundation model internals (weights, training data): outside OPHP's control; governed through supplier management and contractual assurance instead of direct controls. The suspended resume-screening pilot: no production use; must pass an AI impact assessment before re-entering scope. AI features embedded in medical devices: governed under existing FDA-regulated clinical engineering processes; scheduled for Phase 2 evaluation. General IT systems: covered by the existing security program, addressed here only as dependencies.
Key Dependencies:
The riskiest interfaces sit at the boundaries: the scheduling system API that OPHP Assist can write to, the identity provider for patient sessions, and — for Copilot — the SharePoint/OneDrive permission hygiene that determines what the AI can surface. Scope boundaries only work if these interfaces are managed deliberately.
The top risks:
R-01 — Prompt injection (High): Attacker-crafted input, or malicious content retrieved into context, causes the chatbot to bypass guardrails or misuse its scheduling functions. Treated with layered filtering, deny-by-default tool permissions, and server-side authorization re-checked on every API call — so even a successful injection can't exceed the user's own privileges.
R-02 — PHI disclosure (High): Treated architecturally: the RAG knowledge base contains no PHI by design. Patient-specific data flows only through authenticated API calls scoped to the current session.
R-03 — Hallucinated health guidance (High): Grounded responses only, refusal + human handoff for health-condition questions, adversarial test suites re-run on every model change, and sampled transcript review reported to governance.
R-06 — Copilot permission sprawl (High): SharePoint/OneDrive sharing remediation before license rollout, sensitivity labeling, and ongoing oversharing reports — because Copilot faithfully surfaces whatever permissions allow.
R-07/R-08 — Data leakage & shadow AI (High): Acceptable Use Policy plus a sanctioned alternative, DLP on known AI endpoints, and a repeated staff survey to measure the trend instead of assuming it away.
One risk was accepted, not mitigated: vendor outage (R-10) — the chatbot fails visibly and safely to phone/portal fallback. A register where everything says "mitigate" is a checkbox exercise; documented acceptance with rationale is real risk management.
AI Risk Assessment & Treatment
Fifteen risks identified across OPHP's two AI systems, scored on a 5×5 likelihood × impact scale, with acceptance authority tied to risk level (Low = system owner, Medium = CISO, High/Critical = AI Governance Committee).
AUP:
This policy defines the acceptable use of artificial intelligence tools at Overland Park Health Partners. Its goals are to (a) protect patients and their information, (b) enable the workforce to benefit from approved AI tools safely, and (c) meet OPHP’s legal and contractual obligations, including HIPAA. This policy is a primary treatment for risks R-07 (data leakage into AI tools) and R-08 (shadow AI) in the AI Risk Assessment.
Scope:
This policy applies to all use of AI tools in connection with OPHP work, on any device, including personal devices used for work purposes. “AI tools” includes chatbots and assistants (e.g., M365 Copilot, consumer chatbots), AI features embedded in approved software, AI transcription/summarization services, and code or content generators.
Key prohibitions:
No PHI in any AI tool (none is currently approved for it — including Copilot); no unapproved consumer AI for any work use; no AI making consequential decisions about patients or employees — AI may inform; a qualified human must decide; no bypassing guardrails or monitoring.
Why the scope statement is a risk decision, not paperwork
Every downstream activity — risk assessment, controls, audits — inherits its boundaries from scope. The judgment lives in the exclusions: I excluded the foundation model internals because OPHP can't control them, so that risk is managed through supplier oversight and contract terms instead of direct controls. I kept the suspended resume-screening pilot out of scope, but with a gate — it can't restart until it passes an AI impact assessment. If something goes wrong later, every exclusion is a documented, defensible decision rather than an oversight.
Why I kept PHI out of the chatbot's knowledge base entirely
The strongest control is architectural. Instead of putting patient data in the RAG corpus and filtering the outputs, OPHP Assist's knowledge base contains only public operational content — locations, hours, insurance, policies. Patient-specific actions flow through authenticated API calls scoped to the current session. "The PHI was never in the corpus" is a fundamentally better answer than "we added a filter and hope it holds."
Why one risk was accepted instead of mitigated
Vendor outage (R-10) is accepted at Low with a contingency: the chatbot fails visibly and safely to phone and portal fallback. A risk register where every line says "mitigate" is a checkbox exercise — real risk management means some risks are consciously accepted, with rationale, an owner, and a review date. Showing the acceptance is showing the discipline.
Why no AI tool at OPHP is approved for PHI — including Copilot
For version 1.0 of a healthcare AI program, a bright line beats a nuanced matrix. "No PHI in any AI tool, period" is a rule 1,850 people can remember and auditors can verify. The policy includes an exception process, so the line can move deliberately later — with a risk assessment, a BAA, and controls — rather than eroding informally through a thousand small judgment calls.
Why the Acceptable Use Policy permits before it prohibits
Staff were already using shadow AI — not because they're reckless, but because AI is useful and nobody offered a safe path. So the policy leads with approved tools, pairs every "no" with a sanctioned alternative, and protects good-faith self-reporting of mistakes. A policy that only says "no" gets ignored; one that makes the secure path the convenient path actually changes behavior.
Why patient harm is scored separately from company harm
ISO/IEC 42001's distinctive requirement (Clause 6.1.4) is assessing impacts on individuals and society, not just the organization. Risks like hallucinated health guidance or unequal chatbot access get evaluated from the patient's perspective in a dedicated impact assessment, and where patient harm scores higher than organizational harm, the higher score drives the risk level. That's the difference between AI governance and rebadged IT risk management.