What the 230 control objectives already answer.
The CRI Financial Services AI Risk Management Framework contains 230 control objectives — the most operationally specific AI governance artefact the financial sector has produced. We mapped every one of them against the eight MARQUE questions. The distribution is the finding: documentation and oversight are heavily covered, and the questions specific to autonomous action are not.
Coverage by question.
| Question | What it asks | Objectives | Share | Assessment |
|---|---|---|---|---|
| Authority | What is the agent permitted to commit, and who granted that? | 39 | 17% | Partial |
| Oversight | Who is accountable in the interval between decision and review? | 110 | 48% | Well covered |
| Drift | How is behavioral change detected before it becomes loss? | 11 | 5% | Thin |
| Auditability | Can a decision be reconstructed months later, exactly? | 131 | 57% | Well covered |
| Accountability | When it goes wrong, who answers? | 55 | 24% | Well covered |
| Identity | What is the agent, legally, and to whom does its output belong? | 32 | 14% | Partial |
| Systemic behavior | What happens when many agents converge on the same trade? | 16 | 7% | Thin |
| Standards & interoperability | What does conformance actually mean here? | 62 | 27% | Well covered |
A control objective may serve more than one question, so the column sums above 230. 18 of the 230 map to no MARQUE question — largely fairness, privacy and human-subject controls that matter but sit outside the authority-to-act problem.
Explore every mapping.
One row per subject and relationship: the 230 control objectives as assigned here (and the 18 assigned to none), the standards register's frameworks, and the knowledge graph's typed edges from instruments, the reference gate, KYA (Know Your Agent) dimensions and canon terms. Filter it, follow any row to its source, or download exactly what you see. The rows are the same as api/marque-mappings.json and api/marque-mappings.csv; the graph rows equal the MARQUE (a reference framework organized around eight questions) edges in api/graph.json.
307 subjects shown.
| Subject | MARQUE questions | Basis and source |
|---|---|---|
| AI Legal, Regulatory, and Policy IntegrationThe organization identifies, monitors, and integrates applicable laws, regulations, contractual obligations, and sector requirements into policies, procedures, and operations governing AI. This includes updating governance artifacts and aligning operational practices as requirements evolve. | AddressesOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Compliance Responsibilities ManagementThe organization clearly assigns, documents, and regularly validates its compliance responsibilities for AI-related legal, regulatory, contractual requirements, and internal organizational AI policies. | AddressesAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Compliance Validation ProceduresThe organization establishes and implements procedures to validate AI system compliance with applicable laws, regulations, and organizational policies that incorporate relevant industry standards and guidance. This includes routine audits, impact assessments, risk management activities, and documentation reviews at key stages of the AI lifecycle, with mechanisms to incorporate lessons learned and feedback into ongoing process improvements. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Compliance DocumentationThe organization maintains documentation to demonstrate how AI systems comply with applicable laws, regulations, and organizational policies. This documentation includes risk assessments, compliance reviews, audits, corrective actions, and other relevant information generated throughout the AI lifecycle. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Legal Feedback and Change IntegrationThe organization establishes an ongoing improvement process with legal experts and relevant stakeholders to ensure that changes in laws and regulations are applied to the AI system, and that changes in the AI system are reviewed by legal for appropriate consideration and integration into risk management processes. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Data Lifecycle and RetentionThe organization ensures that data retention policies, privacy requirements, and legal obligations governing data lifecycle management are integrated into its AI system lifecycle processes. It maintains records of data retention periods, manages data deletion or archiving in compliance with privacy norms, and verifies that training datasets adhere to these policies, especially when data subjects exercise their rights or when legal or privacy obligations change. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Principles and Policy IntegrationThe organization defines and documents its own AI Trustworthy Principles, which are then integrated into relevant policies, processes, and practices across key functions (e.g., HR, IT, legal, compliance). | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Terminology and Scope GlossaryThe organization establishes, maintains, and periodically updates a glossary of AI-related terms and concepts and clearly defines the scope, purpose, and intended/acceptable uses of its AI systems. This information is referenced and reflected consistently across organizational policies, standards, other relevant documentation, and training programs. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Acceptable Use PolicyThe organization develops and maintains an enterprise-level Acceptable AI Use Policy that outlines the types of AI applications the organization is willing or unwilling to adopt based on its risk appetite and tolerance. This policy is communicated clearly across the organization and, where applicable, supplemented by individual acceptable use guidelines or standards for employees, third parties, and other relevant stakeholders. Periodic reviews ensure alignment with evolving risk considerations and organizational objectives. | AddressesOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Trustworthy Principles TrainingThe organization regularly offers tailored training programs to educate relevant staff, including those involved in AI system design, development, deployment, and other related roles, on its AI Trustworthy Principles. These principles encompass legal and regulatory considerations as well as their connection to organizational values. The training programs are regularly reviewed and updated as needed to ensure alignment with organizational objectives and mission. | AddressesOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Governance and Risk StandardsThe organization's governance policies, risk controls, model testing and validation processes, as well as compliance and enterprise risk management (ERM) frameworks, are updated to include AI-specific considerations. These updates address unique AI system implications (e.g., data quality, provenance, secure handling) throughout the AI lifecycle and enhance the identification, assessment, management, and monitoring of AI risks in alignment with the organization's AI Trustworthy Principles and risk appetite and tolerance. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Model Standards and ValidationThe organization sets standards for experimental design, data quality, and model training, which include documenting assumptions, methods, testing outcomes, data lineage, model versioning, and performance monitoring. These standards also outline processes for regular review, validation, and updates, ensuring models align with the organization's AI Trustworthy Principles throughout their lifecycle. | AddressesOversightDriftAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Assessment ModelsThe organization updates its risk assessment methods, consistent with those in ERM and Model Risk Management, to address the unique risks of AI systems during development, deployment, and operation and evaluate the impact and likelihood of AI-specific risks consistently for a unified view. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Monitoring and EscalationThe organization integrates AI-specific considerations into its monitoring, reporting, and escalation processes, aligned with its risk criteria, capacity, and appetite. It establishes or adapts practices based on the AI system’s risk profile to provide effective oversight throughout the AI lifecycle. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Impact Measurement PoliciesThe organization’s policies describe methods for regularly measuring AI system impact (e.g., outcomes analysis, impact assessments) and impact at key stages of the AI lifecycle. Assessments are triggered by system changes to better identify and evaluate potential risks and effects on stakeholders, business processes, applications, and broader systems. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Use Risk Acceptance and Rejection FrameworkThe organization has clear policies and decision-making processes, informed by executive leadership, to ensure that AI system use aligns with its defined risk tolerance. These policies outline criteria for identifying and rejecting AI uses that exceed acceptable risk levels as determined by the organization's risk assessment. Decisions to reject an AI system are based on a thorough evaluation of potential risks and impacts, with documentation of the rationale. Rejected uses are reviewed periodically to ensure the organization's risk tolerance remains appropriate and aligned with its overall risk management strategy. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Management FrameworkThe organization establishes policies and documentation practices for AI risk management processes, ensuring transparency and alignment with organizational risk priorities. These policies acknowledge the reality of automatically generated or AI-generated documentation, providing guidance on maintaining accuracy, verifiability, and accountability. They specify roles, responsibilities, and mechanisms for oversight and escalation throughout the AI lifecycle, supported by routine reviews and performance metrics to ensure effective management and continuous improvement. | AddressesOversightAuditabilityAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Documentation StandardsThe organization establishes documentation requirements in its AI risk management policies and procedures, covering AI system design and implementation, model development (including model type, training data sources and selection criteria, assumptions, and limitations), the justification and rationale of key decisions, the acceptable use of proxies, testing, evaluation, validation, and risk mitigation processes (including methodologies and outcomes), and regular monitoring and change management activities. | AddressesAuthorityOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Documentation Repository and AccessThe organization maintains a centralized and accessible repository of AI system documentation, structured to provide relevant AI stakeholders with appropriate access based on their roles and the system’s risk classification. Mechanisms are in place to regularly review the completeness and accuracy of documentation and to maintain readily available information for oversight, audit, and ongoing risk management. | AddressesOversightAuditabilityAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Performance and Risk MonitoringThe organization documents its approach for monitoring its existing AI systems for performance and risk issues (including key performance indicators, security events, and other relevant metrics), even if AI is not yet widely adopted. Key personnel are assigned responsibility for monitoring activities, with clearly defined roles, escalation procedures, and reporting mechanisms to provide accountability and timely issue resolution. | AddressesOversightAuditabilityAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Periodic AI Risk Management Process ReviewThe organization conducts periodic reviews of its AI risk management processes, with frequency and scope based on AI adoption, system risk, and technological change. These reviews include assessment by internal audit or third-line functions and incorporate insights from monitoring activities and incident analyses to drive continuous process and control enhancements. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Reporting and OversightThe organization’s senior leadership is regularly informed of AI system performance, risks, and risk management review outcomes through defined reporting mechanisms (e.g., reports, dashboards). This oversight aligns AI risk management with overall organizational strategy and risk appetite, enabling timely decisions and prioritized resource allocation. | AddressesOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Independent AI Risk Management Process AssessmentThe organization utilizes qualified, independent parties (e.g., audit, compliance functions, third parties) to conduct regular, independent assessments of the organization’s AI risk management processes to identify gaps, drive improvements, and optimize the organization's AI risk management capabilities. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Inventory ManagementThe organization maintains a regularly updated inventory of its AI systems, including purpose, data sources, responsible personnel, risk ratings, criticality, dependencies, compliance requirements, and decommissioning attributes (e.g., sunset dates, archival procedures, data retention policies). This inventory is regularly updated as new systems are developed, acquired, or retired, enabling the organization to have a current and accurate understanding of its AI landscape, including the lifecycle management of its AI systems. Inventory processes are regularly reviewed to incorporate lessons learned and feedback from operational monitoring. | AddressesOversightAuditabilityAccountabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Inventory and Data IntegrationThe organization integrates the AI system inventory with its technology management and data governance processes to drive consistency and enable cross-functional collaboration. The inventory informs risk management prioritization (e.g., risk assessment documentation, monitoring and mitigation plans, meeting minutes and/or decision logs), with high-risk and mission-critical systems subject to enhanced oversight, control, and reporting. | AddressesOversightAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Inventory Integration for Purchased and Shadow SystemsThe organization establishes practices to ensure that AI systems used in purchased products and Shadow IT are identified, documented, and incorporated into its inventory and risk management processes. Procurement procedures require vendors and internal teams to disclose AI components, which are then evaluated for compliance, security, and alignment with organizational risk standards. All such AI systems are tracked throughout their lifecycle to prevent unmanaged risks and gaps. | AddressesAuditabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Risk-Based Inventory ResourcesThe organization allocates and sustains resources to create, maintain, and govern the AI Inventory proportionate to the risk of each AI system or activity, ensuring higher-risk entries receive deeper classification, documentation, validation, and oversight throughout their lifecycle. | AddressesOversightAuditabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Inventory Risk AnalysisThe organization analyzes inventory data to identify common risk patterns, interdependence, and potential cascading effects across AI systems. This portfolio-level risk analysis enables enterprise-wide risk mitigation strategies, optimal resource allocation, and overall risk management effectiveness. | AddressesIdentitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Inventory AuditsThe organization conducts regular audits of the AI system inventory to verify completeness, accuracy, and timeliness. | AddressesAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI System Decommissioning Policies and Impact ProceduresThe organization establishes and follows comprehensive policies and procedures for decommissioning AI systems. These explicitly define criteria for retirement based on AI-specific factors (e.g., performance, data quality, regulatory compliance, strategic alignment, and risk tolerance). The decommissioning process incorporates thorough impact assessments to identify and mitigate potential risks such as data loss, operational disruption, and reputational damage. It ensures adequate resources for system transition or replacement, including for critical or revenue-generating systems, and includes provisions for rapid decommissioning in emergencies, supported by automated tools for timely decision-making. | AddressesStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Management Roles and ResponsibilitiesThe organization defines and documents key AI risk management roles and responsibilities (e.g., AI system owners, developers, data scientists, risk managers, independent validation, additional second and third line personnel), across levels and functions. It establishes clear expectations, organizational structures for independent oversight, decision-making authority, escalation, and accountability, ensuring a structured, transparent, and accountable approach to AI risk management that aligns with existing organizational practices, industry best practices, and regulatory expectations. | AddressesAuthorityOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Communication and EscalationThe organization establishes clear communication channels, escalation procedures, reporting lines, and decision-making authority for AI risk management, so stakeholders know whom to contact, collaborate with, and rely on for authorized decisions related to AI risks. | AddressesAuthorityOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Roles and Processes Review/UpdateThe organization regularly reviews and updates roles, responsibilities, and communication lines to align with its evolving AI strategy, risk landscape, and industry best practices, utilizing stakeholder consultations and gap analysis. | AddressesOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Roles in Job and PerformanceThe organization embeds AI risk management roles into job descriptions, performance goals, and career development paths, providing relevant personnel with necessary training and support. Additionally, the organization evaluates their performance in these areas. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Management Training and PoliciesThe organization provides role-specific AI risk management training to all personnel involved in AI system development, deployment, or use, including executives, decision-makers, and technical staff. This training covers relevant trustworthiness principles, policies, procedures, legal and regulatory requirements, and industry best practices. It emphasizes understanding AI assumptions, limitations, and risks, fostering an informed approach to AI adoption and oversight. | AddressesAuthorityOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Mandatory AI Risk Management TrainingThe organization provides role-specific AI risk management training to all personnel involved in AI system development, deployment, or use, including new hires and those transitioning into AI roles. This training covers relevant trustworthiness principles, policies, and legal and regulatory requirements. It emphasizes understanding AI assumptions, limitations, risks, and content provenance, with content lineage and provenance information integrated as a key subcomponent to enhance comprehension of data origin, integrity, and traceability throughout the AI lifecycle. The program incorporates theoretical concepts, practical exercises, and case studies to ensure effective application of knowledge across organizational roles. | AddressesAuthorityAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Training Effectiveness EvaluationThe organization regularly evaluates the effectiveness of AI risk management training using assessments, employee feedback, and performance metrics. Evaluation results drive insights from monitoring activities and incident management to identify gaps and lessons learned. These findings inform updates to training content, delivery methods, and the overall training program to ensure continued relevance, effectiveness, and alignment with best practices and organizational needs. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Advanced AI Risk Certification ProgramsThe organization offers advanced AI risk management training and certification programs for personnel in specialized roles (e.g., executives, data scientists, risk managers). These programs cover advanced topics (e.g., responsible AI design, algorithmic fairness, explainable AI, risk quantification) and develop AI risk management expertise. AI risk management training is integrated into the organization's broader learning and development strategy. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Leadership Commitment to Responsible AIThe organization’s executive leadership demonstrates their commitment to responsible AI development and deployment by communicating the importance of AI risk management through town halls, newsletters, public statements, and digital channels. They emphasize the benefits of effective AI risk management, foster open dialogue, and recognize exemplary practices. Additionally, leadership sets clear expectations, defines roles and responsibilities, allocates adequate resources, and holds management accountable to ensure the effective implementation and integration of AI risk management practices across the organization. | AddressesAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Appetite and ThresholdsThe organization's executive leadership and/or an oversight board or committee, actively participate in establishing and approving the organization's risk appetite and tolerance thresholds for AI systems. They regularly review and contribute to AI risk management strategies, policies, and performance metrics, and principles, creating alignment with the ERM framework and business objectives. | AddressesOversightAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Governance StructureThe organization establishes an AI governance structure, such as a committee with senior leaders from business, technology, risk, and legal. It provides oversight, reviews major AI initiatives, and advises on resources. Over time, this structure evolves toward clearer accountability, potentially involving a senior executive or Chief Model Risk Officer (CMRO) who takes primary responsibility for AI risk, ensuring alignment with existing risk functions like Model Risk Management (MRM). | AddressesOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Board Oversight of AI RisksThe organization’s board of directors provides independent oversight of AI risk management by reviewing performance, discussing significant AI-related issues, and offering guidance on industry standards and guidelines. The board actively oversees the integration of AI into the organization’s broader strategic objectives, including investment and resource planning, business model evolution, and HR practices related to AI talent. The board ensures that AI considerations are embedded into enterprise-level decision-making, aligning AI initiatives with organizational goals and risk appetite. | AddressesOversightAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Multiple Perspectives in AI Risk TeamsTo minimize risk blind spots and groupthink and represent global or regional stakeholder interests, the organization prioritizes multidisciplinary perspectives in AI risk management decision-making. AI risk management teams are formed considering demographics, disciplines, experience, and backgrounds, actively seeking multiple perspectives. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Human-AI Supervision PoliciesThe organization develops, periodically reviews, and updates policies and protocols for human involvement, oversight, and disclosure throughout the AI lifecycle. These policies should address risks such as automation complacency, anthropomorphization, and disinformation by including measures to prevent unapproved interactions, promote transparency, and mitigate undue reliance. They should also establish safeguards for human override, communication, and external stakeholder engagement to ensure responsible and aligned AI deployment. | AddressesOversightAccountabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Monitoring Human-AI OversightThe organization implements mechanisms (e.g., audits, performance evaluations, feedback loops) to monitor and assess human-AI interactions, including behavioral risks like automation complacency or inappropriate overreliance. Data collected should inform decision-making and resource allocation, and policies should promote understanding of AI limitations to prevent overreliance. Integration with ongoing monitoring processes should specifically include assessments of how effectively human operators are interacting with and overseeing AI systems, evaluating the quality and outcomes of human-AI collaboration. | AddressesAuthorityOversightDriftAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Trustworthy Principles and CommunicationThe organization regularly reviews AI Trustworthy Principles prioritizing safety, critical thinking, and the minimization of potential negative impacts in AI system design, development, deployment, and use. These principles are clearly communicated to stakeholders and integrated into relevant training programs. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Open Risk Communication PoliciesThe organization develops and implements policies fostering open communication, proactive risk reporting, and a risk-aware culture across the AI lifecycle, integrating these practices into existing management systems and workflows. These policies include whistleblower protections, independent oversight, critical practices like pair programming, dogfooding, and external audits, ensuring employees and stakeholders can raise concerns and practice effective challenge without retribution. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Safety Lessons and Best PracticesThe organization implements an improvement process that captures, shares, and applies lessons learned and best practices related to AI safety and risk management. This process promotes effective challenge through regular debriefs, case studies, cross-functional collaboration, and the integration of insights into policies, practices, and training programs to drive ongoing enhancement of the organization's critical thinking and safety-first mindset in AI development and deployment. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk and Impact Documentation TemplatesThe organization establishes standardized templates and guidelines for documenting AI system risks and potential impacts throughout the AI lifecycle. These templates support informed risk assessment and estimation processes, facilitating consistent documentation across teams and projects. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Risk Documentation Review and UpdatesThe organization regularly reviews and updates AI risk and impact documentation based on stakeholder feedback (e.g., end-users, subject matter experts, external advisors), ensuring that the information remains accurate, relevant, and actionable. This feedback is used to refine AI risk management practices and inform targeted risk mitigation strategies. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Benefits Monitoring and Updates PlanThe organization creates a plan to regularly review and update documentation of the AI system’s actual and potential benefits as its functionality, performance, and context of use evolve. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Communication and Stakeholder TransparencyThe organization develops and implements a comprehensive communication strategy to proactively share information about AI risks, potential impacts, and risk mitigation actions with relevant internal and external stakeholders. This plan includes tailored messaging, engagement mechanisms, and channels for stakeholder feedback, fostering transparency, accountability, and building trust in the organization’s AI risk management practices and responsible AI development and deployment. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Testing and Validation StrategyThe organization establishes an AI system testing strategy encompassing unit, integration, performance, and user acceptance testing, tailored to the system characteristics and requirements. This strategy should also include testing for real-world risks through methods such as red-teaming and field testing. The strategy will be regularly reviewed and updated. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Incident Identification and ResolutionThe organization integrates AI incident identification, reporting, and documentation into its existing incident management framework, ensuring clear definitions, roles, and responsibilities that enable prompt identification, thorough investigation, and effective resolution. This integration helps to minimize harm, facilitate timely response, and prevent recurrence, while leveraging established procedures and workflows. | AddressesAuditabilityAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Testing and Incident Response TrainingThe organization provides regular training and resources to support personnel in effectively testing AI systems, identifying incidents, and sharing information on risks and issues within its existing incident management framework. This includes ensuring training aligns with established procedures for incident response and communication, reinforcing practical skills and preparedness through simulations and scenario exercises. | AddressesStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Incident Tracking and AnalysisThe organization maintains a centralized AI inventory or enterprise knowledge management system that integrates with existing incident management frameworks to track, monitor, and analyze AI incidents. This system supports the identification of trends, patterns, and emerging risks and facilitates effective information sharing among relevant stakeholders within the broader incident response and risk management processes. | AddressesOversightIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Secure External AI Incident SharingThe organization establishes secure and compliant channels for sharing sensitive information related to AI risks and incidents with external stakeholders (e.g., industry peers, academic researchers, regulators, information sharing databases) to promote collective learning and improvement while protecting confidential and proprietary data. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Post-Incident Review and ImprovementsThe organization conducts regular post-incident reviews and root cause analyses to identify improvements in AI testing, incident identification, and information sharing. These reviews should be integrated into the organization's ongoing development cycle to inform continuous improvement of AI systems, practices, and safety measures. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| External Stakeholder Feedback ChannelsThe organization identifies relevant external stakeholders (e.g., users, customers, community groups, subject matter experts) and establishes clear, ongoing channels (e.g., surveys, focus groups, forums, feedback mechanisms) for collecting feedback on potential individual and stakeholder group impacts of its AI systems throughout the system lifecycle. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Stakeholder Feedback Policy and PrioritizationThe organization develops high-level policies and guidelines for collecting, considering, and prioritizing external stakeholder feedback, ensuring that feedback is effectively communicated to AI development and deployment teams for incorporation into decision-making processes. | AddressesStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Industry Collaboration and Responsible AIThe organization actively participates in industry initiatives and collaborates with external stakeholders to promote responsible AI development and deployment, sharing experiences, contributing to best practices, and staying informed of emerging trends and concerns related to AI risks. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Stakeholder Engagement Processes in Development and DeploymentThe organization establishes clear processes and channels for AI development and deployment teams to regularly engage with relevant AI stakeholders (e.g., end-users, subject matter experts, impacted communities). These interactions involve gathering feedback through various methods (e.g., surveys, interviews, focus groups, workshops), fostering an inclusive and collaborative environment. | AddressesSystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Feedback Evaluation and PrioritizationThe AI development team develops criteria and guidelines for evaluating and prioritizing feedback from AI stakeholders, considering source credibility, potential impact on system performance, and alignment with organizational goals and values. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Feedback Conflict ResolutionThe organization establishes a transparent, fair, and accountable process for adjudicating and resolving conflicting feedback from AI stakeholders, which includes evaluating the merits of feedback, considering trade-offs, and engaging in constructive dialogue. | AddressesAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Impact Assessments with Stakeholder InputAI development and deployment teams conduct impact assessments that incorporate external stakeholder feedback, often mediated through user-facing functions (e.g., product management or customer success), and other relevant data to understand potential impacts. Assessment results inform AI system design and deployment decisions, helping to proactively identify and mitigate risks. Teams ensure that feedback collected and processed through these functions is documented and integrated throughout the system lifecycle. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Stakeholder Feedback Education and TransparencyThe organization educates stakeholders on effectively submitting feedback, communicates the process for how feedback is handled, and regularly informs them about how their feedback has been incorporated into AI system design and implementation (e.g., via reports, case studies, public forums), thereby promoting transparency, trust, and demonstrating its commitment to responsible AI development and deployment. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party AI Evaluation and SelectionThe organization establishes processes for evaluating and selecting third-party AI technologies based on criteria that assess security and privacy implications, integrating AI-specific considerations into third-party procurement planning, due diligence, evaluation, and contracting practices to create alignment with organizational risk management policies. | AddressesAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party System RequirementsThe organization identifies and documents AI system requirements that may be specific to a third party to inform procurement planning, due diligence, and contracting. | AddressesAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Procurement and AI Partner EvaluationThe organization updates its procurement planning processes to integrate AI-specific requirements so that procurement activities consider AI's unique implications and challenges associated with third-party partnerships. It also emphasizes the importance of participating in joint testing with third-party entities to collaboratively evaluate AI technologies and validate their effectiveness and compliance with organizational standards. | AddressesAuditabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Due Diligence for AI VendorsThe organization enhances its policies and procedures and provides adequate resources for conducting due diligence on third-party entities by incorporating AI-related considerations, including data provenance, secondary data use, and vendor data practices. This involves assessing intellectual property and data management specific to AI to inform more comprehensive risk-benefit assessments for AI-related partnerships. The due diligence process emphasizes negotiating contractual provisions that protect against data misuse, ensure data quality, and secure appropriate data rights. | AddressesAuditabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party AI Risk DocumentationThe organization reviews and updates its existing documentation of AI risks associated with third-party entities (e.g., intellectual property infringement, data privacy, security, data provenance, and secondary data use by vendors) to include AI-specific factors. This documentation is regularly reviewed and adapted to address emerging AI-related risks, including specific considerations around data sourcing, management, and vendor data practices. Additionally, it clarifies AI risk management responsibilities within a shared responsibility model, helping all parties understand their roles in mitigating AI-related risks. | AddressesOversightAuditabilityAccountabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Fourth-Party Disclosure and TerminationThe organization recognizes the risks associated with fourth parties—entities utilized by third parties—by requiring third parties to disclose their own third-party relationships and any associated risks. In cases where significant risks are identified, the organization establishes clear guidelines for terminating third-party contracts to protect its interests and mitigate potential harm. | AddressesIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| System Requirements Review and UpdatesThe organization creates a plan for regular reviews and updates of third-party system requirements throughout the AI lifecycle, allowing for the identification of emerging risks and the incorporation of feedback from relevant AI stakeholders. | AddressesOversightIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party Concentration Risk ManagementThe organization addresses aggregate third-party concentration risk by encouraging diversification of partners and thorough assessments of potential vulnerabilities associated with reliance on a limited number of third-party AI providers. | AddressesAuthorityIdentitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party AI Compliance MonitoringThe organization strengthens its monitoring and auditing processes for third-party AI partners by integrating AI-specific compliance obligations related to data management and security standards, while establishing mechanisms to address any AI-related issues identified. | AddressesOversightAuditabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party AI Incident ProtocolsThe organization modifies its protocols for handling incidents or breaches related to third-party AI risks to include provisions for addressing data provenance issues, secondary data use, and other third-party data-related vulnerabilities. These protocols should encompass prompt reporting, investigation, impact assessment, and remediation, with an emphasis on contractual enforcement and negotiation strategies. | AddressesAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Third-Party Training and ResourcesThe organization revises its training and resources for personnel managing third-party relationships to include AI-related content, focusing on the nuances of due diligence, contract negotiation, and risk assessment in the context of AI. This training is regularly updated to reflect changes in AI policy and industry best practices. | AddressesIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party AI Contingency PlansThe organization develops or updates existing contingency plans for potential failures or incidents in high-risk third-party AI systems and data, defining roles and responsibilities for key stakeholders (e.g., IT, legal, communications, senior leaders) and outlining specific response steps (e.g., system isolation, data recovery, public relations). These plans should also consider emerging risk transfer mechanisms such as AI insurance policies or special provisions in cyber insurance tailored to AI risks. | AddressesAccountabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Failure and Incident Communication ProtocolsThe organization establishes communication protocols to enable timely, accurate, and consistent notification of relevant stakeholders (e.g., customers, regulators, media) in the event of failures or incidents. These protocols utilize predefined templates, approval processes, and designated spokespeople. Regular tabletop or simulation exercises should be conducted to test and refine communication readiness. | AddressesAuthority | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| SLAs and Contracts with AI VendorsThe organization establishes service level agreements (SLAs) and contractual provisions with high-risk third-party AI providers, defining obligations, liabilities, remedies, performance metrics (e.g., uptime, error rates), incident reporting requirements, and corrective action procedures. Contracts should include provisions addressing specific risks, such as indemnities or coverage related to AI-related damages, and consider negotiations around AI insurance and risk transfer. These agreements are regularly reviewed and updated. | AddressesOversightAccountabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Monitoring and Early Warning SystemsThe organization implements logging, monitoring, and early warning systems to detect potential failures, anomalies, or breaches in high-risk third-party AI systems, triggering investigations and responses. Regular audits and assessments drive compliance and identify areas for risk management improvement. | AddressesOversightAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Purpose and Context DocumentationThe organization identifies and documents the AI system’s purpose, context, beneficial uses, user types and expectations, relevant laws, norms, and prospective deployment settings. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Impact and Stakeholder Impact AssessmentThe organization considers the potential positive and negative impacts of the AI system in collaboration with a multidisciplinary set of relevant stakeholders (e.g., domain experts, human factors experts, affected communities) throughout its lifecycle. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Assumptions, Risks, and TEVV DocumentationThe organization identifies and documents assumptions, limitations, and potential risks throughout the AI system’s lifecycle. Testing, evaluation, verification, and validation (TEVV) requirements and system metrics to identify, monitor, and manage associated system risks are identified. | AddressesAuthorityOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Non-AI Alternatives EvaluationThe organization considers non-AI alternatives and documents the comparative analysis and decision rationale. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Multidisciplinary AI Impact TeamsThe organization recruits, supports, and facilitates documented collaboration among multidisciplinary teams throughout the AI system lifecycle (from problem formulation to monitoring). This enhances comprehensive risk analysis, bias mitigation, and thorough consideration of potential impacts. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Alignment with Mission and ValuesThe organization identifies and documents the AI system’s alignment and contribution to organizational mission, values, goals (including relevant goals for AI technology), and AI Trustworthy Principles. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Purpose and Context ReviewThe organization establishes plans to review and update the AI system’s documented purpose and context to drive ongoing alignment with the organization's evolving mission, goals, and AI Trustworthy Principles. The organization regularly re-evaluates the business value and context of use for existing AI systems to validate alignment. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Business Value and Context CommunicationThe organization clearly defines, documents, and communicates the business value, objectives, and intended context of use for each AI system to relevant stakeholders, promoting alignment with organizational goals and facilitating transparency and accountability in how the AI system supports operational success. | AddressesAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Tolerance DefinitionsThe organization defines, develops, and documents risk tolerances for AI systems, considering different risk types (e.g., financial, operational, safety, reputational), sources, and levels (e.g., from negligible to critical), with awareness and oversight from senior leadership and the board where appropriate. | AddressesOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Design Decision Rationale DocumentationThe organization documents and communicates AI design decisions and risk tolerances, ensuring they align with stakeholder requirements, values, and trustworthiness principles. This process includes input from leadership and the board to support decision-making that balances risks, intended use, and organizational risk appetite. | AddressesAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Requirements from StakeholdersThe organization engages relevant AI stakeholders (e.g., end-users, domain experts, impacted communities) to elicit and document system requirements that address AI risks and promote trustworthy characteristics (e.g., security, fairness, transparency, accountability). | AddressesAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Data Interdependency and Provenance DocumentationThe organization documents the AI system's internal and external data interdependencies, including data provenance from a privacy perspective. This process identifies and assesses potential negative impacts stemming from these connections, informing risk thresholds, deployment decisions, and operational management decisions. | AddressesOversightAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Context-Informed Data DesignThe organization conducts research to understand the potential limitations of data that may affect the specific uses of the AI system, and uses this understanding, along with insights on values, contexts, and systemic and historical considerations, to inform data selection and representation in the AI system design process. | AddressesAuthoritySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Learning and Decision TasksThe organization defines and documents the AI system's existing and potential future learning and decision-making tasks (e.g., classification, generation, recommendation, prediction), considering fit-for-purpose, scalability and adaptability. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Assumptions and Limitations DocumentationThe organization documents the assumptions and limitations associated with the AI system's existing and potential learning tasks, considering factors such as data availability, model performance, human-AI interaction, irreversibility of actions, and computational resources. | AddressesAuthorityAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Learning Tasks Review and UpdatesThe organization creates a plan for regular reviews and updates to documented learning tasks, assumptions, and limitations as the AI system evolves or as new requirements arise. | AddressesAuthorityOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Usage and Boundary DocumentationThe organization documents the settings, environments, and conditions that are within the AI system’s intended use, defining the boundaries of its applicability while considering knowledge limits and areas where human intervention and irreversibility of decisions is crucial. | AddressesAuthorityOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Interdependencies and DependenciesThe organization documents the AI system's interdependencies, including both upstream and downstream data sources, as well as human dependencies, clearly identifying where the system relies on input from other automated systems or human operators. | AddressesAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Development and Operation DocumentationThe organization documents assumptions, limitations, techniques, and metrics used for development or operation of the AI system throughout the lifecycle, aligning with data governance policies. This includes documenting data selection, curation, preparation, and analysis techniques, as well as identifying modeled constructs and methods for inferring reasonable relationships between constructs and dataset attributes. | AddressesAuthorityAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| TEVV Protocols and StandardsThe organization establishes and documents testing, evaluation, verification, and validation (TEVV) protocols for AI models, systems, and their subcomponents, covering the AI lifecycle from design to deployment and operation. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Experimental Design and Statistical MethodsThe organization identifies valid experimental design and statistical techniques for testing complex AI systems, considering human factors, emergent risks, and dynamic contexts of use as relevant to the AI system. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Validation Metrics and RationaleThe organization demonstrates that AI system performance and validation metrics are interpretable, unambiguous, and relevant to the context of use, with the rationale for their selection clearly documented. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Design and Deployment Validation FeedbackThe organization establishes regular communication and feedback mechanisms among relevant AI stakeholders to validate design and deployment assumptions, which informs the development of TEVV (test, evaluation, verification and validation) approaches for detecting and assessing potential harmful impacts. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Testing Limits and ConstraintsThe organization clearly defines and documents the limits of testing, including any claims about the system that are not falsifiable, and specifying what can and cannot be tested to maintain transparency regarding residual risks. | AddressesAuthorityAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Design and Deployment AlignmentThe organization considers design strategies, testing strategies, implementation strategies, and deployment of AI systems in the context of potential impacts, organizational AI system goals, and alignment with organizational objectives, values, and AI Trustworthy Principles. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Impact Feedback from Multidisciplinary TeamsThe organization solicits feedback from a multidisciplinary design and development team, augmented by additional stakeholders as needed, to identify and document the potential positive impacts of the AI system within its intended context of use. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| User Interface and Interpretability DesignThe organization designs and documents the AI system's user interface, workflows, and interpretability criteria in collaboration with end users, incorporating their feedback to enhance system benefits and understanding while recognizing the role of human interaction in interpreting system outputs. | AddressesAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI System Justification and Cost-BenefitThe organization documents the rationale for using an AI system, including a comparative analysis of the benefits, risks, and costs associated with the AI system versus non-AI alternatives. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Cost and Impact AssessmentThe organization considers and documents potential monetary and non-monetary costs and potential impacts, including system performance, functionality, and trustworthiness, in alignment with its risk tolerance. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Application Scope DefinitionThe organization defines, specifies, and assesses the AI system's targeted application scope, considering its capabilities, limitations, context, and categorization. The organization engages relevant stakeholders (e.g., domain experts, end users) to validate the targeted application scope, aligning it with the AI system's intended purpose and organizational goals and AI Trustworthy Principles. | AddressesAuthority | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Operator and Practitioner Proficiency LevelsThe organization defines and documents required proficiency levels for operators and practitioners interacting with the AI system, considering performance and trustworthiness characteristics, as well as relevant technical standards and certifications. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Proficiency Assessment and Maintenance PlanThe organization maintains the proficiency of operators and practitioners concerning the AI system's operation, risks, limitations, and knowledge boundaries. This is achieved through a structured proficiency assessment and maintenance plan encompassing regular training, certification, and evaluation programs. The plan incorporates continuous monitoring and performance metrics to identify areas for improvement and adapt training as needed, ensuring sustained capability for safe and effective AI system management within its sector and context of use. | AddressesAuthorityOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Operator and End-User Testing and FeedbackThe organization involves operators, practitioners, and end users in AI system prototyping and testing activities to gather feedback on performance and trustworthiness, validating human-AI configurations and identifying requisite proficiency levels and training needs. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Human Oversight Roles and ResponsibilitiesThe organization defines and documents roles and responsibilities for human oversight of the AI system, considering its capabilities, context of use, potential risks, and knowledge limits. | AddressesAuthorityOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Oversight Training and ResourcesThe organization provides training and resources to individuals responsible for human oversight of the AI system, equipping them with the necessary skills, knowledge, and authority to perform their roles effectively. | AddressesAuthorityOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Criteria and Thresholds for InterventionThe organization documents and communicates criteria and thresholds for human intervention in AI system operation, procedures for escalating issues, and guidelines for making oversight decisions. Wherever possible, these criteria are embedded within the AI systems to facilitate timely human intervention. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Oversight Effectiveness Evaluation and ImprovementThe organization documents and reviews processes to regularly evaluate the effectiveness of human oversight mechanisms through qualitative and quantitative methods, such as audits, performance evaluations, and stakeholder feedback, while implementing a plan to assess human oversight and update documentation based on changes in the AI system's capabilities, context of use, or identified risks. These evaluations inform continuous improvement efforts and maintain alignment with governance policies. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Legal Risk Management ProcessesThe organization documents processes for identifying, mapping, assessing, and managing potential legal risks associated with the AI system and its components, including, but not limited to, fair lending practices, model risk, data privacy, intellectual property, third-party rights, and the use of third-party data or software, as available. | AddressesAuthorityAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party Resource DocumentationThe organization maintains documentation of third-party AI resources used in its AI systems, including information on provenance, functionality, limitations, and potential risks, regularly updating this documentation as new information becomes available. | AddressesAuthorityAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Legal Risk Communication and UpdatesThe organization communicates identified legal risks associated with the AI system, and relevant changes in laws, regulations, and industry standards, to relevant stakeholders (e.g., developers, users, decision-makers), facilitating informed decision-making and effective risk mitigation. | AddressesStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Internal Controls for AI ComponentsThe organization identifies and documents internal controls for AI system components, including third-party technologies, to mitigate potential risks and drive system integrity. This includes mapping identified risks to the corresponding internal controls. | AddressesAuditabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Controls Effectiveness and Incident ResponseThe organization regularly documents and reviews the effectiveness of internal risk controls and incident response procedures for both AI system components and third-party technologies, documenting results and implementing improvements to drive secure and reliable operation. | AddressesOversightAuditabilityAccountabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Identification, Assessment, and PrioritizationThe organization documents processes for identifying, assessing, and prioritizing AI system-specific risks, including the likelihood and magnitude of potential impacts (beneficial and harmful), using structured methodologies (e.g., risk matrices, RAG ratings, econometric approaches), TEVV practices, and adversarial testing to uncover potential misuse, vulnerabilities, unintended consequences, and content provenance harms (e.g., misinformation, deepfakes). | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Profile DevelopmentThe organization develops comprehensive risk profiles (from all risks identified throughout MAP) that outline known and potential adverse outcomes, direct costs, indirect costs, potential systemic risks to markets and consumers, and the degree of impact on the AI system and its stakeholders, and the speed of onset of these risks. | AddressesSystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Decision Rationale and Stakeholder ValidationThe organization documents the rationale behind its risk prioritization decisions and risk tolerance, including the factors considered, trade-offs made between different risk response options, and input received from relevant stakeholders, while also engaging these stakeholders (e.g., technical experts, domain specialists, impacted communities) to validate its decisions on risk prioritization, risk appetite and tolerance, and resource allocation, thereby incorporating multidisciplinary perspectives into the risk response process. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Structured AI stakeholder EngagementThe organization documents processes for regularly engaging relevant AI stakeholders (e.g., end-users, domain experts, potentially impacted communities) using structured methodologies such as value sensitive design (VSD) to gather feedback on the specific AI system's performance, impacts, and unanticipated consequences. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Stakeholder Engagement and MitigationThe organization engages with relevant stakeholders to solicit context-specific insights and to develop action plans that detect, prevent, and mitigate potential risks, costs, or adverse impacts. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Metrics and Measurement SelectionThe organization selects and prioritizes significant AI risks for measurement and monitoring, defining metrics and measurement approaches that consider the AI system's specific context, intended use, and potential impacts on stakeholders. The organization documents the rationale for the selection of specific metrics and measurement approaches, including their relevance, feasibility, and limitations in relation to the AI system and its associated risks. The organization determines that measurement and testing are complete when prioritized risks have been tested, measured, and tracked, and no new or serious risks have emerged. | AddressesAuthorityOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Unmeasurable Risks and Rationale DocumentationThe organization identifies and documents AI risks and/or trustworthiness characteristics that cannot or will not be measured, along with the reasons for exclusion. Recognizing that some risks may be difficult to measure quantitatively, the organization also considers tracking these risks qualitatively to ensure they are acknowledged and monitored as appropriate. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Error and Incident Data AnalysisThe organization collects and analyzes error reports, incidents, and potential impacts associated with its AI systems, using this information to assess the effectiveness of existing risk controls and the validity of current metrics. Recognizing that metrics can be subject to issues such as calibration drift, bias, measurement uncertainty, and Goodhart's law, the organization regularly reviews whether the metrics remain meaningful and reliable in the evolving context. | AddressesOversightDriftAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Independent Expert Evaluation and Stakeholder ConsultationThe organization involves internal experts (external to front-line development) and independent assessors, including robust testing functions, in the regular assessment and updating of AI metrics and risk controls. Concurrently, it determines the need for consultation with domain experts, users, AI stakeholders external to the development team, and affected communities, based on risk appetite. This approach leverages multidisciplinary, unbiased insights to ensure a comprehensive understanding of potential impacts and the adequacy of risk management measures. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| TEVV Test Data and Metrics DocumentationThe organization documents test sets and metrics used during the testing, evaluation, verification, and validation (TEVV) of its AI systems. The documentation includes relevant information on test sets, such as data sources, preparation techniques, data splits (e.g., training, validation, and testing), and identified constraints or limitations. Metrics are documented with clear definitions, formulas, and rationale, along with any assumptions and limitations. | AddressesAuthorityAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| 2. TEVV Tools and Configuration DocumentationThe documentation of tools used during TEVV includes details on the software packages, libraries, frameworks, and hardware components employed, specifying their versions, configurations, and implemented customizations. The organization confirms that the tools and their configurations are appropriate for the specific AI system and its intended use case. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Centralized TEVV Repository and AccessThe organization maintains a centralized repository for TEVV documentation, promoting accessibility to relevant stakeholders and enabling updates and version control as the AI system evolves. The repository is organized to facilitate efficient retrieval and review of TEVV documentation, and access controls are implemented to ensure data security and privacy. | AddressesAuthorityOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Human Subject Use and ConsentThe organization conducts evaluations involving human subjects—potentially including focus groups, small group studies, UI/UX research, surveys for publications, structured experiments, large-scale A/B testing, or extensive human data collection—in compliance with relevant laws, regulations, guidelines, and organizational policies. It ensures clear communication of the purpose, nature, risks, and benefits to participants, protection of any human-subjects data, and obtaining informed consent prior to participation. The organization documents the specific requirements followed, the consent procedures used, and the nature of the research to ensure transparency and adherence to standards. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Representation and Recruitment ProcessThe organization takes steps to ensure human subjects involved in AI system evaluations are sufficiently representative of the relevant population. It documents the recruitment and selection process used, including the criteria applied to promote a balanced and representative sample. The organization acknowledges limitations or potential biases in the subject population that could not be fully addressed. | AddressesAuthorityAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Adverse Event Monitoring and ReviewThe organization has procedures in place to monitor for and document adverse events or unintended consequences experienced by human subjects during the evaluation process, such as errors in testing or negative impacts. It takes appropriate measures to address and mitigate these issues when they occur. The organization conducts post-evaluation reviews to identify lessons learned from any adverse events in order to drive improvements to its human subject evaluation practices. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Performance and Assurance CriteriaThe organization defines clear performance and assurance criteria for its AI systems that are tailored to the specific intended use cases, deployment settings, and stakeholder expectations associated with each system. The organization engages a range of relevant stakeholders to review and validate that the selected measures are appropriate and meaningful for assessing the system in its real-world context of use. The stakeholder engagement process and key feedback are documented. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Measurement Methods and ResultsThe organization selects and applies a combination of quantitative and qualitative measurement methods to rigorously evaluate each AI system's performance and assurance characteristics, based on the specific criteria defined for that system. Quantitative measures may include established metrics appropriate for regression, time-series, classification, information retrieval, clustering, dimensional reduction, natural language processing or other tasks. Qualitative measures may include user feedback, expert reviews, and assessments of explainability, usability and accessibility. The measurement approaches and results are documented. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Performance Analysis and TrendsThe organization analyzes the quantitative and qualitative measurement methods and results used to evaluate AI system performance and assurance across its AI systems. It identifies patterns, trends, and outliers in the results to pinpoint areas for improvement in its AI system measurement practices. The organization documents how its measurement approaches and results evolve over time, using these insights to drive continuous improvement. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Performance Under Realistic ConditionsThe organization demonstrates and documents AI system performance and assurance under realistic conditions that closely approximate the intended deployment settings. Key factors, such as data quality, user interactions, and environmental variables, are considered. Limitations in replicating the deployment environment are documented and communicated to stakeholders, along with plans to address them. | AddressesAuthorityAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Monitoring and Anomaly DetectionThe organization monitors the functionality, reliability, and behavior of the AI system and its components in production, as identified during the MAP function. It implements both manual and automated monitoring tools and processes, including statistical quality control (SQC) approaches, to continuously gather data, alerting stakeholders to any deviations or anomalies. | AddressesOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Performance Tracking and ImprovementThe organization systematically analyzes production data to track system performance and reliability over time, comparing real-world metrics against pre-deployment expectations. This analysis includes evaluating error propagation, identifying feedback loop risks, and assessing whether the AI system is adapting appropriately to changing conditions, using statistical quality control methods to detect shifts, trends, and assignable causes. Findings from these evaluations inform iterative improvements. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Monitoring IntegrationThe organization integrates AI-specific monitoring activities with its broader system-wide monitoring framework. AI-related performance and reliability metrics, anomaly detection signals, decision logs, and statistical quality control indicators are incorporated into existing monitoring platforms and operational dashboards. This allows AI-related alerts to be contextualized alongside other system indicators, enabling a holistic response to incidents. | AddressesOversightAuditabilityAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Incident Investigation and Root Cause AnalysisThe organization conducts structured investigations, integrating with existing incident management processes where appropriate, using root cause analysis methodologies when anomalies or failures are detected. These investigations consider factors such as data integrity, model biases, potential unintended consequences, and statistical quality control evidence supporting identified causes. Corrective actions to restore reliability are documented and integrated into future risk mitigation strategies. | AddressesAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Validation and Reliability Testing ProcessThe organization implements a structured validation and reliability testing process that incorporates performance metrics aligned with real-world deployment conditions, including measures for robustness against distribution shifts, stress testing under varying operational scenarios, and adversarial testing, with oversight or input from the MRM program and independent model validation functions. The organization establishes and documents acceptance criteria based on statistical confidence levels. | AddressesOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Validation Results and ImprovementThe organization documents validation results, comparing actual system performance against expected outcomes. This documentation includes model confidence intervals, performance degradation patterns, failure scenarios, and assumptions made during testing, and these outputs are reporting the MRM program and reviewed by model validation functions. The organization continuously refines system components based on identified weaknesses. | AddressesOversightDriftAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Generalization and Bias AssessmentThe organization conducts evaluations to assess how well the AI system generalizes beyond its training conditions, measuring the impact of data variations, shifts in contextual factors, potential biases introduced by unseen inputs, and to establish knowledge limits. Domain expertise is leveraged to interpret results and determine system limitations. | AddressesAuthority | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Safety Risk Assessments and Stress TestingThe organization conducts regular safety risk assessments of its AI systems, focusing on risks identified during the MAP function, including systemic risk to markets or consumers. These assessments include stress testing under various conditions, considering historical system failures in similar domains. The results, including identified safety concerns, failure points, and mitigation strategies, are documented and integrated into the risk management lifecycle. | AddressesAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Controlled Failures and Fail-Safe MechanismsThe organization demonstrates the AI system's ability to operate safely under normal conditions and fail in a controlled manner when exceeding its knowledge limits through scenario-based testing. The organization implements and assesses fail-safe mechanisms to minimize harm. | AddressesAuthority | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Security and Resilience Improvement Processhe organization maintains a structured approach to AI system security and resilience, integrating with existing security and resilience program processes, ensuring that defenses address AI-specific threats. Regular reviews of AI system security logs, adversarial testing outcomes, historical incident intelligence (including documented misuse such as fraud, extortion, and model reverse-engineering), and current threat intelligence guide refinements in AI system security configurations, access controls, and response protocols. Changes to AI-specific defense mechanisms, model resilience strategies, and failure response protocols are formally documented. | AddressesAuthorityOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Security and Resilience TestingThe organization conducts regular security and resilience evaluations for its AI systems, aligning these efforts with risks and vulnerabilities identified during the MAP function. These assessments include red teaming exercises, penetration testing, and stress testing. Findings from these evaluations are documented and used to refine AI-specific and enterprise-wide security strategies. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Ongoing AI Risk and Threat AssessmentsThe organization conducts ongoing reviews of AI system-specific risks and, as warranted by the risk level of the AI system, performs structured assessments tailored for AI systems, such as adversarial role-playing, impact assessments, red-teaming, and chaos testing. These assessments are designed to identify potential failure modes, emergent risks, and content-related challenges (e.g., misinformation, disinformation, deepfakes, tampered content) relevant to the AI context, supporting proactive risk identification and mitigation. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Security Metrics and Log MonitoringThe organization defines and tracks AI security and resilience metrics, ensuring alignment with existing enterprise-wide cybersecurity and IT resilience frameworks. AI-specific security logs and monitoring outputs are integrated into centralized security information and event management (SIEM) systems. Regular audits ensure that AI systems are held to the same security and resilience standards as other critical IT assets. | AddressesOversightAuditabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Transparency and Accountability EvaluationThe organization assesses AI system transparency and accountability by evaluating the effectiveness of mechanisms that provide clear, accessible information to users, stakeholders, and non-technical actors. This includes reviewing explanations, disclosures, and communication channels, as well as interpretability methods that contextualize technical explainability for human understanding. Findings inform updates to governance policies, training, and user guidance to enhance transparency and facilitate effective oversight and human intervention. | AddressesOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Metrics for Transparency and AccountabilityThe organization establishes and monitors metrics to measure the transparency and accountability of its AI systems, including the effectiveness of explainability features, the clarity of disclosures, and the resolution times for escalated decisions. It also assesses the quality of communication to non-technical stakeholders (e.g., clear explanations, adverse action notices, appeal processes) to ensure information is accessible and meaningful. Regular review of AI system logs and stakeholder feedback helps identify trends and refine accountability mechanisms, supporting effective oversight and human intervention. | AddressesOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Model Explainability and ValidationThe organization provides clear and structured explanations of its AI models (e.g., design choices, training data sources, feature importance, decision pathways) that serve as the underlying reasons behind outcomes. The model validation process includes testing for stability, fairness, and performance across various conditions, with specific attention to potential biases and limitations. The organization employs interpretable models or post-hoc explainability techniques where possible and ensures that AI outputs align with intended policies and AI Trustworthy Principles. | AddressesAuthority | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Interpretability and Decision ContextThe organization ensures that AI-generated outputs are interpreted in context, helping users understand how decisions were reached and their potential limitations. Decision rationales are structured to be accessible to technical teams, end-users, and external stakeholders, ensuring they align with the expected use case, audience expertise, and impact considerations. The organization integrates human oversight mechanisms where necessary and leverages explainability testing methods to validate the clarity and effectiveness of AI-generated explanations. | AddressesAuthorityOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Initial Privacy Risk AssessmentThe organization conducts an initial examination of the privacy risks associated with its AI systems, as identified during the MAP function, and documents the results of this examination, including any identified privacy issues, concerns, or potential violations specific to AI systems. It establishes accountability mechanisms for managing AI-related privacy risks and incidents, such as data breaches or unauthorized access, and assigns clear roles and responsibilities for privacy risk management. | AddressesAuthorityAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Ongoing AI Privacy Risk Assessment, Monitoring, and VerificationThe organization conducts ongoing privacy risk assessments, and actively monitors and verifies privacy risks throughout the AI lifecycle. This includes techniques such as PIAs, data flow mapping, adversarial testing, and re-identification risk analysis, focusing on risks like re-identification, inadvertent data leaks, or malicious data exfiltration through AI system outputs. These activities evaluate and verify the effectiveness of privacy controls, including anonymization methods, with findings documented and used to continuously improve privacy safeguards and risk management practices. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Data Consent and ManagementThe organization establishes procedures for tracking and managing data subject consent, including documenting consent statuses, handling data access requests, and ensuring compliance with legal and regulatory requirements. These procedures prevent use of withdrawn or erased data both during training and post-deployment. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Context-Specific Fairness and Bias EvaluationThe organization conducts evaluations of fairness and bias in its AI systems, focusing on any regulatory requirements and the risks and potential impacts identified during the MAP function. The organization employs techniques and tools to assess fairness and bias, examining potential sources of bias throughout the AI lifecycle, including systemic bias, statistical and computational bias, and human cognitive bias. Based on the evaluation results, the organization develops and implements strategies to mitigate or manage identified biases and fairness issues. The organization documents the results of its fairness and bias evaluations, including identified issues and mitigation strategies. | AddressesAuditabilitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Resource Efficiency AssessmentThe organization conducts an assessment of the resource efficiency of its AI systems across their entire lifecycle. This assessment evaluates energy consumption, resource utilization, and the efficiency of AI infrastructure. The results are documented, including identified opportunities for optimization. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Metrics and Monitoring of AI Resource EfficiencyThe organization establishes metrics and monitoring processes to track the effectiveness of its AI resource efficiency efforts. It regularly reviews and updates its resource efficiency assessment and optimization strategies based on new data, technologies, and best practices in efficient AI. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Optimization Strategies for AI Resource EfficiencyThe organization ensures that the systems continue to deliver value and meet performance objectives through measurement of AI resource efficiency. These strategies consider the specific performance requirements and operational contexts of each AI system. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| TEVV Process Review and Continuous ImprovementThe organization schedules regular reviews and continuously monitors and updates its TEVV processes. This ensures accuracy, completeness, and alignment with industry best practices, regulatory requirements, evaluation results, stakeholder feedback, and evolving industry standards. The review process incorporates lessons learned from each iteration and reflects pertinent changes in testing methodologies or tools, with frequency determined by AI system complexity, risk profile, and pace of development. All updates are documented to maintain effectiveness, efficiency, and alignment with AI risk management goals. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| TEVV Metrics AnalysisThe organization regularly evaluates the effectiveness of its TEVV metrics, including trustworthiness characteristics and environmental metrics, and continuously monitors and updates them. It assesses whether these metrics effectively identify and mitigate risks within acceptable levels defined by its risk appetite. Results, strengths, weaknesses, and areas for improvement are documented, and corrective actions are taken to refine the TEVV approach, ensuring continuous improvement and alignment with AI risk management goals. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Cost-Effectiveness and Optimization of TEVVThe organization analyzes the efficiency and cost-effectiveness of its TEVV metrics and processes, considering the level of risk associated with each AI system and the potential impact of system failures or performance issues. The organization evaluates the cost of implementing and maintaining each TEVV measure relative to the expected risk reduction benefits it provides, prioritizing investments in the most critical and impactful measures. The results of this analysis, including key cost, risk, and optimization trade-offs, are documented and regularly reviewed to inform ongoing refinements to the organization's TEVV strategy and practices. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Tracking and Resource AllocationThe organization allocates resources to support an approach for identifying and tracking AI risks. This approach includes monitoring AI system performance, considering the nature of AI risks, and analyzing external factors such as operational environment changes, stakeholder feedback, and industry developments. Resources are allocated to develop and implement AI risk management techniques, addressing opacity and explainability challenges. The organization reviews and adjusts resource allocation to ensure the effectiveness of its AI risk identification and tracking processes, adapting to the evolving regulatory landscape. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Documentation and ReviewFor each AI system, the organization documents the identified risks, their likelihood and potential impact, and the effectiveness of risk tracking methods employed. The documentation includes methodologies, tools, data sources, and personnel roles and responsibilities. The organization reviews and updates this documentation to reflect changes in the AI system's risk profile and assesses the effectiveness of its risk identification and tracking processes to drive continuous improvement. | AddressesOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Measurement Technique Gap AnalysisThe organization identifies AI risk scenarios where current measurement techniques may be unavailable or insufficient, documenting these scenarios and limitations. It explores alternative risk tracking approaches and evaluates the suitability of each approach, considering data availability, interpretability, and the ability to incorporate domain knowledge. The selection of modeling techniques is guided by the AI system's characteristics, the nature of the risks, and risk management objectives. The rationale for the chosen approaches, assumptions, and limitations is documented. | AddressesAuthorityAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Pilot Studies and Approach RefinementThe organization conducts pilot studies or proof-of-concept trials to test the feasibility and effectiveness of alternative risk identification and tracking approaches, based on best practices, industry trends, collaborative endeavors, and internal innovation, in real-world settings, documenting lessons learned, limitations encountered, or areas for further refinement. | AddressesAuthorityAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Long-term Impact Evaluation FrameworkThe organization develops a framework for evaluating the long-term impacts of deployed AI systems on organizational objectives and AI Trustworthy Principles, ensuring sustained value and alignment with evolving expectations. | AddressesStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Feedback and Appeals ProcessesThe organization establishes feedback processes for relevant stakeholders to report problems, concerns, or unintended consequences related to AI system outcomes, integrating with existing processes for reporting security issues and potential vulnerabilities. This includes implementing an appeals mechanism that allows users to challenge or request reviews of outcomes they believe to be inaccurate, unfair, or harmful. Both processes are documented clearly, including channels, timeframes, responsibilities, escalation procedures, and criteria for decision-making, with all reported issues tracked to closure. | AddressesOversightAuditabilityAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Feedback Integration and Process RefinementThe organization integrates user feedback and appeal data into its AI system evaluation metrics, tracking key indicators to identify patterns or systemic issues related to AI system outcomes. Feedback and appeal processes are continuously monitored and refined based on user input, system performance data, and evolving best practices, with refinements documented to ensure the processes remain effective, inclusive, and aligned with the organization's AI governance framework. | AddressesOversightAuditabilitySystemic behaviorStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Context-Specific Risk IdentificationThe organization reviews AI risk identification processes for alignment with the specific deployment context(s) of its AI systems, considering intended use cases, user populations, operational environments, trustworthiness characteristics, and potential impacts on individuals. It actively consults with domain experts, end users, and other relevant stakeholders to gather input on risks and challenges, documenting the outcomes. Additionally, the organization documents the involvement of internal experts, independent assessors, domain experts, users, and other external AI stakeholders in the assessment process, including their contributions, recommendations, and actions taken based on their input, to ensure transparency, accountability, and a comprehensive record of the assessment activities. | AddressesOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Integration with Organizational ProcessesThe organization assesses the integration of its AI risk identification processes with other relevant organizational processes, such as cybersecurity, resilience planning, and incident management. Internal and external experts provide feedback on integration. It documents how AI risk identification aligns with and supports these processes to ensure consistency and effectiveness of risk management practices. Areas for improvement are identified and addressed. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Incorporating Real-World DataThe organization incorporates insights from user feedback, incident reports, and other real-world data sources into its AI risk identification approaches. This grounding in actual experiences and concerns of end users and impacted communities is documented, highlighting how these insights are integrated into the risk identification process. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Validation, Testing, and Effectiveness Evaluation of AI Risk ApproachesThe organization validates the efficacy of its AI risk identification approaches through targeted testing, simulations, or pilot studies in the deployment context(s). Concurrently, it regularly reviews and assesses the effectiveness of its AI risk identification and tracking approaches by evaluating the timeliness and accuracy of risk detection, risk coverage, and adaptability to changing circumstances. All results, including any limitations, assumptions, strengths, weaknesses, or areas for improvement, are documented and used to refine and continuously enhance the risk approaches. | AddressesAuthorityOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Benefits and Performance AssessmentThe organization assesses and documents the AI system's anticipated capabilities and benefits, and alignment to organizational objectives and AI Trustworthy Principles, against accepted benchmarks. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Performance Validation via Stakeholder InputThe organization actively seeks input from domain experts and relevant AI stakeholders, such as system developers, operators, users, and impacted communities, to validate whether the AI system is performing consistently as intended in its specific deployment context(s), and documents the outcomes of these consultations, including any discrepancies or concerns raised. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Analysis of Performance and Trustworthiness TrendsThe organization regularly analyzes the measurement results to identify patterns, trends, or anomalies indicating issues with AI system trustworthiness while engaging in dialogue with domain experts and relevant AI stakeholders to interpret these results and their implications. Findings are documented alongside insights, recommendations, and areas of consensus or disagreement | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Continuous Improvement of AI TrustworthinessThe organization regularly reviews and updates its risk controls and performance metrics across trustworthy characteristics based on assessment results, stakeholder feedback, and evolving risk landscapes, ensuring continuous improvement and alignment with best practices and regulatory requirements to maintain AI system trustworthiness. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Stakeholder Feedback on PerformanceThe organization engages in regular consultations with relevant AI stakeholders (e.g., system developers, operators, users, and impacted communities), to gather insights on observed performance changes. Outcomes of these consultations are documented, including areas of agreement, disagreement, or concern. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Root Cause Analysis and Action PlansThe organization conducts root cause analyses to investigate the factors contributing to identified performance changes, integrating with existing incident and problem management processes where appropriate, documenting findings along with recommended actions for sustaining improvements, mitigating declines, or addressing related risks and trustworthiness issues. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Knowledge Sharing and Industry ContributionThe organization shares its findings and receives feedback regarding measurable performance improvements or declines with the broader AI community through publications, conferences, or industry forums, contributing to collective knowledge and best practices in context-specific AI performance management and trustworthiness assurance. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI System Evaluation and Gap AnalysisThe organization establishes a formal evaluation process to determine if the AI system achieves its intended purposes and objectives, assessing performance metrics, stakeholder feedback, alignment with organizational goals and values, and the system's trustworthiness (including fairness, transparency, accountability, privacy), while identifying gaps, risks, and potential improvements. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Go/No-Go Decision CriteriaThe organization makes a determination as to whether to proceed using clear criteria and thresholds to guide decisions on whether an AI system's development or deployment should proceed, pause, or be terminated based on evaluation results, its risk tolerance, and confirmation that all identified risks and vulnerabilities have been remediated or formally accepted. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Prioritization and FrameworkThe organization prioritizes AI risks withing the existing enterprise risk framework that takes into account the impact and likelihood of documented AI risks, risk appetite and tolerance, the availability of resources, and options for risk treatment, utilizing methodologies such as risk matrices, risk scores, or multi-criteria decision analysis to ensure a consistent and transparent assessment of AI risks. | AddressesAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Framework Updates and Performance MonitoringThe organization regularly assesses and updates its risk prioritization framework and risk tolerance based on changes in the AI system's performance, the operational environment, or the availability of new risk response methods and resources. | AddressesOversightDriftStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Risk Response Strategy and OptionsThe organization responds to high-priority AI risks, considering options such as risk mitigation, transfer, avoidance, or acceptance. These strategies align with risk management policies, risk tolerance, and relevant industry standards. | AddressesStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Responsibility and Decision CriteriaThe organization assigns responsibility to a designated person, group, or role with decision-making authority to establish and document clear criteria for selecting the appropriate risk response option for each high-priority AI risk. The criteria should consider potential impact, risk appetite and tolerance, and the feasibility and effectiveness of available risk response methods. Agreed upon risk responses are tracked and monitored to closure. | AddressesAuthorityOversightAuditabilityAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Residual Risk Documentation and ManagementThe organization identifies and documents negative risks associated with its AI systems, including risks that have been accepted, transferred, or mitigated to the extent possible. For partially mitigated risks, the organization documents both the mitigated and unmitigated aspects of the risk to maintain a comprehensive view of the system's risk landscape. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Guidance for Downstream StakeholdersThe organization provides downstream acquirers and end users with guidance on the proper use, limitations, and potential risks of its AI systems, including any requirements for safe operation, decision-making considerations, or monitoring to mitigate negative residual risks. | AddressesAuthorityOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Regular Residual Risk ReviewsThe organization regularly reviews and updates its assessment and documentation of negative residual risks to ensure accuracy and relevance, considering changes in the AI system, operational environment, or risk landscape. | AddressesOversightAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Residual Risk Reporting and FeedbackThe organization maintains documentation of residual risks, including descriptions of each risk, their potential impact on downstream acquirers and end users, and the rationale and remediation status for the chosen risk treatment approach. The organization also engages with these stakeholders to gather feedback on their experiences with residual risks, using this information to support ongoing risk management and system enhancements. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Management Resource PlanningThe organization determines resource needs—such as personnel, budget, and technical capabilities—into its established risk management framework to effectively manage AI risks in alignment with organizational risk tolerance, while regularly reviewing these needs based on changes in the AI system's performance, risk profile, operational context, and evolving industry standards. | AddressesOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Resource Allocation and BudgetingThe organization allocates resources for AI risk management into its existing budgeting processes, ensuring that adequate resources are dedicated to managing AI risks effectively. This integration ensures that AI risk management resource needs are aligned with overall organizational priorities and strategies, and are considered as part of the regular budgeting cycle | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Resource Effectiveness MonitoringThe organization establishes mechanisms to monitor the effectiveness of AI risk management resource allocation, including metrics for evaluating risk reduction, impact mitigation, benefits realization, and stakeholder satisfaction. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Ongoing AI Performance and Trustworthiness MonitoringThe organization implements and applies mechanisms to sustain the performance, trustworthiness, and alignment of deployed AI systems with organizational values, norms, and risk tolerances, ensuring their continued value delivery. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Feedback-Driven System OptimizationThe organization incorporates insights gained from performance measurements, stakeholder consultations, and root cause analyses into ongoing efforts to optimize AI system performance and trustworthiness, documenting how these insights are used to inform system updates, process improvements, or risk management strategies. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Risk Control Effectiveness ReviewThe organization regularly assess and updates its AI system risk controls across trustworthiness principles as needed to maintain system value and trustworthiness. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Monitoring and Responding to Emergent AI RisksThe organization establishes practices to continuously check for unplanned or emergent risks and capabilities of the AI system, triggering a review of prior risk management and TEVV steps when such capabilities are identified. It then responds to these newly identified, emergent risks within its existing risk assessment processes, documenting steps to address previously unknown risks in deployed AI systems. These procedures include provisions for rapidly assessing the potential impact of the identified risk, along with defined escalation pathways and decision-making protocols to initiate mitigation actions as warranted. | AddressesOversightAuditabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Emergent Risk Stakeholder Communication and TransparencyThe organization communicates with relevant internal and external stakeholders in a timely and transparent fashion regarding identified emergent risks, their potential implications, and the organization's ongoing assessment and evolving management strategies. This includes utilizing pre-planned communication channels and templates, and coordinating with third parties as necessary, with an approach tailored to the unique characteristics of emergent risks. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Risk Response Team and TrainingThe organization designates and trains a cross-functional incident response team, involving representatives from relevant business units, technical teams, and risk management functions, to effectively coordinate and execute escalation procedures when a previously unknown risk is identified, including non-security incidents that may impact AI systems or business operations. | AddressesOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Performance Monitoring and Action TriggersThe organization determines when an AI system's performance or outcomes are inconsistent with its intended use, necessitating supersession, disengagement, or deactivation, and assigns specific roles and responsibilities for monitoring performance, making decisions regarding these actions, and executing them when necessary. | AddressesOversightDriftAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Disengagement Management and Post-Incident ReviewThe organization manages the consequences of AI system supersession, disengagement, or deactivation, including communication with affected stakeholders, archiving data and models, and conducting post-incident review and analysis, while also providing training and resources to ensure all relevant personnel understand their roles, responsibilities, and procedures for these actions, thereby promoting a culture of responsible AI governance. | AddressesOversightAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Technical Mechanisms for System Shutdown / DisconnectionThe organization designs, implements, and regularly tests technical mechanisms and safeguards, including fallback, rollback, contingency, and deactivation systems, for the rapid, controlled disengagement of AI systems with inconsistent performance or outcomes. Plans for disconnecting third-party services are detailed, specifying coordination, responsibilities, and decision-making to ensure seamless transitions and maintain system integrity. These measures are validated and updated based on lessons learned and industry best practices to ensure effectiveness, reliability, and to minimize negative impacts. | AddressesAccountabilityIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party Practitioner Training and CollaborationThe organization determines the needed level of third party personnel AI system proficiency and specific skills and collaborates with third party management to ensure that third party personnel receive adequate training. This training may be provided by the organization or by the third party. | AddressesIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Vendor Risk and Compliance AssessmentsThe organization integrates third-party AI resource assessments into existing vendor risk management processes, conducting periodic evaluations that identify potential AI-specific risks, vulnerabilities, and compliance gaps across technical and operational dimensions. These assessments examine AI system performance, data quality, algorithmic bias, security controls, and alignment with organizational AI principles and industry standards, with findings documented to inform risk mitigation strategies and ongoing monitoring efforts. | AddressesOversightDriftAuditabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Dependency, Aggregate, and Concentration RiskThe organization periodically assesses its portfolio of third-party AI resources to identify potential concentration risks, evaluating dependencies, vendor diversity, insourcing/outsourcing considerations, and the potential impact of over-reliance on specific third-party providers across critical AI systems and functions, with findings used to inform risk mitigation strategies and strategic sourcing decisions. | AddressesIdentitySystemic behavior | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Shared ResponsibilityThe organization applies its risk management policies, risk appetite and tolerance, and risk controls to third-party AI resources, while developing and monitoring a shared responsibility model that defines risk management responsibilities, accountability, and potential escalation procedures for the organization and third-party provider across the AI system lifecycle. | AddressesOversightAccountabilityIdentityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Third-Party AI Risk MonitoringThe organization monitors AI risks and benefits associated with third-party resources (e.g., data, models, consultants, contractors, other external personnel) throughout the AI lifecycle, including the ongoing monitoring of SLAs and contract compliance to ensure adherence to contractual commitments and mitigate associated risks. | AddressesOversightDriftIdentity | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Model Risk and Remediation ProtocolsThe organization maintains a risk management approach for pre-trained models, including developing protocols for model validation, monitoring, and potential remediation, defining model limitations, and creating frameworks for AI system adjustment, replacement, or decommissioning based on identified risks and performance metrics. | AddressesAuthorityOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Performance Deviation DetectionThe organization develops monitoring mechanisms to detect and evaluate performance deviations, risks, and behaviors of pre-trained models in production systems, tracking performance metrics across development and production contexts, establishing indicators for model drift, bias, or degradation, implementing assessment processes to identify and address emerging risks, and documenting variations in model performance. | AddressesOversightDriftAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Post-deployment OversightThe organization conducts ongoing monitoring, maintenance, and improvement of the AI systems, as well as the exploration and development of new AI-powered capabilities aligned with the organization's strategic objectives. | AddressesOversightDrift | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Vulnerability and Security ReviewThe organization has integrated its AI systems into the overall vulnerability management and security review processes, ensuring that AI-specific vulnerabilities and security risks are identified, assessed, and remediated on a regular basis, in alignment with the organization's broader cybersecurity strategy and controls. | AddressesOversight | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Application and Update ManagementThe organization has established robust application management and upgrade processes that specifically address the unique requirements and considerations of its AI systems, including the management of model updates, algorithm changes, and data updates, to ensure the continued reliability, security, and performance of the AI applications. | AddressesAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Change Management for AI SystemsThe organization incorporates AI systems into existing change management processes, conducting system updates, modifications, and decommissioning through structured approaches that include documentation, stakeholder communication, and tracking of dataset modifications (e.g., deletions, rectifications). | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Safety Metrics and Incident ResponseThe organization defines, monitors, and refines safety metrics that reflect system reliability, robustness, and failure response times. Real-time monitoring capabilities are integrated into the system to identify deviations. Incident response plans include predefined mitigation steps, communication protocols, and post-incident reviews. Regular drills are conducted to ensure preparedness for AI-related safety incidents. | AddressesOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AI Incident Response and Recovery ProceduresThe organization implements AI-specific incident response and recovery procedures into existing organizational incident management processes, outlining steps for addressing system failures, security breaches, and other AI-related incidents while considering the unique characteristics of AI systems, and periodically reviews and updates these procedures based on lessons learned, emerging risks, and evolving industry practices. | AddressesOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Content Lineage and Provenance TrainingThe organization establishes an ongoing program to evaluate the ability of operators and end users to understand content lineage, origin, and provenance information related to the AI system. The organization evaluates the adequacy of existing training and adapts training and certification programs to address identified gaps. | AddressesAuditability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Stakeholder Engagement for ImprovementThe organization regularly engages a wide range of stakeholders (e.g., users, domain experts, affected communities, other relevant AI stakeholders) to gather feedback and insights on the performance, impacts, and potential improvements of its AI systems. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Feedback Integration and Continuous ImprovementThe organization integrates feedback from AI stakeholders and insights from independent oversight into the AI system’s development, deployment, monitoring, and TEVV processes, facilitating effective implementation, user acceptance testing, ongoing monitoring, evaluation, and optimization of AI systems throughout their lifecycle. This integration ensures that measurement data and stakeholder feedback directly inform decisions, enhance system performance, and promote trustworthiness. The framework is designed to support continuous improvements driven by data-driven insights and stakeholder perspectives, ensuring that changes meet user needs and operate as intended. | AddressesOversightDriftStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| System-Specific Incident ProcessesThe organization develops and maintains incident response and recovery processes specific to each AI system, tailored to the system's unique characteristics, potential risks, and operational context. These processes are integrated with existing procedures where practical and include designated roles and responsibilities for key stakeholders. The incident response and recovery processes are regularly reviewed and updated based on actual incidents, simulated scenarios, system performance data, and emerging industry practices, ensuring they remain effective and relevant in addressing the distinct needs of each AI system. | AddressesOversightAccountabilityStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Centralized Incident Repository and AnalysisThe organization maintains a centralized database for tracking AI system incidents and errors, including details on the nature of incidents, potential impact, affected parties, and response steps taken, and analyzes this data across all its AI systems to identify common errors, trends, and patterns, enabling proactive risk management and continuous improvement of AI incident response processes. | Not assigned toNone | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Incident Communication and ReportingThe organization responds to, recovers from, and communicates AI system incidents and errors to relevant AI stakeholders, including affected communities, in a timely, transparent, and accessible manner, with defined roles and responsibilities for incident management, escalation, and communication. | AddressesOversightAccountability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Incident Response and Recovery UpdatesThe organization regularly reviews, tests, and updates its incident response and recovery procedures to maintain their effectiveness and alignment with industry best practices, regulatory requirements, and organizational risk management policies. | AddressesOversightStandards & interoperability | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Authorized Information Sharing and Lessons LearnedThe organization actively shares authorized information regarding its AI risk identification approaches and lessons learned through publications, conferences, and industry forums. This sharing fosters transparency, trust, and the collective advancement of AI risk management practices among industry, regulators, and affected stakeholders. All shared information is consistent with regulatory obligations and organizational confidentiality policies, ensuring that specific determinations are made regarding what can and cannot be shared. The focus is on conveying lessons learned rather than disclosing specific incident details, thereby maintaining compliance while promoting collaborative improvement in AI risk management. | AddressesAuthority | Editorial assignment (crosswalk)Cyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| Model Context Protocol (MCP)Graph neighbors → | AddressesAuthorityIdentityStandards & interoperability | Standards registerAnthropic; open specification |
| Agent-to-Agent (A2A)Graph neighbors → | AddressesIdentitySystemic behaviorStandards & interoperability | Standards registerOriginated at Google; contributed to the Linux Foundation |
| OpenTelemetryGraph neighbors → | AddressesOversightDriftAuditability | Standards registerCloud Native Computing Foundation |
| NIST AI Risk Management FrameworkGraph neighbors → | AddressesOversightDriftAccountability | Standards registerUS National Institute of Standards and Technology |
| ISO/IEC 42001Graph neighbors → | AddressesOversightAccountabilityStandards & interoperability | Standards registerISO / IEC |
| FDC3Graph neighbors → | AddressesIdentityStandards & interoperability | Standards registerFINOS (Fintech Open Source Foundation, Linux Foundation) |
| FIX ProtocolGraph neighbors → | AddressesAuditabilityAccountabilityStandards & interoperability | Standards registerFIX Trading Community |
| XBRLGraph neighbors → | AddressesAuditabilityStandards & interoperability | Standards registerXBRL International |
| SR 26-2 (Revised Model Risk Management)Graph neighbors → | AddressesOversightAuditabilityAccountability | Standards registerFederal Reserve · OCC · FDIC |
| IMDA Model AI Governance Framework for Agentic AIGraph neighbors → | AddressesAuthorityOversightAccountabilityIdentity | Standards registerInfocomm Media Development Authority, Singapore |
| IOSCO Supervisory Toolkit for AI Use in Capital MarketsGraph neighbors → | AddressesOversightAccountabilitySystemic behaviorStandards & interoperability | Standards registerInternational Organization of Securities Commissions |
| Financial Services AI Risk Management Framework (FS AI RMF)Graph neighbors → | AddressesOversightAuditabilityAccountabilityStandards & interoperability | Standards registerCyber Risk Institute · FSSCC · US Treasury (AIEOG) |
| AIEOG Shared AI LexiconGraph neighbors → | AddressesIdentityStandards & interoperability | Standards registerUS Treasury · FBIIC · FSSCC |
| DORA (Digital Operational Resilience Act)Graph neighbors → | AddressesOversightAuditabilityAccountabilitySystemic behavior | Standards registerEuropean Union — Regulation (EU) 2022/2554 |
| ISO 20022Graph neighbors → | AddressesAuditabilityStandards & interoperability | Standards registerISO — maintained by the Registration Management Group |
| FDX (Financial Data Exchange) APIGraph neighbors → | AddressesAuthorityIdentityStandards & interoperability | Standards registerFinancial Data Exchange — industry standards body |
| W3C Decentralized Identifiers (DIDs)Graph neighbors → | AddressesAuthorityIdentity | Standards registerWorld Wide Web Consortium — W3C Recommendation |
| NIST Cybersecurity Framework 2.0Graph neighbors → | AddressesOversightAccountabilityStandards & interoperability | Standards registerUS National Institute of Standards and Technology |
| ACP (Agent Communication Protocol) — supersededGraph neighbors → | AddressesStandards & interoperability | Standards registerIBM Research → Linux Foundation; merged into A2A |
| The Agent Authority GrantGraph neighbors → | Puts into practiceAuthority | Knowledge graph edgeQIS Ecosystem |
| The Kill-Switch CovenantGraph neighbors → | Puts into practiceDrift | Knowledge graph edgeQIS Ecosystem |
| Model Provenance RepresentationsGraph neighbors → | Puts into practiceIdentity | Knowledge graph edgeQIS Ecosystem |
| The Stressed Conditions AnnexGraph neighbors → | Puts into practiceSystemic behavior | Knowledge graph edgeQIS Ecosystem |
| The Schedule SetGraph neighbors → | Puts into practiceStandards & interoperability | Knowledge graph edgeQIS Ecosystem |
| QIS Reference Gate (RG-01)Graph neighbors → | Puts into practiceAuthorityDrift | Knowledge graph edgeQIS Ecosystem |
| AuthorityGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| OversightGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| DriftGraph neighbors → | AddressesDrift | Knowledge graph edgeQIS Ecosystem |
| AuditabilityGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| AccountabilityGraph neighbors → | AddressesAccountability | Knowledge graph edgeQIS Ecosystem |
| Agent identityGraph neighbors → | AddressesIdentity | Knowledge graph edgeQIS Ecosystem |
| Systemic behaviorGraph neighbors → | AddressesSystemic behavior | Knowledge graph edgeQIS Ecosystem |
| ConformanceGraph neighbors → | AddressesStandards & interoperability | Knowledge graph edgeQIS Ecosystem |
| Agent IdentityGraph neighbors → | AddressesIdentity | Knowledge graph edgeQIS Ecosystem |
| Trust BoundaryGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| Tool ManifestGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| Task DelegationGraph neighbors → | AddressesAccountability | Knowledge graph edgeQIS Ecosystem |
| Agent MemoryGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| Prompt InjectionGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| Human-in-the-LoopGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| Human OverrideGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| GuardrailsGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| Audit TrailGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| Agent2AgentGraph neighbors → | AddressesSystemic behavior | Knowledge graph edgeQIS Ecosystem |
| Agent orchestrationGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| Decentralized IdentifierGraph neighbors → | AddressesIdentity | Knowledge graph edgeQIS Ecosystem |
| Consent GrantGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| AuthorityGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| OversightGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| DriftGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| AuditabilityGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| AccountabilityGraph neighbors → | AddressesAccountability | Knowledge graph edgeQIS Ecosystem |
| IdentityGraph neighbors → | AddressesIdentity | Knowledge graph edgeQIS Ecosystem |
| Systemic behaviorGraph neighbors → | AddressesSystemic behavior | Knowledge graph edgeQIS Ecosystem |
| ConformanceGraph neighbors → | AddressesStandards & interoperability | Knowledge graph edgeQIS Ecosystem |
| ObservabilityGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| OrchestrationGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| EvaluationGraph neighbors → | AddressesStandards & interoperability | Knowledge graph edgeQIS Ecosystem |
| Experiment trackingGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| RetrievalGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| Graph databaseGraph neighbors → | AddressesIdentity | Knowledge graph edgeQIS Ecosystem |
| LineageGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| Data qualityGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| IngestionGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| TransformationGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| Research environmentGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| ConstraintsGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| Fiduciary dutyGraph neighbors → | AddressesAccountability | Knowledge graph edgeQIS Ecosystem |
| Duty of careGraph neighbors → | AddressesAccountability | Knowledge graph edgeQIS Ecosystem |
| Effective challengeGraph neighbors → | AddressesOversight | Knowledge graph edgeQIS Ecosystem |
| Kill FunctionalityGraph neighbors → | AddressesDrift | Knowledge graph edgeQIS Ecosystem |
| Authority GrantGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| Agent Decision RecordGraph neighbors → | AddressesAuditability | Knowledge graph edgeQIS Ecosystem |
| Authority EnvelopeGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| Restart ConditionGraph neighbors → | AddressesDrift | Knowledge graph edgeQIS Ecosystem |
| Governed QuantityGraph neighbors → | AddressesAuthority | Knowledge graph edgeQIS Ecosystem |
| AgentGraph neighbors → | addressedByIdentity | Knowledge graph edgeQIS Ecosystem |
Control-objective identifiers, names and texts are reproduced from the FS AI RMF Risk and Control Matrix v1.0 and remain the issuing bodies'; framework names likewise. The assignments, the register mapping and the graph edges are this corpus's editorial work. The downloadable rows carry identifiers and names, not objective texts. See the FS AI RMF provenance record.
The finding.
Auditability and oversight dominate. That is what a framework built by risk and compliance functions produces, and it is not a criticism — those controls are real and they are the ones examiners will test first.
But the thin columns are drift (11), systemic behavior (16), identity (32), and they are thin in a specific way. The framework governs an AI system that an institution operates. It does not govern an agent that acts — because at v1.0 it was not written to, and because the vocabulary for delegated authority did not exist in the sector's own lexicon.
An institution that implements all 230 control objectives has built a genuinely strong AI risk program and has still not answered what its agent is permitted to commit, who granted that, and what happens when many agents do the same thing at once.
Those are not exotic questions. They are the first questions an examiner will ask once agentic deployment is visible, and the existing control set does not reach them.
Method, stated plainly.
This mapping is editorial. Each of the 230 control objectives was assessed against the eight questions using its objective text and its named risk statement. A first pass used terminology matching; the assignment is judgment, and judgment can be wrong.
Two things follow from that. First, the underlying data is published as JSON so you can re-derive it, disagree with specific assignments, and show your working. Second, if you think a mapping is wrong we would rather hear it than not — corrections are published with attribution.
What is not editorial: the 230 count, the function breakdown, and the objective text. Those come directly from the published Risk and Control Matrix v1.0 and can be checked against it.
Source and provenance
- Issuing body
- QIS Ecosystem
- Canonical source
- https://qistrust.com/crosswalk/
- Version
- MARQUE 1.0 × Risk and Control Matrix v1.0
- Related source
- FS AI RMF (QIS-S-112)
- Last verified
- Next review due
- Recorded claims
- fs-ai-rmf (2026-08-02), fs-ai-rmf-release (2026-08-26)
- Content held
- The MARQUE assignment of each of the 230 control objectives (the editorial mapping only). qisfund.com/api/crosswalk.json
sha256:25abcdccc0073c57ec3a3bb69a03647abc2c79bf39d64a040c95da8dee19a1a9 - Third-party material
- The control-objective identifiers and texts are the issuing body's (Cyber Risk Institute · FSSCC · US Treasury (AIEOG)); see the FS AI RMF record, QIS-S-112.
- This corpus's work
- Original work of the QIS Ecosystem, under the terms at https://qistrust.com/license/.
Dates are when each recorded claim was last checked against its primary source (the verification register), not when this build ran; last verified is the oldest of them. The same record, field for field, is in api/provenance.json (qis-provenance-1) and in this page's structured data.