Why Aggregate Accuracy Fails in High-Stakes AI
Strong overall accuracy can conceal serious subgroup failures and hidden deployment risks in operational AI systems.
Read Insight
Operational AI Assurance Platform
Govern AI deployment with evidence, not assumptions.
Ducaltus is an operational AI assurance and governance software platform for high-stakes AI, connecting technical evidence with deployment readiness, governance oversight, remediation, reassessment, and traceable assurance across the AI deployment lifecycle.
Strong model performance alone does not establish that an AI system is ready for deployment or that its assurance position will remain unchanged as conditions evolve. Ducaltus provides an operational assurance layer connecting evaluation evidence with deployment readiness, governance oversight, remediation, reassessment, and ongoing assurance across the AI deployment lifecycle.
Who We Support
Ducaltus supports organisations developing, evaluating, procuring, or deploying AI systems in high-stakes and governance-sensitive environments. It is designed for contexts where deployment decisions require defensible evidence, structured oversight, and continuing assurance beyond initial model evaluation.
Teams moving AI systems from technical evaluation toward controlled operational deployment and continuing assurance.
Organisations requiring structured assurance, governance oversight, and defensible evidence around consequential AI deployment.
Functions responsible for AI risk, oversight, accountability, deployment review, and continuing governance.
Organisations conducting technical, governance, procurement, or third-party assurance of AI systems.
Capabilities
Structured evaluation of whether available evidence supports deployment, restriction, further review, or reassessment.
Evaluation of performance variation, error disparities, fairness concerns, and hidden reliability failures beyond aggregate metrics.
Analysis of threshold-sensitive behaviour and false-positive and false-negative trade-offs under relevant deployment conditions.
Structured support for governance review, accountability, deployment oversight, and evidence-informed decision-making.
Support for tracking assurance concerns, remediation activity, reassessment, and subsequent deployment review.
Persistent assurance evidence designed to support review, justification, traceability, and audit reconstruction.
Ducaltus Platform
Ducaltus provides a structured assurance environment for connecting technical evaluation with operational review, governance decisions, remediation, reassessment, and continuing evidence across the deployment lifecycle.
Bring evaluation evidence and assurance findings into a structured operational review process rather than relying on isolated metrics or one-time assessments.
Support assurance decisions before deployment and through subsequent review, remediation, reassessment, and changing operational conditions.
Preserve accountable human review and governance authority around consequential deployment and assurance decisions.
Maintain evidence and decision context that can support internal review, governance justification, and audit reconstruction.
Assurance Approach
Ducaltus applies a structured assurance process that connects technical evaluation with deployment context, governance review, remediation, reassessment, and continuing evidence.
Establish the AI system, intended use, deployment conditions, available evidence, relevant stakeholders, and assurance objectives.
Review model behaviour, subgroup reliability, error trade-offs, threshold sensitivity, and other deployment-relevant evidence.
Examine whether the available evidence supports deployment and identify conditions requiring restriction, further review, or additional assurance activity.
Record assurance findings, support accountable review, and track remediation or other actions arising from identified concerns.
Re-evaluate relevant evidence following remediation or material change and maintain traceable assurance information over time.
Research & Evidence Base
Ducaltus draws on research spanning AI reliability, fairness metric disagreement, subgroup performance, threshold sensitivity, deployment risk, and operational assurance. This research provides part of the evidence base informing the company's approach to high-stakes AI assurance and governance.
Research to Operational Assurance
Ducaltus connects research on reliability, fairness, deployment risk, and governance with practical assurance processes for evaluating and governing high-stakes AI systems across the deployment lifecycle.
Research Notes & Insights
Technical perspectives exploring subgroup reliability, fairness evaluation, deployment risk, and operational considerations in high-stakes AI systems.
Strong overall accuracy can conceal serious subgroup failures and hidden deployment risks in operational AI systems.
Read InsightDifferent fairness metrics can produce conflicting conclusions about the same model, creating uncertainty in deployment decisions.
Read InsightThe operational impact of AI system errors depends heavily on context, deployment conditions, and real-world consequences.
Read InsightFounder
Founder of Ducaltus, working across operational AI assurance, deployment governance, AI reliability, fairness, and the translation of technical evidence into accountable governance for high-stakes AI systems.
Ducaltus connects technical evidence with deployment governance, accountable review, remediation, reassessment, and traceable assurance to support defensible decisions across the AI deployment lifecycle.
Evaluation & Engagement
Ducaltus is available for evaluation discussions, controlled pilot engagements, technical and governance review, and strategic collaboration relating to high-stakes AI assurance.
Initial discussions can begin using public, non-confidential material. More detailed technical and operational documentation is available to appropriate evaluators and partners under confidentiality arrangements.