Carely

Safeguards and governance

Aria prepares. People decide. Always.

These are the rules we hold ourselves to in a statutory service: what the model may do, what it may never do, when it must stop, and how a council can prove all of that to an inspector.

Prototype status · the practice framework is drafted and will be owned by a registered social worker before any pilot goes live

Six rules that do not bend

No statutory decision

Aria never determines eligibility, capacity, best interests, deprivation of liberty, safeguarding outcomes, Continuing Healthcare eligibility or charges.

A named human owns every output

Every draft, referral and summary carries the name of the practitioner accountable for it, and the audit trail shows who changed what.

Stop and hand over

Risk, safeguarding, liberty and capacity triggers interrupt the flow immediately and route to a human — with everything Aria heard attached.

Transparency by default

People are told they are talking to an AI in the first message, and can ask for a human at any point without giving a reason.

Data minimisation

We collect what the conversation needs and nothing more. Production runs under a completed DPIA, with UK data residency.

Publish the failures

Model incidents are logged, contained and reported to the practice lead and programme board. The pause control is documented, not theoretical.

Escalation

Triggers that always hand over to a person

These are non-negotiable. When one appears, Aria stops, tells the person what is happening, and creates an immediate notification with an owner.

Mandatory escalation triggers and their routes
TriggerAria doesRoute and timing
Disclosure or suspicion of harm, neglect, abuse or exploitationStops the flow, captures the concern verbatim, tells the person what happens nextSafeguarding lead, immediate (notification N3)
Immediate danger to lifeInstructs the person to call 999 and stays with the conversationEmergency services, immediate
Deprivation-of-liberty indicatorsRecords AGNI-consistent evidence over time; never concludesDoLS / LPS team, immediate (N9)
Question about a person's mental capacityCaptures supported decision-making and routes onwardQualified MCA assessor (N4)
Carer in crisis, or unable to continueFlags urgency, offers contingency and immediate contactCarer services and duty lead, immediate (N18)
Self-harm or suicidal thoughtsProvides crisis numbers, flags for urgent human contactDuty lead, immediate, with crisis signposting
Any request for a human beingOffers a callback or a direct line, no reason requiredDuty team, immediate
Model incident: an output that is wrong or unsafeIncident record and containment; pause availableCarely.care practice lead and PSW, within one hour (N19)

Oversight

Who is accountable for the model

The practice framework is the document that governs Aria's behaviour: conversation standards, required questions, prohibited outputs, escalation rules, language and accessibility standards, and the QA sampling regime.

It is written to be owned by the council's Principal Social Worker, not by us. In a pilot, the PSW can inspect it, amend it, and audit against it — and the framework changes when they say so, not when it suits us.

  • A registered social worker owns practice quality (Carely.care practice lead)
  • The council's PSW holds veto over practice-affecting changes
  • Quality assurance samples Aria's drafts monthly, with published findings
  • Every AI output is attributable, versioned and retained for audit
  • An independent review of the model's impact is commissioned at pilot end

Incident and pause controls

  • Pause in one step. A named council officer can suspend Aria's assessment drafting without a change request.
  • Graceful degradation. If the model is paused, the front door reverts to structured forms and human triage — the service continues.
  • Containment. Incidents are triaged within one hour, with affected outputs identified and re-reviewed by a person.
  • No silent learning. Nothing a person tells Aria in a live service is used to train a model.
  • Full audit. Inputs, outputs, versions and human overrides are retained so an inspector can reconstruct any decision.

Compliance posture

What we align to, and where we actually stand

We would rather state the position accurately than claim certifications we do not yet hold.

Compliance alignment and current status
Standard or frameworkWhat it means hereStatus
UK GDPR and Data Protection Act 2018Lawful basis, minimisation, retention and rights for everything the front door handlesDesign complete; DPIA completed before any live pilot data
DHSC guidance on AI in adult social careSafeguards, transparency and human oversight expectationsAligned by design; published in the practice framework
Mental Capacity Act 2005 and the AGNI judgmentSupported decision-making, multifactorial evidence, no determination by the modelReflected in flows, escalation rules and the MCA/DoL pathway
Care Act 2014s.4 information, s.9 assessment, s.10 carers, s.13 eligibility, s.42 safeguardingMapped in the practice framework
NHS Data Security and Protection ToolkitSecurity and information governance evidence for health-adjacent flowsAssessment planned as part of pilot onboarding
Cyber Essentials PlusIndependently tested controls for the service and its supply chainTargeted before handling live council data
WCAG 2.2 AAAccessibility of every public and professional surfaceBuilt to AA, including keyboard operation and reduced-motion support
CQC local authority assessment frameworkEvidence that supports the council's own assessment, not a substitute for itDesigned to produce audit-ready evidence as a by-product

Data protection

What we do with information

In the prototype: nothing you type into Aria is stored or transmitted. The demonstration runs entirely in your browser with synthetic data.

In this website's forms: we store your name, email, organisation, area and message so we can reply to you, and we notify the founding team. We do not sell it, share it, or add you to a marketing list. See the privacy notice.

In a live service: a DPIA is completed before go-live, data stays in the UK, retention follows the council's own schedule, and every AI output is attributable and auditable. Nothing said to Aria in a live service is used to train a model.

Interrogate us

Ask the hard governance questions before you consider a pilot. We would rather answer them now than after a procurement.

Ask us anything