Can an AI Redaction Still Leave Someone Identifiable?

Check a proposed release for combinations of clues, repeated references and the information a reader actually needs.

A records steward compares transparent overlays with an opaque band over a document.
A public copy should preserve the information readers need while protecting people in the source.

A privacy-review AI model can locate names and other personal details in text. A town’s only overnight ferry mechanic may still be recognizable after a name is removed. The release decision turns on who can combine the remaining clues, what they already know and why the document is being released.

Find the references that belong together

A woman in a black dress stands on a curved platform surrounded by a rainbow-colored light installation.
Classification helps a reviewer locate candidate identifiers across a document.

The Text Anonymization Benchmark contains 1,268 English-language European Court of Human Rights cases. Its annotations include types of identifiers and links among references to the same entity. A useful test follows a person across the document, including a later pronoun or distinctive description. A tool that masks most names can still expose the person in the one record that matters. The Text Anonymization Benchmark

Read the proposed public copy

Staggered transparent blocks surround an opaque white rectangle.
A blacked-out name may leave identifying context in the surrounding passage.

Review the transformed document as a reader with local knowledge would. For a public service report, a general subject and time period may serve the purpose as well as an exact occupation and shift. Check the exported text layer, attachments and metadata under the organization’s release procedure. Preserve an access-controlled original for the reviewer who must verify the change.

Choose the release and its audience

A person stands in front of an endless shelf of books, holding a book and examining it intently.
An aggregate count and a case narrative reveal different amounts of information.

NIST SP 800-188 treats de-identification as a governance decision that includes release arrangements and residual risk. A public download, controlled access for researchers and a statistical summary serve different audiences. Record the purpose, what reviewers removed or generalized, what utility they retained and who approved the particular release. A benchmark on legal documents cannot certify a dataset from another setting. NIST SP 800-188 on de-identifying government datasets

Try it with the evidence

Edit a fictional service report

Source notes. Invented text. “Lea, the island’s only overnight ferry mechanic, reported a broken light at 02:17 Tuesday.” Release purpose: tell residents how many safety reports were received this month and what issue was raised. The community knows the shift schedule.

Prompt. Identify the details that could identify the speaker together. Draft the minimum public summary that serves the purpose and explain your choice.

Check your reading

The occupation, island, shift and precise time can identify the speaker even with the name removed. “One lighting safety report was received this month” preserves the count, topic and period. The restricted source can retain the detail needed for follow-up. No real personal information is required for this exercise.

Illustrated field notes

Release decisions and the data lifecycle
Futuristic Elevator with Large Screen and Buttons.
Limit who can see the source and the proposed release.
A collection of books stacked on top of each other in a study room.
A report should link each conclusion to supporting evidence.
A computer screen displaying a website or application with an orange and white color scheme.
Consent may be limited to a purpose, period or audience.
An image of futuristic electronic components on a white surface.
Decide what information is necessary before collecting it.
Two faces are depicted in contrasting styles: a wireframe face on the left and a realistic face on the right.
Test whether generated records still reveal information about individuals.
A futuristic building with a cylindrical shape and a large circular window on its front side, housing rows of computers and servers.
Tokenization, encryption and public anonymization serve different purposes.
An open book with a futuristic interface overlaying it, lying on a desk in a dimly lit room.
A translation can change the apparent scope of a privacy notice.
A young girl stands in front of a large window, lost in thought as she gazes out at the cityscape.
Training should use examples drawn from the actual release process.
Risk, incidents and review
A humanoid robot stands in front of a large screen displaying data or code in a futuristic laboratory or control room.
Record which policy version governed the decision.
A server room with multiple rows of servers, each enclosed in a glass case.
An unusual access event calls for investigation.
An abstract representation of risk scoring and prioritization featuring balancing scales on a black circuit board.
Severity depends on who could connect the remaining clues.
A futuristic representation of a globe with a cloud hovering above it, featuring a dynamic network of thin white lines.
A policy notice needs a jurisdiction and effective date.
An outlined face glimmers against a dark electronic surface.
A media flag needs a separate check of its relevance to the data release.
Automated Vendor Risk Management (AVRM) infographic featuring complex visual elements and a sophisticated color scheme.
A vendor assessment needs evidence about the actual service.
A large screen displays a complex system of interconnected lines and symbols in an office setting.
A behavioral outlier alone cannot establish employee misconduct.
A dimly lit office or workspace with a large computer monitor and keyboard surrounded by various electronic devices and wires.
Record when the problem was contained and who verified the correction.
Nested blue and amber rings surround a dimly lit center.
Revisit disclosure risk when new external data become available.