Anonymization of rulings through OCR and NLP

Sector: Public · Cliente: Comunidad de Madrid

In this successful case, we addressed the challenge of managing and analyzing a large set of rulings from the Regional Institute for Consumer Arbitration of the Autonomous Community of Madrid. The project aimed to transform 4,677 rulings from the years 2015, 2016, and 2017 into accessible and structured data. The complexity lay in dealing with diverse formats, including scanned documents, and the need to classify and anonymize them for subsequent analysis. 

To tackle this challenge, we implemented an advanced technological solution based on Optical Character Recognition (OCR) models and natural language processing techniques. We employed OCR to convert scanned documents into digital text, enabling subsequent classification and labeling of the rulings based on their content. Additionally, we used language models to identify sensitive entities that required anonymization, such as names of individuals or involved companies.

The process consisted of several phases:

1. Text Extraction: We utilized OCR technology to extract text from scanned documents, ensuring accurate conversion even for documents of varying quality.
2. Automated Classification: Machine learning models were employed to automatically classify the rulings based on their content and type.
3. Data Anonymization: We identified and anonymized sensitive entities present in the documents, ensuring compliance with data protection regulations.

Madrid office

6 Pollensa Street, ECU Bldg.

2nd floor, Las Rozas,

Madrid 28290. Spain.

Tel.: +34 916492292