• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

Tabular Data Anonymisation Solution for Safe Use in AI Systems Developed at HSE University

Tabular Data Anonymisation Solution for Safe Use in AI Systems Developed at HSE University

© iStock

The AI and Digital Science Institute at the HSE Faculty of Computer Science has developed a tabular data anonymisation service designed to prepare corporate datasets for use in analytics and AI applications. The solution can identify personal data in structured datasets, apply consistent and reproducible anonymisation rules, and generate the artifacts required for quality control, auditing, and subsequent use of data in secure environments.

The solution addresses one of the key challenges of AI adoption in organisations: real-world data is essential for training, testing, and monitoring models, yet its direct use often carries the risk of exposing personal information. This challenge is particularly acute when working with data from corporate information systems, where information about users, employees, students, or clients is stored in the form of interconnected tables, identifiers, and attributes.

The service developed at HSE University addresses this challenge by combining processing rules, a replacement registry, and a reproducible anonymisation model. Given identical input data, the system produces consistent and predictable results, which is essential for the replicability of experiments, data quality assurance, and subsequent auditing. This approach preserves the structure of the dataset and maintains its suitability for analytical applications and AI use scenarios.

The solution is being developed in compliance with Russian personal data legislation and applicable requirements for data anonymisation. Its architecture provides for separate storage of source data and processing artifacts, as well as management of replacement rules, access controls, integrity checks, and a replacement registry. Together, these mechanisms enable the service to be integrated into a controlled AI data lifecycle management framework.

Currently, the service is used within HSE University's SmartMLOps platform to process data from the university's corporate information systems. Its applications include preparing data for analytics, testing, and the deployment of AI services. The solution can also be adapted for use in secure environments by organisations handling sensitive datasets, including those in education, healthcare, industry, finance, and government.

A separate line of development focuses on creating a version for unstructured data such as text documents, communications, contracts, and other materials in which personal data appears in free form. This version is currently under development and undergoing pilot testing. It will use a combination of rule-based methods, NLP (natural language processing) tools, and NEM (named entity recognition) models to identify personal data in texts while considering the context.

Hadi Saleh

Hadi Saleh

'It is not enough for AI projects to simply have access to data. It is necessary to prepare data in a way that preserves its analytical value while ensuring that personal information is not disclosed. Our service addresses exactly this engineering challenge: it integrates anonymisation into a managed process for preparing data for AI,' said project leader Hadi Saleh, Head of the Unit for Applied Technological Solutions at the AI and Digital Science Institute, HSE Faculty of Computer Science.

The rights to the core components of the solution are reserved. The team envisions further development of the service both as an internal tool at HSE University and as a solution for deployment in secure environments within organisations that require data preparation for AI while complying with personal data protection requirements.

The project is ranked among the top 10 in the Data Security, Trust, and Quality category of the 2026 Gravitation International University Award in AI and Big Data.

The service was developed by the team of the Strategic Technological Project 'Multi-Agent AI Platform for Sectoral Solutions' as part of HSE University’s Development Programme for 2025–2036, supported under the Priority 2030 Strategic Academic Leadership Programme.

See also:

Scientists Develop Algorithm for More Reliable Processors in Data Centres

Researchers from HSE MIEM and Samara University have developed the LRF-3D algorithm to automatically bypass idle nodes in three-dimensional networks-on-chip. Thanks to its hierarchical architecture, the algorithm outperforms existing solutions in both speed and path accuracy, improving processor reliability for use in data centres, supercomputers, and AI computing. The source code and test results are publicly available.

Researchers Rank Recommendation Algorithms Using Sports Tournament Model

Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science have developed an approach for selecting recommendation algorithms more effectively. Their approach uses pairwise comparisons of algorithms to create a tournament table, with the overall ranking based on their performance across all datasets in the tournament. This can reduce the number of algorithms that need to be tested when developing new services, saving both time and money. The study was presented at the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2026).

Researchers Develop Method for Direct Generation of Regulatory DNA

Researchers at HSE University have developed a model for generating promoters and enhancers—DNA sequences that regulate gene activity. The model works directly with DNA nucleotides, without first transforming them into a continuous numerical representation. This solution could be useful for applications in synthetic biology and gene therapy. The study results were presented at the ICLR 2026 Workshop ‘Generative AI in Genomics (Gen^2): Barriers and Frontiers.’

Researchers at HSE University and Sber Train Neural Networks to Better Predict User Preferences

The HSE FCS AI and Digital Science Institute and Sber have introduced a new architecture for recommendation systems that combines two classes of models, enabling algorithms to better predict users’ interests and needs. A preprint of the paper has been published on arxiv.org and presented at Urban ML.

Physicists Discover What Happens Inside a Stable Vortex

Large vortices with characteristic spiral arms are often observed in the atmosphere and the ocean. Physicists from HSE University have explained how these structures form and why they retain their shape. The researchers found that velocities at points located along the same vortex arc remain correlated even over long distances. At the same time, this correlation weakens rapidly with increasing distance from the vortex centre. These differences help explain the formation of spiral arms and may improve models of atmospheric and oceanic currents. The findings have been published in Physical Review Fluids.

HSE Computer Science Researchers Win Gold Medal at International Machine Learning Competition

A team comprising HSE International Laboratory of Statistical and Computational Genomics researchers Aleksei Shmelev and Nikita Chervov, 2025 graduate of the HSE Faculty of Computer Science’s Master’s programme in Data Analysis in Biology and Medicine Ivan Gevorkov, and two students from the United States achieved an outstanding result at the 2026 NeuroGolf international machine learning championship. The team won a gold medal and placed seventh overall.

‘Working with AI Solves a Wide Range of Engineering Problems’

Artificial intelligence is a working tool based on a balanced combination of algorithms and engineering. Experts and doctoral students from the HSE Moscow Institute of Electronics and Mathematics explain how AI technologies can improve an application, device, or system, and what engineering tasks are solved in the process.

‘The Peak of Stupidity’ and ‘The Valley of Despair’: HSE Economists Propose an Explanation for the Dunning–Kruger Effect

The Dunning–Kruger effect, which describes a sharp surge in self-confidence among beginners followed by an equally rapid decline as they gain experience, can be explained by the nature of the learning process and the acquisition of new knowledge. This conclusion was reached by Andrey Vorchik of the HSE Faculty of Economic Sciences together with independent researcher Murat Mamyshev. They developed a mathematical model of learning and demonstrated how subjective confidence is formed and changes as knowledge accumulates, as well as how teachers can reduce the ‘valley of despair’ experienced by learners.

Toffee and Risk: Scientists Discover Why People Who Crave Sweets Make More Impulsive Choices

Having a sweet tooth may be linked not only to eating habits but also to the way people make decisions. Researchers at HSE University have found that people with a preference for sweet foods tend to behave more impulsively—not because they want immediate rewards, but because they are less willing to tolerate uncertainty. These findings may help improve treatments for addiction. The study findings have been published in Frontiers in Psychology.

Advancing Collaboration: HSE Faculty of Computer Science and Harbin Institute of Technology Hold Joint Seminar

From July 13 to 16, 2026, the Faculty of Computer Science hosted the Russian–Sino Research Seminar on Machine Learning Applications, organised by the HSE Laboratory for Cloud and Mobile Technologies in partnership with the Harbin Institute of Technology (China). A delegation comprising seven students and three university representatives travelled to Moscow to take part in an intensive four-day programme.