• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

AI to Enable Accurate Modelling of Data Storage System Performance

AI to Enable Accurate Modelling of Data Storage System Performance

© iStock

Researchers at the HSE Faculty of Computer Science have developed a new approach to modelling data storage systems based on generative machine learning models. This approach makes it possible to accurately predict the key performance characteristics of such systems under various conditions. Results have been published in the IEEE Access journal.

Data storage systems play an important role in today’s digital world, as they are responsible for the safety and prompt availability of vast amounts of information. These systems consist of many components, including controllers, HDD and SSD disks, as well as cache memory, which work together to ensure fast and efficient operation. To achieve optimal performance, it is essential to accurately predict how these systems will function in different scenarios, such as when the load on the system changes.

Researchers at the HSE Faculty of Computer Science developed a new approach to modelling data storage system performance, which relies on generative machine learning models. The authors proposed a method that provides high-precision predictions of the key performance characteristics of the systems: the number of input/output operations per second (IOPS) and latency.

The modelling includes two stages. First, the scientists collect data by measuring the system’s performance under various loads and configurations. This data is then fed to two special generative models: the CatBoost regression model and the normalizing flow model. CatBoost works well with tabular data and can accurately predict average values and performance deviations. The normalizing flow model produces a complete distribution of possible outcomes, taking into account data uncertainties and variability.

Mikhail Hushchyn

‘One of the main advantages of our method is that it does not require detailed knowledge of the internal structure of the system components. This is often impossible due to the manufacturers’ trade secrets. Instead, our generative models are trained directly on real-world data. For instance, in our study, we trained a model using 300,000 measurements. This makes our approach versatile and applicable to any type of data storage system,’ says study author Mikhail Hushchyn, a senior research fellow at the HSE Faculty of Computer Science.

The researchers tested the accuracy of the proposed approach using Little's law, a fundamental principle of queuing theory. According to test results, these predictions are highly consistent with real observations: prediction errors range from just 4–10% for IOPS and 3–16% for latency, while the correlation with the observed values reaches 0.99.

Aziz Temirkhanov

‘Our proposed approach opens up broad prospects for optimising and planning the operation of data centres. It makes it possible to predict the behaviour of the system amid load changes, identify potential performance issues, and optimise power consumption. Furthermore, expensive physical experiments are no longer required for accurate modelling,’ stated Aziz Temirkhanov, a junior research fellow at the Laboratory of Methods for Big Data Analysis.

The experimental code and measurements of the storage system performance are publicly available.

See also:

Physicists Find a Way to Model Ion Parameters in Plasma in Seconds

Researchers from HSE University and the Moscow Institute of Physics and Technology (MIPT) have developed a set of simple analytical methods for calculating the properties of heavy ions in helium under the influence of a strong electric field. The new approach speeds up calculations of ion mobility and ion–molecule reaction rates by thousands of times while maintaining sufficient accuracy for plasma jet modelling. The findings have been published in the journal Physica Scripta.

A New Section on AI and a Prizewinning Paper: Early-Career HSE Researchers Take Part in IEEE EDM Conference

The 27th IEEE International Conference of Young Professionals in Electron Devices and Materials (EDM) has taken place in the Altai Republic. This year, researchers from HSE University presented the results of their research and were involved in organising a new section on artificial intelligence. A paper by HSE master’s student Rodion Sidorenko was awarded third place in the research paper competition at the conference.

‘AI Enables Researchers to Tackle More Complex and Important Problems’

In late July 2026, Dmitry Rybin, a graduate of the HSE Faculty of Mathematics who is now working in China, used ChatGPT to disprove a longstanding mathematical hypothesis. In an interview with the HSE News Service, he discussed AI's ability to make discoveries in mathematics, reflected on his time at HSE University, and spoke about his doctoral research at the Chinese University of Hong Kong.

Two Years of Growth or Decline: How to Choose an Investment Strategy

Economists from HSE University, together with colleagues from international universities, have analysed stock market movements over almost a century and proposed an investment strategy that could have delivered returns nearly twice as high as the market average. Their research suggests following a momentum strategy during periods of sustained market growth and switching to a value strategy after prolonged market declines. The study has been published in the Journal of Banking and Finance.

Researchers Reveal Link Between Attention and Communication Difficulties in Autism

Researchers at HSE University have examined how communication difficulties in children with autism are related to brain function. The findings show that not only language networks but also attention networks play an important role. The weaker the connections involved in maintaining focus and switching attention, the more pronounced communication difficulties were. The study has been published in European Child & Adolescent Psychiatry.

Scientists Discover Why Some People Wore Masks During COVID-19 While Others Did Not

Why do some people voluntarily follow new rules while others ignore them? Researchers at HSE University have found that the answer lies not so much in people's willingness to cooperate, as previously believed, but in their ability to empathise with others. Empathy proved to be the strongest predictor of whether people chose to wear face masks voluntarily during the COVID-19 pandemic. The findings have been published in Frontiers.

Physicists at HSE University and FIAN Discover Way to 'Photograph' Sound for Testing Materials Used in 6G Communications

Researchers at HSE University, in collaboration with colleagues from the Lebedev Physical Institute of the Russian Academy of Sciences (FIAN), have developed a method for rapidly determining how firmly a film is bonded to a substrate. This is important for the creation of ultrahigh-frequency acoustic filters, which are key components of next-generation 5G and 6G communications. For the first time, researchers have succeeded in measuring the lateral rigidity of the bond between a two-dimensional material film and a substrate in this way. The study results have been published in Applied Physics Letters.

AI for Doctors: HSE Faculty of Computer Science Delivers Course for Russian University of Medicine Students

In June 2026, the HSE Faculty of Computer Science (FCS) completed a course on the use of artificial intelligence in medicine for first-year Paediatrics students at the Russian University of Medicine. The course was delivered with support from a grant awarded to HSE University under the Artificial Intelligence federal project, part of the national project ‘Data Economy and the Digital Transformation of the State.’

Scientists Create Open Dataset for Studying Concentration

A team of Russian researchers, including scientists from HSE University–St Petersburg, has developed the first open multimodal dataset containing recordings of brain activity, heart function, and video observations to help researchers understand what happens in the human brain during deep concentration. In the future, the dataset could accelerate the development of neural interfaces, rehabilitation technologies, and AI systems. The article has been published in Scientific Data.

Scientists Propose Method for More Efficient Resource Use in Machine Learning

An international group of researchers, including mathematicians from the AI and Digital Science Institute at the HSE Faculty of Computer Science, has provided a theoretical justification for a simple and computationally efficient method of estimating uncertainty in Stochastic Gradient Descent (SGD). The paper has been published on the scientific preprint server arXiv.org and presented at AISTATS 2026.