The F4U System for Understanding the Effects of Data Quality

Daniele Foroni, Matteo Lissandrini, Yannis Velegrakis

Abstract:

We demonstrate a system that enables a data-centric approach in understanding data quality. Instead of directly quantifying data quality as traditionally done, it disrupts the quality of the dataset and monitors the deviations in the output of an analytic task at hand. It computes the correlation factor between the disruption and the deviation and uses it as the quality metric. This allows users to understand not only the quality of their dataset but also the effect that present and future quality issues have to the intended analytic tasks. This is a novel data-centric approach aimed at complementing existing solutions. On top of the new information that it provides, and in contrast to existing techniques of data quality, it neither requires knowledge of the clean datasets, nor of the constraints on which the data should comply.

Cite:

and
The F4U System for Understanding the Effects of Data Quality.” Proceedings of the 37th IEEE International Conference on Data Engineering, ICDE 2021