Skip to content

Fully-controlled realistic error generation for tabular data.

License

Notifications You must be signed in to change notification settings

calgo-lab/tab_err

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 Cannot retrieve latest commit at this time.

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

tab_err

tab_err is an implementation of a tabular data error model that disentangles error mechanism and error type. It generalizes the formalization of missing values, implying that missing values are only one of many possible error type implemented here. tab_err gives the user full control over the error generation process and allows to model realistic errors with complex dependency structures.

The building blocks are ErrorMechanisms, ErrorTypes, and ErrorModels. ErrorMechanism defines where the incorrect cells are and model realistic dependency structures and ErrorType describes in which way the value is incorrect. Together they build a ErrorModel that can be used to perturb existing data with realistic errors.

This repository offers three (soon) APIs, low-level, mid-level and high-level. For details and examples please check out our Getting Started Notebook.