# wd-quality

This repository contains the materials used  for the paper ["A Study of the Quality of Wikidata" by Kartik Shenoy, Filip Ilievski, Daniel Garijo, Daniel Schwabe and Pedro Szekely](https://arxiv.org/abs/2107.00156). A pre-print can be cites as proposed below (a journal paper is currently under revision):

```
@misc{shenoy2021study,
      title={A Study of the Quality of Wikidata}, 
      author={Kartik Shenoy and Filip Ilievski and Daniel Garijo and Daniel Schwabe and Pedro Szekely},
      year={2021},
      eprint={2107.00156},
      archivePrefix={arXiv},
      primaryClass={cs.AI}
}
```
Data used in the paper is accessible from [https://w3id.org/wd_quality#data](https://w3id.org/wd_quality#data)

## Notebooks

The repository consists of a series of notebooks which were used to perform the different analyses in the paper: 

[Comprehensive Constraints Analysis - Final.ipynb](https://github.com/usc-isi-i2/wd-quality/blob/main/Comprehensive%20Constraints%20Analysis%20-%20Final.ipynb) - This notebook has the queries executed for the dataset to check type, value type, item requires, symmetric and inverse constraints.

[Comprehensive Constraints Analysis - With Removed Statements - Final.ipynb](https://github.com/usc-isi-i2/wd-quality/blob/main/Comprehensive%20Constraints%20Analysis%20-%20With%20Removed%20Statements%20-%20Final.ipynb) - This notebook has the queries executed for the dataset with the removed statements to check type, value type, item requires, symmetric and inverse constraints. It is essentially the same notebook, but we run it twice with different data: once with all statements, and once with all statements + removed statements (see section 3.2 in the paper for more info)

[Deprecated Statements Analysis.ipynb](https://github.com/usc-isi-i2/wd-quality/blob/main/Deprecated%20Statements%20Analysis.ipynb) - This notebook has the results of analysing deprecated statements.

[Removed Statements Analysis.ipynb](https://github.com/usc-isi-i2/wd-quality/blob/main/Removed%20Statements%20Analysis.ipynb) - This notebook has the queries executed to determine statistics of the removed statements.

The following spreadsheet contains the constraints we have encoded in our analysis:
[Spreadsheet with constraint properties](https://docs.google.com/spreadsheets/u/1/d/1EueS5dAiGVWa8N1MisgY1i6QE369EOcOieEiDyeAOzk/edit#gid=0)

## Sample queries

This repository includes a folder [Scripts](https://github.com/usc-isi-i2/wd-quality/tree/main/Scripts) which has 2 subfolders for the 2 sets of constraint violation scripts. However, note that these scripts **will not be directly executable**. In order to reproduce these results, the following folder structure is assumed:

```
.
├── allConstraintsAnalysis_Final
├── allConstraintsAnalysis_WRemoved_Final
├── Notebooks
│   └── wd-quality ==> ========= GITHUB REPO ROOT ========================
│       ├── Archived
│       └── Scripts
│           ├── ViolationCheckScripts
│           └── ViolationWithRemovedStatementsCheckScripts
├── propertiesSplit_Final
│   └── checkViolations ==> ==== CORRECT LOCATION of ViolationCheckScripts scripts =======
│       └── exec_logs
├── propertiesSplit_WRemoved_Final
│   └── checkViolations ==> ==== CORRECT LOCATION of ViolationWithRemovedStatementsCheckScripts scripts =======
│       └── exec_logs
```

The output folders `allConstraintsAnalysis_Final`, `allConstraintsAnalysis_WRemoved_Final` need to have this folder structure:

```
.
├── codependencyConstraint
│   ├── Mand
│   ├── Mand_Normal
│   ├── Mand_Sugg_Normal
│   ├── Normal
│   └── Suggestion
├── inverseConstraint
│   ├── mandatory
│   ├── normal
│   └── suggestion
├── symmetricConstraint
│   ├── mandatory
│   ├── normal
│   └── suggestion
├── typeConstraint
│   ├── mandatory
│   ├── normal
│   └── suggestion
└── valueTypeConstraint
    ├── mandatory
    ├── normal
    └── suggestion
```