Wikidata:Dataset Imports/Unpaywall

You may find these related resources helpful:

• Dataset Imports
• Why import data into Wikidata.
• Learn how to import data
• Bot requests
• Ask a data import question

Guidelines for using this page

Documenting the import

• Guidelines on how to import a dataset into Wikidata are available at Wikidata:Data Import Guide.
• Please include notes on all steps of the process.
• Once a dataset has been imported into Wikidata please edit the page to change the progress status from in progress to complete.
• It is strongly recommended to use Visual Editor when making changes to this page, particularly for editing any of the tables.

Creating a Wikidata item for the dataset

• Please create a Wikidata item for the dataset, this will allow us to improve the coverage of datasets on Wikidata and understand what datasets are available on that topic and which of them have been added to Wikidata.
• If you are working with very large dataset you can break it into smaller Mix n' Match catalogues, but only create one Wikidata item.
• Link the dataset Wikidata item to this page using Wikidata Dataset Imports URL (P5195)

Getting help

• If your dataset import runs into issues please edit the page to change the progress status from in progress to help needed.
• You can ask for help on Wikidata:Project chat.

Overview

Dataset name

Unpaywall

Source

Impactstory

Link

[1]

Dataset description

data format A data set linking DOIs to freely available versions of the article. This includes preprints (e.g. arXiv) and institutional repositories.

Progress of import

The table below is used to track the progress of importing this dataset. The suggested column headings are most applicable to data being imported from a spreadsheet - you can change some column headings or add new columns as required to best describe the progress of this import.

Data sets used:

• Unpaywall (Q38352586) for doi to (arXiv, full text pdf) mapping
• inventaire.io (Q32193244) data dump for doi to Q mapping

Subtask	Process import	Structure of data within Wikidata	Match the dataset to Wikidata	Importing data into Wikidata
Import arXiv identifiers 863k in data set phab:T208118	Code prepared Initial data set (138k items) processed	Automatic detection and decoding of honey bee waggle dances. (Q47562874) arXiv ID (P818)     "1708.06590" stated in (P248) Unpaywall (Q38352586)	Using wd_doi_ids.ndjson.gz provided by inventaire.io Mapping by case-insensitive doi matching	Export using QuickStatements (Q20084080) Initial data set (7000 items) imported

Edit history

Use the table below to list batches of edits that have been completed for this dataset. Ideally each entry should have all applicable columns filled out, but at a minimum please make to add a date and description to give an idea of what was added to Wikidata and when.

Date	Description	Method	Properties	Qualifiers	References	Statements added	Statements removed	Link to import sheet
27 Oct 2018	Initial arXiv import	See above	arXiv ID (P818)	-	Unpaywall (Q38352586)	7217	0	[2]
Date 3	Description 3	Method 3	Properties 3	Qualifiers 3	References 3	Added Count 3	Removed Count 3	Link 3

Discussion of import

These headings are generally useful, please change this section to suit your needs.

Structure of data within Wikidata

Field name	Wikidata property	Notes
Name1	Property1	Notes1
Name2	Property2	Notes2
Name3	Property3	Notes3

Maintenance

Queries and expected results

Query link	Description	Expected results
Link1	Property1	Notes1
Link2	Property2	Notes2
Link3	Property3	Notes3