Wikidata:WikiCite/Tool audit

Below is an audit of source metadata, identifier, reference, and citation tools for Wikimedia projects:

Audit

• Software
  • Wikimedia (movement)
    • Mediawiki (software)
      • Extensions (internal API)
        • Extension:Cite - https://www.mediawiki.org/wiki/Extension:Cite - Implements the "Cite" interface to editor along with <ref> and <references /> tags for management of references (citations) in a Wikipedia article to other (especially primary or secondary) sources.
        • Extension:BiblioPlus - https://www.mediawiki.org/wiki/Extension:BiblioPlus - An extension to enable specifically PubMed- and ISBN-based citations
          • Used for instance on http://cazypedia.org/
        • Extension:WikiCitation - https://www.mediawiki.org/wiki/Extension:WikiCitation - Implementation for citations without templates (notes such template usage is typically taxing on the system). While this template alternative may be more responsive, it is also unstable and experimental.
        • Extension:Pubmed - https://www.mediawiki.org/wiki/Extension:Pubmed - Enable citation of Pubmed articles
        • Extension:PubmedParser - https://www.mediawiki.org/wiki/Extension:PubmedParser - Similar to Pubmed extension above but instead creates a #PMID parser keyword that generates a citation based on a specified template created beforehand.
        • Category:Referencing_extensions - https://www.mediawiki.org/wiki/Category:Referencing_extensions - Listing of extensions with varying levels of stability and usage.
      • Templates
        • English Wikipedia
          • {{Citation}} - https://en.wikipedia.org/wiki/Template:Citation - (based on Lua Module:Citation/CS1 https://en.wikipedia.org/wiki/Module:Citation/CS1 ) follows standards outlined here https://en.wikipedia.org/wiki/Help:Citation_Style_1 and with respect to the guidelines here https://en.wikipedia.org/wiki/Wikipedia:Citing_sources#WP:CITEVAR
            • Inherited by the following templates:
              • {{Cite doi}} (slightly deprecated) for a source that uses a Digital Object Identifier (doi)
              • {{Cite arXiv}} arXiv pre-print, {{Cite AV media}} audio and visual, {{Cite AV media notes}} audio and visual liner notes, {{Cite book}} books, {{Cite conference}} conference papers, {{Cite DVD notes}} DVD liner notes, {{Cite encyclopedia}} edited collections, {{Cite episode}} radio or television episodes, {{Cite interview}} interviews, {{Cite journal}} magazines, journals, academic papers, {{Cite mailing list}} public mailing lists, {{Cite map}} maps, {{Cite news}} news articles, {{Cite newsgroup}} online newsgroups, {{Cite podcast}} audio or video podcast, {{Cite press release}} press releases, {{Cite report}} reports, {{Cite serial}} audio or video serials, {{Cite sign}} signs, plaques, {{Cite speech}} speeches, {{Cite techreport}} technical reports, {{Cite thesis}} theses, {{Cite web}} web sources
              • There are other, similar templates across the wikis as well, though possibly lesser-used, lesser-known or discouraged.
          • {{Authority control}}
            • Specify option using the following identifiers:
              • VIAF, LCCN, ISNI, ORCID, GND, SELIBR, SUDOC, BNF, BPN, RID, BIBSYS, ULAN, MBA, NLA, NDL
              • See https://en.wikipedia.org/wiki/Template:Authority_control#Wikidata for full table
          • ORCID templates https://en.wikipedia.org/wiki/Wikipedia:ORCID#Citations
            • In parallel to {{Authority control}}, there exist ORCID templates in 12 sister projects and 34 languages (including English).
          • {{citation needed}} - https://en.wikipedia.org/wiki/Template:Citation_needed - Shows the opposite of a citation, where one should be created.
        • French Wikipedia
          • "L’espace Référence" ('Reference' Namespace) - https://fr.wikipedia.org/wiki/Aide:Espace_r%C3%A9f%C3%A9rence
          • Usage: https://fr.wikipedia.org/w/index.php?title=Sp%C3%A9cial%3AIndex&prefix=&namespace=104
      • Web API (external API)
        • Read/Write HTTP endpoint https://www.mediawiki.org/wiki/API:Main_page
          • On English Wikipedia for example: https://en.wikipedia.org/w/api.php
            • Note the only ways to access references or citations (such as in a "References" section) are to use full search actions:
              • https://www.mediawiki.org/wiki/API:Search
              • https://www.mediawiki.org/wiki/API:Opensearch
        • Client Libraries
          • Big list of "Client Code" libraries https://www.mediawiki.org/wiki/API:Client_code
            • List of recent evaluations of a selection of libraries https://www.mediawiki.org/wiki/API:Client_code/Evaluations
            • "Gold Standard" for client libraries https://www.mediawiki.org/wiki/API:Client_code/Gold_standard
          • Pywikibot
            • On-wiki: https://www.mediawiki.org/wiki/Manual:Pywikibot
            • Source: https://git.wikimedia.org/tree/pywikibot%2Fcore.git
            • Examples of interacting with references via Pywikibot
              • Find articles missing <references/> tag, and add them - https://git.wikimedia.org/blob/pywikibot%2Fcore.git/247d495f9dbbb2ae886d0f61a2502c35b0ea924d/scripts%2Fnoreferences.py
              • Find articles with reference <ref> tags that use a URL without a title, and add a title - https://git.wikimedia.org/blob/pywikibot%2Fcore.git/247d495f9dbbb2ae886d0f61a2502c35b0ea924d/scripts%2Freflinks.py
    • Wikibase (software for Wikidata)
      • Mediawiki extensions
        • Wikibase Repository - http://wikiba.se/applications/#repo - Currently used to store some references, may include scope of source metadata generally.
          • Properties
            • Ability to store source metadata as properties to Wikidata items: https://www.wikidata.org/wiki/Wikidata:List_of_properties/Works
          • Arbitrary Access (currently disabled)
            • Clients are permitted to access server content (such as items and their properties) in an arbitrary, programmatic fashion.
          • Front-end interface enables editing and managing of Wikidata items and their properties.
        • Wikibase Client http://wikiba.se/applications/#client
          • Could be used to display references and source metadata on other mediawiki sites, e.g. display a reference on multiple Wikipedia articles (even across languages) based on information from Wikidata.
      • Libraries
        • Reusable components http://wikiba.se/components/
        • Wikidata Toolkit https://github.com/Wikidata/Wikidata-Toolkit
    • Bots
      • Hosted on on Tool Labs (Wikitech), which provides access to:
        • Replica (redundant) database of production wikimedia sites, for analytics and bot queries.
        • Shared storage of public datasets such as mediawiki wiki data dumps.
        • Full hosting environment
      • WikiJournal bot
        • Updates list of Journals cited by Wikipedia via WikiProject Academic Journals: https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Academic_Journals/Journals_cited_by_Wikipedia
        • On-wiki: https://en.wikipedia.org/wiki/User:JL-Bot
        • Source: https://github.com/wpoa/wiki-bot-journal
        • Operated: locally? foreign server?
      • Citation bot (f.k.a. DOI bot)
        • Originally designed to add Digital object identifiers (DOIs) to references; it now does much more, adding PubMed Identifiers (PMIDs), and ISBNs, and fixing common formatting errors.
        • On-wiki: https://en.wikipedia.org/wiki/User:Citation_bot
        • Source: https://code.google.com/p/citation-bot/source/browse/#svn%2Ftrunk
        • Production: Currently "citations" on https://toolforge.org (also related to citation-bot and citations-dev)
      • Recitation bot
        • MediaWiki bot to upload content to Wikimedia projects and update corresponding citations on Wikipedia. Intended to replace citation-bot.
        • On-wiki: https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Open_Access/Signalling_OA-ness
        • Source: https://github.com/wpoa/recitation-bot
        • Production: Currently "recitation-bot" on https://toolforge.org/
      • Open Access Media Importer
        • Handles the special case of uploading the source media content of Open Access works to Wikimedia Commons
        • On-wiki: https://commons.wikimedia.org/wiki/User:Open_Access_Media_Importer_Bot
        • Source: https://github.com/wpoa/open-access-media-importer
        • Production: Currently in operation, not hosted on toolforge.org
      • Cite-o-meter
        • Scholarly article usage on Wikipedia; citations by publisher in the top 100 Wikipedias.
        • On-wiki: none (read-only)
        • Source: https://github.com/wpoa/Wikipedia-Cite-o-Meter
        • Production: https://cite-o-meter.toolforge.org/
      • Yadkard (a.k.a. Yadfa)
        • This a is simple tool to create shortened footnote and typical citations using Google Books URL, DOI, ISBN and some news website. There is an English version, as well as a Farsi version.
        • On-wiki: none (external tool for editors)
        • Source: https://github.com/irdb/yadkard
        • Production: https://yadkard.toolforge.org and https://yadfa.toolforge.org
      • Citing Bot
        • Running on Russian Wikipedia, this bot processes templates {{ Cite PMID }} , {{ Cite doi }} , and the like, and fills them with another template (translates to something like {{ art }} , affixing with all the necessary details
        • On-wiki: https://ru.wikipedia.org/wiki/%D0%A3%D1%87%D0%B0%D1%81%D1%82%D0%BD%D0%B8%D1%86%D0%B0:Citing_Bot
        • Source: https://github.com/kekaadrenalin/Citing-Bot
        • Production: https://citing-bot.toolforge.org/pmid.html
    • Other Code / Scripts / Snippets / Gists
      • bib2wikidata https://github.com/mitar/bib2wikidata
        • MeteorJS application that enables read/write access (via oath) to a mediawiki/wikibase site, and further, the automatic import of bibtex bibliographies (CSL format) to Wikidata.
      • Citoid (see also Zotero below) https://www.mediawiki.org/wiki/Citoid
        • nodejs application to act as a client to a Zotero Translation Server and as a server to a companion mediawiki extension (also named citoid) that feeds the compiled citation data into the VisualEditor extension, enabling users to quickly locate sources and select metadata for use in a Wikipedia article, along with automatic reference formatting.
  • 3rd Party
    • Zotero
      • Bibliography management system
      • Standard zotero.org application and service (browser plugin, zotero servers, etc) - https://www.zotero.org/
        • A thread about integrating with Wikipedia exists on the Zotero forums since 2006 - https://forums.zotero.org/discussion/196/integration-with-wikipedia-reference-system/
        • Here is Zotero support documentation describing how to work with Wikipedia and Zotero - https://www.zotero.org/support/kb/zotero_and_wikipedia
        • There is also Wikipedia documentation on using Zotero as well - https://en.wikipedia.org/wiki/Wikipedia:Citing_sources_with_Zotero
      • Zotero translation-server (xpcshell + zotero translators + xulrunner)
        • Source: https://github.com/zotero/translation-server (server), https://github.com/zotero/translators (translators)
        • Note there was previously a node.js version of this server that has been discontinued: https://github.com/zotero/zotero-node
        • Usage via Citoid (see above), a nodejs application that fetches source metadata via Zotero translation-server.
    • WIKINDX
      • Bibliography management system, supports multiple formats, including bibtex.
      • Description: http://wikindx.sourceforge.net/
• IdeaLab Grant Applications
  • https://meta.wikimedia.org/wiki/Grants:IdeaLab/Tools_for_using_wikidata_items_as_citations - Project to advance state-of-the-art for implementing tools for citations in coordination with Wikidata
  • https://meta.wikimedia.org/wiki/Grants:IdeaLab/A_citation_a_day - Citation game to encourage improvements to verifiability of statements in Wikipedia articles, shows interest in improving content and engaging editors.
• Research Projects
  • Oral Citations - https://meta.wikimedia.org/wiki/Research:Oral_Citations - Project to expand scope and repertoire of possible formats for reference sources (i.e. include oral record, audio) in order to overcome a lack of published material in emerging languages on Wikipedia.
  • Understanding Sources - https://meta.wikimedia.org/wiki/Research:Understanding_sources - Analyzing users' selections of news sources for unfolding events.
  • Citation Practices - https://meta.wikimedia.org/wiki/Research:Citation_Practices - Undergraduate research project to better understand how and why Wikipedia editors add citations to articles, results pending.

TODO

• Consider updating format of audit information
  • Tools could be organized into one or more table(s)
  • Determine standard fields for software information
• Provide description or visualization of the relationships between these projects and Wikimedia projects/communities. E.g. portray sample workflows, incorporate any usage information, etc.
• Add more tools, resources, examples, new sections, etc to this page.