BMGF Open Science Metrics Report

1 Data summary

We started with 1000 articles funded by the Bill and Melinda Gates Foundation; these articles were in xml format.

2 Data Generation & Sharing

We exclude articles that did not generate data. Articles sharing data as supplemental material were identified by locating the list of supplemental files in the full text and finding terms like ‘dataset’ or ‘data file’ in either the supplemental file name or description.

Articles sharing data online contained a) links to data repositories (e.g. Zenodo or Dryad) or other online locations (e.g. Github), b) DOIs or other Permanent Identifiers (PIDs) for data repositories, or c) accession numbers associated with data repositories. When an article was found to share data both in the supplemental material and online, we classified these as ‘online’ in the below table and figure.

Data Generation & Sharing
Data Sharing Status Total Percent
No data generated 15 2
No data shared 525 53
Supp mat 361 36
Online 98 10

3 Data repositories

The online repositories identified for ‘data sharing’ above can be identified through their DOIs or other PIDs, the site linked to by a dataset URL, or through the characteristic format of an accession number (e.g. PRJNA12345 is the format of a BioProject on the NCBI website).

Most commonly used data repositories
Data Repositories Total Percent
Github 36 48.0
NCBI Bioproject 6 8.0
Gene Expression Omnibus 4 5.3
Open Science Framework 4 5.3
Other 4 5.3
Dryad Digital Repository 3 4.0
Harvard Dataverse 3 4.0
World Health Organization 3 4.0
Centre for Disease Control (CDC) 2 2.7
ClinicalTrials.gov 2 2.7
ENA/EBI Biosample 2 2.7
Mendeley Data 2 2.7
NCBI Sequence Read Archive 2 2.7
figshare 2 2.7

4 Code Generation & Sharing

To identify articles producing shareable code objects the full text is searched for the names of command line software or programming environments. Articles mentioning one or more software or environments are classified as ‘generating code’.

To detect code sharing, we searched the full text for a) links or b) DOIs (or other PIDs) for repositories where code objects could be shared. We also check the supplemental file titles and descriptions for terms like ‘script’ or ‘code’ for code sharing in the supplemental material.

Articles found to share code both in the supplemental material and online are grouped under ‘online’ in the table and figure below.

Code Object Generation & Sharing
Code Sharing Status Total Percent
No code generated 615 62
No code shared 328 33
Supp. mat. 1 0
Online 56 6

5 Preprinting

To assess whether any articles were posted as a preprint, we performed a fuzzy match for the article title and authors against a listing of articles from all of the major preprint servers.

Preprint Repositories Total Percent
No preprint 892 89
medRxiv 53 5
bioRxiv 43 4
Other 6 1
Research Square 6 1