BMGF Open Science Metrics Report
1 Data summary
We started with 1000 articles funded by the Bill and Melinda Gates Foundation; these articles were in xml format.
2 Data Generation & Sharing
We exclude articles that did not generate data. Articles sharing data as supplemental material were identified by locating the list of supplemental files in the full text and finding terms like ‘dataset’ or ‘data file’ in either the supplemental file name or description.
Articles sharing data online contained a) links to data repositories (e.g. Zenodo or Dryad) or other online locations (e.g. Github), b) DOIs or other Permanent Identifiers (PIDs) for data repositories, or c) accession numbers associated with data repositories. When an article was found to share data both in the supplemental material and online, we classified these as ‘online’ in the below table and figure.
| Data Sharing Status | Total | Percent |
|---|---|---|
| No data generated | 15 | 2 |
| No data shared | 525 | 53 |
| Supp mat | 361 | 36 |
| Online | 98 | 10 |
3 Data repositories
The online repositories identified for ‘data sharing’ above can be identified through their DOIs or other PIDs, the site linked to by a dataset URL, or through the characteristic format of an accession number (e.g. PRJNA12345 is the format of a BioProject on the NCBI website).
| Data Repositories | Total | Percent |
|---|---|---|
| Github | 36 | 48.0 |
| NCBI Bioproject | 6 | 8.0 |
| Gene Expression Omnibus | 4 | 5.3 |
| Open Science Framework | 4 | 5.3 |
| Other | 4 | 5.3 |
| Dryad Digital Repository | 3 | 4.0 |
| Harvard Dataverse | 3 | 4.0 |
| World Health Organization | 3 | 4.0 |
| Centre for Disease Control (CDC) | 2 | 2.7 |
| ClinicalTrials.gov | 2 | 2.7 |
| ENA/EBI Biosample | 2 | 2.7 |
| Mendeley Data | 2 | 2.7 |
| NCBI Sequence Read Archive | 2 | 2.7 |
| figshare | 2 | 2.7 |
4 Code Generation & Sharing
To identify articles producing shareable code objects the full text is searched for the names of command line software or programming environments. Articles mentioning one or more software or environments are classified as ‘generating code’.
To detect code sharing, we searched the full text for a) links or b) DOIs (or other PIDs) for repositories where code objects could be shared. We also check the supplemental file titles and descriptions for terms like ‘script’ or ‘code’ for code sharing in the supplemental material.
Articles found to share code both in the supplemental material and online are grouped under ‘online’ in the table and figure below.
| Code Sharing Status | Total | Percent |
|---|---|---|
| No code generated | 615 | 62 |
| No code shared | 328 | 33 |
| Supp. mat. | 1 | 0 |
| Online | 56 | 6 |
5 Preprinting
To assess whether any articles were posted as a preprint, we performed a fuzzy match for the article title and authors against a listing of articles from all of the major preprint servers.
| Preprint Repositories | Total | Percent |
|---|---|---|
| No preprint | 892 | 89 |
| medRxiv | 53 | 5 |
| bioRxiv | 43 | 4 |
| Other | 6 | 1 |
| Research Square | 6 | 1 |


