NASA Open Science Metrics Report

1 Data summary

We started with 1000 articles funded by the National Aeronautics and Space Administration (NASA); these articles were in xml format.

2 Data Generation & Sharing

We exclude articles that did not generate data. Articles sharing data as supplemental material were identified by locating the list of supplemental files in the full text and finding terms like ‘dataset’ or ‘data file’ in either the supplemental file name or description.

Articles sharing data online contained a) links to data repositories (e.g. Zenodo or Dryad) or other online locations (e.g. Github), b) DOIs or other Permanent Identifiers (PIDs) for data repositories, or c) accession numbers associated with data repositories. When an article was found to share data both in the supplemental material and online, we classified these as ‘online’ in the below table and figure.

Data Generation & Sharing
Data Sharing Status Total Percent
No data generated 7 1
No data shared 675 68
Supp mat 47 5
Online 268 27

3 Data repositories

The online repositories identified for ‘data sharing’ above can be identified through their DOIs or other PIDs, the site linked to by a dataset URL, or through the characteristic format of an accession number (e.g. PRJNA12345 is the format of a BioProject on the NCBI website).

Most commonly used data repositories
Data Repositories Total Percent
Github 55 62.5
Zenodo 11 12.5
NCBI Bioproject 7 8.0
OpenfMRI 3 3.4
figshare 3 3.4
Dryad Digital Repository 2 2.3
Git Lab 2 2.3
Harvard Dataverse 2 2.3
NCBI Sequence Read Archive 2 2.3
SIMBAD Astronomical Database 1 1.1

4 Code Generation & Sharing

To identify articles producing shareable code objects the full text is searched for the names of command line software or programming environments. Articles mentioning one or more software or environments are classified as ‘generating code’.

To detect code sharing, we searched the full text for a) links or b) DOIs (or other PIDs) for repositories where code objects could be shared. We also check the supplemental file titles and descriptions for terms like ‘script’ or ‘code’ for code sharing in the supplemental material.

Articles found to share code both in the supplemental material and online are grouped under ‘online’ in the table and figure below.

Code Object Generation & Sharing
Code Sharing Status Total Percent
No code generated 534 54
No code shared 342 34
Online 122 12

5 Preprinting

To assess whether any articles were posted as a preprint, we performed a fuzzy match for the article title and authors against a listing of articles from all of the major preprint servers.

Preprint Repositories Total Percent
arXiv 652 65
No preprint 309 31
European Geosciences Union 17 2
bioRxiv 10 1
Other 6 1
Research Square 6 1