Prevalence of Open Method practices

Authors
Affiliation

I. Grypari

Athena Research Center

N. Manola

Athena Research Center

H. Papageorgiou

Athena Research Center

P. Stavropoulos

Athena Research Center

History

Version Revision date Revision Author
1.0 2023-02-12 First draft I. Grypari, N. Manola, H. Papageorgiou, P. Stavropoulos

Description

“Methods describe the processes, procedures, and materials used in a research investigation. Methods can take many forms depending on the field and approach, including study designs, protocols, code, materials and reagents, databases and more.”1

Open methods refer to:

  1. Open Access to the various elements of the scientific method (datasets, software/code, protocols, materials, etc.)
  2. FAIRness of the same elements (i.e. following the FAIR principles), and,
  3. an Open and FAIR documentation, that facilitates reproducibility and reuse of the study methods.

Metrics

Number/share of publications with Open Source code

Description: Number of publications with Open Source code: This is the number of publications for which the code that was developed in this context to produce the scientific outcomes included in the publication is shared/can be found with Open Access in Open Repositories.

Benefits: Providing Open Access to software/code of the scientific method is of key importance of understanding, evaluating, replicating and extending the study.

Limitations: In most cases, detailed documentation must accompany the code including data management, cleansing and pre-processing, configuration files and workflows.

Differences: ..?

Measurement

There is no comprehensive list of publication-software pairs. The metric is partially covered by well-established repositories like GitHub or existing data sources like OpenAIRE. Automated approaches have been built (e.g., PapersWithCode) or are under development in the scientific community, scanning the publication text and spotting mentions of software/code and its FAIR metadata.

There is no well-established methodology to automatically find publications with code. Some suggested methods are the following:

  1. Text mining and machine learning algorithm to find mentions of Open Software/Code and its FAIR metadata in the publication text.
  2. Search relevant fields or tags in specific databases to find publications with software/code.

Footnotes

  1. https://plos.org/open-science/open-methods/↩︎

Reuse

Open Science Impact Indicator Handbook © 2024 by PathOS is licensed under CC BY 4.0 (View License)

Citation

BibTeX citation:
@online{apartis2024,
  author = {Apartis, S. and Catalano, G. and Consiglio, G. and Costas,
    R. and Delugas, E. and Dulong de Rosnay, M. and Grypari, I. and
    Karasz, I. and Klebel, Thomas and Kormann, E. and Manola, N. and
    Papageorgiou, H. and Seminaroti, E. and Stavropoulos, P. and Stoy,
    L. and Traag, V.A. and van Leeuwen, T. and Venturini, T. and
    Vignetti, S. and Waltman, L. and Willemse, T.},
  title = {Open {Science} {Impact} {Indicator} {Handbook}},
  date = {2024},
  url = {https://handbook.pathos-project.eu/sections/1_open_science/prevalence_open_method_practices.html},
  doi = {10.5281/zenodo.14538442},
  langid = {en}
}
For attribution, please cite this work as:
Apartis, S., G. Catalano, G. Consiglio, R. Costas, E. Delugas, M. Dulong de Rosnay, I. Grypari, et al. 2024. “Open Science Impact Indicator Handbook.” Zenodo. 2024. https://doi.org/10.5281/zenodo.14538442.