Uptake by media
Description
This indicator provides an idea of how frequently a particular scientific publication is mentioned or referenced in the media. Here, media can be considered in a broad way, including not only traditional media, such as newspapers or television, but also more recently emerged social media, including for example Twitter (now X), Facebook or Reddit, and Wikipedia. The visibility of individual scientific publications can then be aggregated in various ways, looking for instance at journals, institutions or even entire countries.
Although this provides some idea of whether science is being used by society, it is relatively limited. That is, by just looking at the fact that research is mentioned, we do not know how it is being used. That is, some research might be frequently mentioned, but ultimately it may not play a larger role in societal debates, support policy making or ignite some product development.
Alternative approaches, for example focussing on the mention of researchers or universities instead of references to a publication, would be interesting. These approaches are relatively underdeveloped at the moment, but might be explored further in the future.
These indicators can also be used indirectly. That is, it was suggested in the literature that instead of tracking the uptake of individual papers, one might instead consider the uptake of a paper’s topic more generally (Noyons 2019). Although we will not describe this approach in detail, it offers an additional possibility that could be explored. One advantage of this approach is that it acknowledges the fact that scientific research can inform media debate even when individual publications are not explicitly mentioned in the media.
Finally, although the focus here is on individual publications, there are also other way to track the uptake of science by the media. For instance, one could directly try to search for an academic journal, instead of trying to identify the media uptake of all publications of that journal and then aggregating to the journal. The same applies of course to other aggregates, such as institutions or repositories. We will not describe this approach here, but it is worthwhile to consider it.
Metrics
#/% of references in Wikipedia
This metric operationalises the uptake of science by Wikipedia. Most articles on Wikipedia have a formal way of citing scientific literature, in a way that is not unlike academic literature itself. However, the audience of Wikipedia is different, and broader than scientists themselves, although not everybody may make use of Wikipedia equally. Because of the formalisation of citations, it means that tracking citations from Wikipedia to scientific publications is relatively accurate. Nonetheless, there are still some challenges with correctly matching citations from Wikipedia to the correct publications, especially if identifiers such as DOIs are not included.
Measurement
The metric can be measured by using existing datasources that already track the uptake of science in social media.
#/% of references in newspapers
This metric operationalises the uptake of science by newspapers. This typically tracks the explicit mention (usually the URL or DOI in a hyperlink in the online version of an article) of science. Arguably, science frequently appears in newspapers without it being explicitly mentioned or linked to. For example, some studies might be mentioned just informally (e.g. “a recent article by …”). Moreover, scientists themselves regularly appear as commentators in newspapers, but this is usually not tracked systematically. So, overall, this metric is not necessarily the most accurate indicator, because it most likely underestimates the uptake of science by newspapers.
Measurement
The metric can be measured by using existing datasources that already track the uptake of science in social media.
Datasources
Crossref Event Data
Crossref Event Data is an open dataset that offers some view of how scientific publications are linked to by a number of other services (including citations). In particular, in addition to citation data from Crossref and DataCite, it collects data from
- Faculty Opinions
- Hypothes.is
- Blogs/media
- Stack Exchange Network
- Wikipedia
- Wordpress.com
The data can be accessed openly through the API. For example, you can get all indexed events through the URL
//api.eventdata.crossref.org/v1/events?mailto=example@example.org&obj-id=10.5555/12345678 https:
Here, obj-id
refers to the DOI (or URL) of a publication, and mailto
refers to an e-mail address (which is not mandatory). Based on these results, it is possible to establish counts of usage for the various datasources that are being tracked. Note that social media is not tracked extensively. Twitter was tracked until February 2023, but was discontinued, and historical data removed. Only items registered by Crossref are tracked.
Altmetric
Altmetric is a commercial provider of various metrics of uptake by (social) media. The dataset is not openly available, but they do provide access for research purposes. Documentation of the API is avalable from https://api.altmetric.com/. Because the datasource is not open, we do not provide explicit examples of the use of the API. Altmetric is part of Digital Science.
In addition to citation data (provided by Dimensions) and readership information, Altmetrics collects data from the following sources:
- Policy
- Twitter (now X)
- YouTube
- Q&A (Stack Overflow)
- Wikipedia
- Open Syllabus
- Blogs / Media
- Publons peer review
- Faculty Opinions
PlumX
PlumX is a commercial provider of various metrics of uptake by (social) media. The dataset is not openly available. An API is available for Scopus subscribers. Because the datasource is not open, we do not provide explicit examples of the use of the API. PlumX is part of Elsevier.
In addition to citation, views and download information, PlumX collects data from the following sources:
- Vimeo, Soundcloud, YouTube
- Blogs / Media
- Wikipedia
Known correlates
Correlations among various measure of uptake by media have been studies (Fang et al. 2020).
References
Reuse
Citation
@online{apartis2024,
author = {Apartis, S. and Catalano, G. and Consiglio, G. and Costas,
R. and Delugas, E. and Dulong de Rosnay, M. and Grypari, I. and
Karasz, I. and Klebel, Thomas and Kormann, E. and Manola, N. and
Papageorgiou, H. and Seminaroti, E. and Stavropoulos, P. and Stoy,
L. and Traag, V.A. and van Leeuwen, T. and Venturini, T. and
Vignetti, S. and Waltman, L. and Willemse, T.},
title = {Open {Science} {Impact} {Indicator} {Handbook}},
date = {2024},
url = {https://handbook.pathos-project.eu/sections/3_societal_impact/uptake_by_media.html},
doi = {10.5281/zenodo.14538442},
langid = {en}
}