What is Altmetric Attention Score

By Shashikant Nishant Sharma

The Altmetric Attention Score, or Altmetric, is a weighted count of how much attention an article has received from non-traditional sources. It’s calculated using an automated algorithm that considers three main factors: 

• Volume: The more people mention the article, the higher the score. 
• Sources: Each type of mention contributes a different amount to the score. For example, a news article is worth more than a tweet. 
• Author: The author of a post is important, too. For example, a post from a doctor that’s followed by other doctors will contribute more than an automated post from a journal. 

Altmetrics can be an early indicator of an article’s potential impact. They can also help get work noticed, which may lead to citations. 

Altmetrics tracks engagement with research as it’s shared, mentioned, reviewed, and read online. The Altmetric Details Page can show a demographics map of the locations of users who have mentioned or saved the research on Twitter or Mendeley. 

The Altmetric Attention Score is a metric designed to measure the attention that a research output, such as a journal article, receives online. Unlike traditional citation metrics, which focus on academic citations, the Altmetric Attention Score considers a wider range of indicators, including social media mentions, news articles, policy documents, blogs, and other platforms where research can be discussed and disseminated. Here’s a detailed overview of how it works and what it represents:

1. Purpose of the Altmetric Attention Score

• Broad Reach Measurement: The score aims to provide a more comprehensive picture of the influence and reach of research beyond academia.
• Immediate Impact: It helps track the immediate impact and public interest in research soon after publication, unlike citations that accumulate over longer periods.

2. Components of the Score

The score is based on various sources that mention or link to a research output. These sources include:

• Social Media: Platforms like Twitter (now X), Facebook, LinkedIn, and others.
• News Outlets: Online news articles that mention the research.
• Policy Documents: Citations or references in official documents from government agencies or policy makers.
• Blogs and Websites: Mentions in academic and non-academic blogs.
• Wikipedia: References in Wikipedia entries.
• Mendeley and other Reference Managers: Mentions in library catalogs or bookmarks in reference management systems.

3. Calculation of the Score

• Weighted Sources: Each type of mention is assigned a different weight based on its source and perceived importance. For example, a news article may have a higher weight than a tweet.
• Volume and Sources: The score increases with the number of mentions and the variety of sources. Diverse sources contribute more significantly than repeated mentions from a single platform.
• Attention and Engagement: It considers not just mentions, but also the level of engagement, such as likes, shares, and comments.

4. Score Representation

• Score Badge: The score is often visualized with a colorful badge. The colors on the badge represent different sources of attention: blue for Twitter, red for news, yellow for blogs, etc.
• Numeric Score: The number itself ranges widely depending on the level of attention. Higher scores indicate broader and more varied attention.

5. Interpretation of the Score

• Contextual Understanding: A high score indicates widespread attention, but not necessarily positive or academic validation. It reflects the reach and engagement but not the quality or scientific rigor.
• Comparison Across Fields: Altmetric scores are field-agnostic, so comparisons across different disciplines should be approached with caution. A high score in a niche field might not be directly comparable to a high score in a more popular or public-interest field.

6. Limitations

• Potential for Misinterpretation: High attention does not equate to high-quality research; it simply measures visibility and interest.
• Vulnerability to Manipulation: As with any metric based on online activity, there is potential for manipulation through coordinated promotions or excessive self-promotion.

7. Applications

• Researcher Impact: Helps researchers and institutions understand the broader impact of their work beyond academic circles.
• Funding and Policymaking: Can influence decisions by showing how research resonates with the public and policymakers.
• Academic Institutions: Universities and research bodies use the score to demonstrate the societal impact of their research.

8. Criticism and Challenges

• Quality vs. Popularity: Some criticize the metric for conflating popularity with impact, as a high score can result from controversial or sensational topics.
• Short-Term Focus: It emphasizes immediate reactions and may not capture long-term academic influence.

Overall, the Altmetric Attention Score serves as a valuable tool for assessing the broader societal impact of research, offering insights into how research outputs are discussed and disseminated beyond traditional academic channels. However, it should be used alongside other metrics and qualitative evaluations to provide a balanced understanding of research impact.

References

Barakat, A. F., Nimri, N., Shokr, M., Mahtta, D., Mansoor, H., Masri, A., & Elgendy, I. Y. (2019). Correlation of altmetric attention score and citations for high-impact general medicine journals: a cross-sectional study. Journal of general internal medicine, 34, 825-827.

Elmore, S. A. (2018). The altmetric attention score: what does it mean and why should I care?. Toxicologic pathology, 46(3), 252-255.

Huang, W., Wang, P., & Wu, Q. (2018). A correlation comparison between Altmetric Attention Scores and citations for six PLOS journals. PloS one, 13(4), e0194962.

Iglesias‐Puzas, Á., Conde‐Taboada, A., Aranegui‐Arteaga, B., & López‐Bran, E. (2021). Factors associated with high Altmetric Attention Score in dermatology research. Australasian Journal of Dermatology, 62(3), e380-e385.

Kolahi, J., Khazaei, S., Iranmanesh, P., Kim, J., Bang, H., & Khademi, A. (2021). Meta‐analysis of correlations between altmetric attention score and citations in health sciences. BioMed research international, 2021(1), 6680764.