Skip to Main Content
University of York Library
Library Subject Guides

Bibliometrics: a Practical Guide

Evidence your strengths

Take control: Choose your own metrics

When writing a CV, funding application or project outcome report it might be useful to support your claims using quantitative research indicators. What are you most proud of, what sets you apart?

Examples of research indicators:

  • Number of co-authors across x countries
  • Citation count
  • Open research practices in your publications
  • Patent or policy citations
  • press or social media attention (check altmetric attention score)

H-Index

The h-index aims to measure the scholarly influence of an author. A scientist has an h-index of h if h of their papers have at least h citations each. For example, an author with 3 publications with 31 citations, 3 citations and 2 citations repectively has an h-index of 2, as 2 of his publications have 2 or more citations. As more and more limitations of the h-index are being identified, it is slowly falling out use.

Limitations: Publication norms vary greatly between disciplines. The h-index cannot be used to compare researchers from different fields. Additionally, the scholar's career length is not taken into account, which benefits more experienced over early-career researchers. The h-index is also insensitive to highly-cited papers, rewarding productive researchers over individuals with a more selective research focus.

Many tweaks of the h-index attempted to fix the above issues (g-index, hg-index, q2-index). However, none have been widely adopted.

Narrative CVs

In an effort to reform research assessments, many organisations are exploring new CV formats.

How do I write a narrative CV?

  • A narrative CV contains written descriptions of contributions and achievements.
  • Moving away from journal-based metrics to evaluate research records, a narrative CV allows for a broader understanding of research outputs, skills and experiences.
  • Use active language and support your statement with evidence that showcase your work. (Use C-A-R structure: Challenge, Action, Result)
  • The university of Glasgow developed a 25min course that might be useful.

Databases

Whilst all sources of bibliometric data are continually extending their coverage, no single database indexes all the world's scholarly publications. Particularly, coverage of the arts and humanities may be less comprehensive as their publication practices differ significantly from sciences and social sciences.

Generally, Web of Science and Scopus offer good coverage of sciences and social sciences, with less emphasis on humanities. Google Scholar covers all disciplines equally well, and captures 'grey literature' such as policy papers and technical reports in addition to journals.  But the criteria for inclusion in Google Scholar are not wholly transparent.

Traditionally, bibliometrics has set a strong focus on citations to evidence research strengths. However, publication practices differ across disciplines, making citations an unreliable indicator for comparison across research fields. Field-weighted metrics, such as the Field-Weighted Citation Impact on Scopus and SciVal, are better indicators of citation performance when multiple disciplines are compared.

Although citations are a common impact indicator within the research world, they cannot reflect the impact of our work outside the academic realm.

Especially when working in a more applied field, we cannot rely on citations to measure the impact of research. Policy or patents mentions, software and data downloads, views in online databases, other altmetrics (news mentions, tweets, blogs) and code forks might be more useful, depending on the aims of your research.

Where to find the data

  1. Use the 'Author' search to find all the publications in the database for an individual. 
    scopus author search window
    Recommended search strategy: last name, first initial AND affiliation e.g. University of York.
     
  2. If appropriate, use the left-hand 'Refine' menu to limit the results to the individual's specific parameters.
     
  3. For an overview of an individual's publications, including citation counts, number of co-authors and preprints, follow the link on their name.
     
  4. To drill down on their citations (or if more than one item in the list applies to your author search), choose 'view citation overview'.
    scopus link to view citation count
  5. On the 'Citation overview' screen, citations are broken down graphically by year, with the option to exclude self-citations. Below, a table lists the citation count per publication. The total citation count can be found in the top row of the table.
    scopus total citation count view

Note: When presenting author-level metrics based on publication data bases, it is important to include how many publications (and hence citations, co-authors etc.) were missing from the list as no database covers all sources.

  1. Using the 'Researchers' tab, you can find all the publications in the database for an individual. individual. search for researcher on web of science in the 'researchers' tab
     
  2. If appropriate, use the left-hand 'Refine Results' menu to limit the results to the individual's specific parameters.
    Note: The more common the name, the more refinements you may need to make to ensure that you only identify items written by that individual.
     
  3. Choose a single profile, or, if more than one profile applies to your author search, 'view as combined record'.locate the 'view as combined record' if more than one profile applies to your author
  4. On the right hand side of the author's profile, some author-level metrics are summarised, including the sum of citations. For more details, follow the link to the 'citation report', which includes graphical representations and a table of publications and citations over time.Web of Science Core Collection metrics with sum of times cited and link to citation report

 

 

 

Note: When presenting author-level metrics based on publication data bases, it is important to include how many publications (and hence citations, co-authors etc.) were missing from the list as no database covers all sources.

If you don't have a profile on Google Scholar yet and are interested in your own metrics, you first have to create a profile: Using your Google (york.ac.uk) account, follow the 'my profile' link in the top left corner. Further instructions for creating a Google Scholar profile are on the promote your research profile page.

Once complete, a summary of your citation metrics in Google Scholar can be found on the right hand side of your profile (see example to the right).

You can also get an overview of people at York with a (public) Google Scholar Citations profile.


To identify citation counts for someone else, search on the author's name (and affiliation) in Google Scholar. If they have set up a public profile, a link in a list of user profiles leads you to their citation metrics.
google lists public 'user profiles' that can be accessed following an author name search

SciVal is a research performance analysis tool based on the Scopus database. The University of York pays for a subscription, so if you sign up with your york.ac.uk email address you are all set to go.

The easiest way of accessing information on your own SciVal research performance indicators, is through the 'Export to SciVal' link on you Scopus profile (see below). Navigate your way to your own Scopus profile using the Author Search tab. Under your Scopus summary indicators, you will find the link to 'Export to SciVal'.

 

Screenshot of Scopus profile with link 'export to Scival'

This will take you to the SciVal overview page, where you can see aggregate measures for your publications, publication views and citations, topic and subject mix, collaborations, the journals you published in and the patent impact of your work.

"Altmetrics" are indicators that go beyond the traditional citation-based metrics. This can include article views, likes, downloads, social media and news mentions, policy citations. As bibliometrics is moving away from citations as their main indicator, several providers of altmetric data emerge and many publishers summarise some altmetric attention metrics on their article pages.Example of PlumX metrics from an article

PlumX is Elsevier's altmetric tool, which is incorporated on every Scopus article page (see to the right). An example PlumX summary of article usage, captures, mentions, Social Media attention and citations is shown to the right. 'View PlumX details' lets you further explore your altmetrics.

 

Altmetric.com calculates an Altmetric Attention Score for every article, which reflects online engagement with your research. A characteristic donut badge (example below, click badge to see more details) helps you easily identify how much and what type of attention a research output has received. You can find altmetric donut badges on publisher article metrics pages, institutional repositories, or even individual researcher or lab publications pages.

 

 

The easiest way to access altmetric information on any article is to download the Altmetric bookmarklet. Install it in your browser to get one-click article level indicators when reading an online journal article.

 

Our tip: Altmetrics accumulate long before any citations roll in, allowing you to evidence the influence of your work a lot earlier. Analysing the types (colours in the PlumX or Altmetrics badge) of engagement can also help you identify the most effective channels of outreach for your work.