The medical research literature contains plenty of contradictory results (and has a strong publication bias). Attempting to make more informed decisions, I would like to educate myself to judge how much importance I should give to the results presented in a given medical research article. For the sake of concreteness, let's assume we only consider medical research articles that study the impact of drug X or medical treatment Z on medical condition Z.

What are the criteria for assessing the quality of evidence in such medical research articles?

For example, Atkins, David, Dana Best, Peter A. Briss, Martin Eccles, Yngve Falck-Ytter, Signe Flottorp, Gordon H. Guyatt et al. "Grading quality of evidence and strength of recommendations." BMJ (Clinical research ed.) (2004). Harvard proposed the following:

enter image description here

enter image description here

which they applied to a few research articles to exemplify the use of their assessment grid:

enter image description here

I wonder whether there exist other similar attempts to lay out a systematic, objectively applicable assessment strategy.

I am aware of the Level of Evidence pyramid (image from the MOOC Introduction to Systematic Review and Meta-Analysis https://www.coursera.org/learn/systematic-review):

enter image description here

Note that I am only interested in assessing the quality of the evidence, and not the quantity of the entire research article. For instance, the quality of writing or the quality of the literature review could be an element to the judge the quality of the research article, but is not useful when the judging the presented evidence.

Related: Medical research articles annotated with quality of evidence.

1 Answer 1


I am not sure if I am answering your question correctly but I wanted to point you towards the following tools that I have found very useful when conducting critical appraisal of literature:

CASP Tools + Checklists

From the above site:

This set of eight critical appraisal tools are designed to be used when reading research, these include tools for Systematic Reviews, Randomised Controlled Trials, Cohort Studies, Case Control Studies, Economic Evaluations, Diagnostic Studies, Qualitative studies and Clinical Prediction Rule.

Even if it doesn't help you at all, perhaps others may find it of use when browsing this question :)

  • Thanks, nice link. The questions are very clear, and it's great to see that the content is CC BY-NC-SA 3.0. Apr 8, 2016 at 15:35
  • @Franck What's CC BY-NC-SA 3.0.?
    – Lucky
    Apr 9, 2016 at 11:23
  • 1
    @Lucky license. Apr 9, 2016 at 13:25

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.