Evaluating Evidence for Decision-making: Five Main Areas to Question

Quality

• Is this research published in a peer-reviewed journal?  Who published it? Is it a relevant publication to the decision? 
• Has this material been cited by others?  Recently?  Why....as a good example, bad example, foundational info?  Are the claims supported or challenged by other authors?
• How convincing is what the researcher is saying?  What arguments support the main point?
• Have limitations and biases been identified and acknowledged?
• Does the researcher include counterevidence of their claim?  Have they included all viewpoints?  Are there opposing views to consider?

Accuracy

• Is the evidence credible?  Are the facts accurate?  What methodology was used?
• Is the information credible?  Is it verifiable?
• Was the data triangulated?

Author

• Is the author known or credible in their field?  How can I tell?  What are their credentials?
• Have they published a substantial amount of work?  Are they known?  Are they well documented?  What are their affiliations? 
• What could be influencing their conclusions?  Who provided funding for their research?
• Can I trust their research?

Purpose

• What is the researcher trying to do/achieve?  What is their position on this topic?  What is the ‘so what’?
• Is the researcher or author stating fact or opinion?  If facts, are they backed up?
• What is the main point?  What is the purpose of this material?  What questions are being addressed?

Currency

• What is the date on this research / evidence?  Is it current or ‘classic’?
• How frequently is this publication published?

Other questions that we might ask are:

• How was the research funded?
• What assumptions did the researcher make, if any?
• Does it seem like there is an Inclination to favour certain evidence over other evidence because it is ‘home grown’ or produced in-house?

Not every question will be relevant to every evaluation, but this is a good starting point to look at the materials you gather for decision-making.  Barends et al., (2014, p. 11) describes the best available evidence should be gathered, then tested for trustworthiness.

This video (What is Critical Thinking?) provides a summary of what to consider when weighing evidence.  https://www.youtube.com/watch?v=HnJ1bqXUnIM