Four principles

From Four principles to make evidence synthesis more useful for policy by Christl A. Donnelly et al.

These are both examples of evidence synthesis. This is the process of bringing together information and knowledge from many sources and disciplines to inform debates and decisions. Issues range from the impact of a pesticide on pollinators to who should be quarantined during a disease outbreak.

An accurate, concise and unbiased synthesis of the available evidence is arguably one of the most valuable contributions a research community can offer decision-makers. The common question ‘What is the evidence?’ could be usefully rephrased as ‘Has sufficient synthesis of all the evidence been done in relation to that?’

[snip]

Here we present a set of principles for good evidence synthesis for policy (see ‘Four principles’). We are a group of academics, policymakers, evidence brokers and those responsible for research funding and publishing (including the editor-in-chief of this journal) in the United Kingdom — a world leader in science advice for policy.

There is the whiff of a bureaucratic hot house to their description, but the structure is useful. I look at this less as how do experts synthesize for policy makers and more as how does an informed citizen judge information.

Click to enlarge.

When a person looks at the information gathered to support an argument, these are good questions:

Is it inclusive?
Is it rigorous?
Is it transparent?
Is it accessible?

Their "inclusive" smacks a little of critical theory obsessives afraid that there is some aggrieved group not being included. I would make it more specific. Inclusive means, have all sides of an argument been included and especially have the relative strengths of all positions been addressed?

It is easy to create a compelling argument by cherry picking the evidence. A good synthesis addresses all the evidence, especially the strongest evidence against whatever conclusion is reached.

This rarely done within research teams and almost never done in the harsh real world where everyone is grubbing for resources, power and prestige.