From 80,000 Hours Research
This is just a rough draft. We should create (a) a shorter version based on our most common mistakes / omissions (b) different versions for different pages.
- 1 Writing clarity
- 2 Have all jargon words and abbreviations been replaced or explained?
- 3 Have we cut out unnecessary hedging words?
- 4 Have all claims been given an example?
- 5 Can the summary be understood without reading the rest?
- 6 Is it easy to understand the main conclusions?
- 7 Have all cliches been removed?
- 8 Check all abstract words to see if they can be replaced by more concrete terms?
- 9 Research quality
- 10 Does the bottom line seem correct, given the evidence that was provided?
- 11 Do any claims in this document seem overconfident?
- 12 Do any of the claims in the document need citations?
- 13 Does the document assert that X causes Y with effect size Z on the basis of low quality evidence, such as a single RCT?
- 14 Whenever someone makes a factual claim which is not common knowledge and there is a citation for that claim, include the citation.
- 15 Are there important remaining questions that the document does not clearly acknowledge?
- 16 Does the document defend any controversial claims with appropriate caution and qualification?
- 17 Does the document follow standard formatting?
- 18 Do all the links work?
- 19 Have footnotes copied and pasted relevant content to establish that what the body concludes on the basis of the footnote is true?
- 20 Was the research process clearly outlined somewhere?
- 21 Was the research process reasonable for answering the question? Were there any literature searches that should have been done but were not?
- 22 Did the document appropriately select and evaluate literature reviews on the question? 
- 23 Were important but difficult “judgment calls” clearly identified in the document. E.g., if there were two reasonable ways one could have done a certain calculation, was this fact noted and was there an explanation of why it was done in the particular way that it was? Or, if there were two reasonable ways that a literature search could have been limited, was that noted and was there an explanation of why it was done the way that it was?
- 24 Does the document carefully attend to questions of causal attribution and publication bias? See here for guidelines
- 25 Our research quality rubric
Have all jargon words and abbreviations been replaced or explained?
Have we cut out unnecessary hedging words?
Have all claims been given an example?
Can the summary be understood without reading the rest?
Is it easy to understand the main conclusions?
Have all cliches been removed?
Check all abstract words to see if they can be replaced by more concrete terms?
Adapted from GiveWell’s checklist