Research habits

General habits

• Make or add to Wikipedia pages in the course of reading about a topic.
• Frequently Google for information to build understanding of the base rates in the area you’re reading about.
• Google the topic with the names of various organizations or movements or ideologies (to build intuition for what various people think about the topic).
  • Similarly, Google the topic along with terms like “criticisms of”, “critique”, “sucks”, “wrong”, “bad”, etc. to see what opponents think. (More generally, there are two ways to build intuition on a topic: to obtain representative data so you understand the base rates, and to collect many (especially extreme) anecdotes so you have a good idea of the space of possibilities of opinion. The strategy of this bullet point helps with the latter.)
• Email relevant people for more information if you can’t find what you’re looking for (and remember to follow up if they don’t respond).
• Archive your online sources to combat linkrot. I use the Scrapbook addon in Firefox (local archive), as well as Pinboard (personal online archive) and Archive.org (public online archive).
• Tabulating information as you come across it will help to make things more explicit, especially by revealing all of the relevant dimensions and exposing the empty cells in the table. Examples: Tabular summary of unschooling literature, User:Issa Rice/Priors for CP, some of the pages on Subwiki, like Symmetric group:S3, and some of the pages on the Cognito Mentoring wiki, like Lower division undergraduate mathematics course structure.

Common frustrations

• Copying text from PDFs can be frustrating. Sometimes using a different PDF viewer helps (e.g. Firefox’s PDF viewer followed by Atril/Evince in case of severe formatting issues). I also wrote a small program called pdftextfmt which will do some simple regex replacement to get a decent output in most cases.

• Generating citations for webpages is tedious. For this reason I wrote a citation generator for Wikipedia, which does something like 80% of the work for 80% of websites.

• I also reference things by linking to them, and found it annoying to copy the page titles, so I wrote an autolink program.

• Being careful (i.e. careful enough that one’s research is representative of the underlying reality) takes a lot of time and effort. It would be great if more of the tedious parts could be automated away.

External links

• Carl Shulman’s research advice (quite coincidentally, Claire Zabel shared Carl’s advice on the same day I began working on this page)
• gwern’s notes on organizing information
• “Fact Posts: How and Why” by Sarah Constantin