{ "cells": [ { "cell_type": "markdown", "id": "c3d5cc64", "metadata": {}, "source": [ "---\n", "title: \"Pitching Data Investigations\"\n", "pagetitle: \"Pitching Data Investigations\"\n", "description-meta: \"Experiment checklist\"\n", "description-title: \"Experiment checklist\"\n", "date: \"08-13-2023\"\n", "date-modified: \"01-04-2025\"\n", "bibliography: references.bib\n", "execute: \n", " enabled: false\n", "keywords: pitching stories, experiment planning\n", "twitter-card:\n", " title: \"Pitching Hypothesis-Driven Data Investigations\"\n", " description: \"Answer these questions to bullet-proof your story\"\n", " image: assets/inspect-element-logo.jpg\n", "open-graph:\n", " title: \"Pitching Hypothesis-Driven Data Investigations\"\n", " description: \"Answer these questions to bullet-proof your story\"\n", " locale: us_EN\n", " site-name: Inspect Element\n", " image: assets/inspect-element-logo.jpg\n", "format:\n", " html:\n", " toc: false\n", "href: checklist\n", "---" ] }, { "cell_type": "markdown", "id": "68af51e4", "metadata": {}, "source": [ "This document asks essential questions to plan data investigations and experiments. Revisit these questions throughout your reporting and research, and use them to communicate your intentions and limitations with your editor. It will help determine if a story is worth pursuing by giving an estimation of time, complexity, and impact.\n", "\n", "As a side benefit, these questions form the backbone of a methodology to get reviewed by experts, as well as the subject of your investigation.\n", "\n", "::: {.callout-note}\n", "Copy the checklist as text [below](#accountability-reporting-checklist), or as a public [Google Doc](https://docs.google.com/document/d/1LXXxMgRlssaQwzs_fmqwIpwySdqXMXpwLaHQ-N5Vdw8/edit?usp=sharing).\n", ":::\n", "\n", "\n", "## Accountability Reporting Checklist\n", "To direct reporting, highlight open factual questions to answer.\n", "\n", "**Hypothesis**: What is the reporting question?\n", "
\n", "_This is an investigative claim (1-2 sentences) that can be tested. _\n", "
\n", "\n", "**Wrongdoing**: Who is causing it? Who is harmed?\n", "
\n", "_Who are the key players?
\n", "What’s the scale (size of the market, # of people affected) and scope (local, national, international)?
\n", "Is it getting worse? \n", "_\n", "
\n", "\n", "**Accountability**: What standard will I use to assess harm?\n", "
\n", "_Note relevant laws (regulation) and corporate claims to check.
\n", "Is there hypocrisy, misuse of power, or legal gray areas?
\n", "Is the problem being addressed?_\n", "
\n", "\n", "**Lit Review and Anecdotes**: What evidence supports the hypothesis?\n", "
\n", "_Include the best research and reporting (with links) on the subject.
\n", "What will we do differently and what do we bring to the table?
\n", "Have you conducted preliminary interviews or found other leads?_\n", "
\n", "\n", "**Categorization**: Choose accurate and reproducible terminology.\n", "
\n", "_Seldom are key variables found neat and tidy within a spreadsheet column._
\n", "_How will you categorize terms (“hate speech” or “slow internet”)?_
\n", "_Are there experts to lean on?_\n", "
\n", "\n", "**Viability**: What is a quick experiment and reporting plan to test the hypothesis?\n", "
\n", "_Determine whether we have a feasible story early._\n", "
\n", "\n", "**Key ingredients**: List with specificity.\n", "
\n", "_Note the “getability” of each item._\n", "\n", "- **Humans** – what does the ideal interviewee look like?\n", "\n", "- **Documents** – Are there agencies to FOIA or other receipts we can find?\n", "\n", "- **Data** – how will you gather, sample, merge, clean, analyze the data?\n", "\n", "- **Observation** - ground-truthing, field reporting, etc.\n", "
\n", "\n", "**Visualize the article**: what are possible headlines, copy, or graphics?\n", "
\n", "_With reporting elements in hand, how will you present the key information to readers?_\n", "
\n", "\n", "**Expectations**: what are the [min and max](https://gijn.org/resource/introduction-investigative-journalism/) stories?\n", "
\n", "\n", "- **Minimum story**\n", "\n", "- **Maximum story**\n", "
\n", "\n", "**Bulletproofing**: What are obstacles and limitations? \n", "
\n", "_What problems do you foresee and how do we address them?
\n", "Are there outside experts or colleagues who will roleplay Reviewer #2?_\n", "
\n", "\n", "**List of questions to answer before proceeding**\n", "
\n", "...\n", "
" ] }, { "cell_type": "markdown", "id": "eefd3256", "metadata": {}, "source": [ "## Acknowledgements\n", "\n", "This checklist is adapted from a [checklist](https://docs.google.com/document/d/19tft98L90zUq4tn6TBXgaFacdbaI3Kr_/) used by my editors Julia Angwin and Evelyn Larrubia at The Markup. As of 2025, I have incorporated aspects of several other checklists used by peers across different newsrooms. Jeremy Singer-Vine provided feedback on an previous draft of the adapted list.\n" ] }, { "cell_type": "raw", "id": "91e903da", "metadata": {}, "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.3" } }, "nbformat": 4, "nbformat_minor": 5 }