12.3 Document research and public records requests

Navigating Public Records Laws and Procedures

Public records laws exist to keep government transparent. They give journalists (and any citizen) the right to access government documents, which makes them one of the most powerful tools in investigative reporting. Understanding how to use these laws, and what to do when access is denied, is a core skill.

Public records laws and procedures

The Freedom of Information Act (FOIA) is the federal law that grants public access to records held by federal agencies. Every state also has its own version of this law (sometimes called "sunshine laws" or "open records laws"), and the rules vary from state to state. These laws cover a wide range of documents: emails, budgets, contracts, inspection reports, meeting minutes, and more.

That said, not everything is available. Common exemptions include:

• National security information (classified documents)
• Personal privacy protections (medical records, Social Security numbers)
• Law enforcement records tied to ongoing investigations
• Trade secrets and confidential business information submitted to the government

Submitting a public records request

Filing a request is a structured process. Here's how it works:

1. Identify the right agency. Figure out which government body holds the records you need. A city budget lives with the city clerk or finance department; federal environmental data might sit with the EPA.
2. Craft a clear, specific request. Vague requests get delayed or denied. Instead of asking for "all documents related to pollution," ask for "inspection reports for [specific facility] from January 2022 to December 2023." The more precise you are, the faster you'll get results.
3. Submit the request in writing. Most agencies have their own forms or online portals. Include your name, contact info, and a detailed description of what you're seeking.
4. Follow up. Agencies often have legal deadlines to respond (20 business days for federal FOIA requests, though state timelines vary). If you don't hear back, call or email the records custodian.
5. Appeal if denied. If your request is rejected, you have the right to appeal. The denial letter should explain the exemption cited and the appeals process. Many denials get overturned on appeal.

Working with public officials

Records custodians are the people who process your requests. Building a professional relationship with them makes a real difference. A few practical tips:

• Explain the public interest in what you're requesting. Officials are more cooperative when they understand why the information matters.
• Offer to narrow your request if it's too broad. A custodian might tell you a request would produce 50,000 pages. Narrowing the date range or specifying document types can speed things up considerably.
• Be persistent but respectful. These are people doing their jobs, and a good working relationship pays off on future requests too.

Organizing and Analyzing Document Sets

Once you have the documents, the real work begins. Investigative projects can involve hundreds or thousands of pages, so having a system to organize and analyze them is essential.

Document organization strategies

Create a document inventory. Assign each document a unique identifier (something like DOC-001, DOC-002) and log basic metadata: the date, source, subject, and a brief description. This inventory becomes your master reference when you need to locate something quickly.

Set up a filing system. Group documents by theme, chronology, or source, depending on what makes sense for your story. Use consistent naming conventions (e.g., "2023-06-15_CityCouncil_Minutes.pdf") and organized folder structures so anyone on your team can find what they need.

Use document management software. Tools like DocumentCloud, DEVONthink, or even well-organized Google Drive folders can help. Key features to look for:

• Optical character recognition (OCR), which converts scanned images into searchable text
• Tagging and annotation tools that let you mark up important passages
• Collaboration features for team-based projects where multiple reporters need access

Extracting key information from complex documents

With your documents organized, you need to pull out what matters.

Keyword searches are your starting point. Identify the most relevant terms and phrases, then use Boolean operators to refine your results: AND narrows results (requiring both terms), OR broadens them (either term), and NOT excludes specific terms. For example, searching "contract AND construction NOT residential" filters out irrelevant hits.

Data analysis techniques come into play when documents contain numerical information. This might involve:

• Extracting data from tables or spreadsheets embedded in reports
• Cleaning messy data (fixing inconsistent formatting, removing duplicates)
• Looking for trends, outliers, and correlations across the dataset
• Visualizing findings through charts, graphs, or timelines to spot patterns

Synthesizing across sources is where investigative reporting gets its power. Cross-reference facts and claims across multiple documents. Look for inconsistencies or gaps in the record. When three different documents tell slightly different versions of the same event, that's often where the story lives.

Incorporating Documentary Evidence into Reports

Documents don't just inform your reporting; they are the evidence. How you present them to your audience determines whether your story is convincing.

Using documents in your reporting

Quote and summarize key documents carefully. Select the most relevant excerpts, provide enough context so readers understand what they're looking at, and always attribute the source. A line from an internal memo carries more weight when readers know exactly where it came from.

Create document-based graphics. Embedding images of original documents (or key portions of them) adds credibility. You can:

• Highlight specific passages or data points within the document image
• Add captions and annotations that explain what the reader should notice
• Use side-by-side comparisons when documents contradict each other

Structure your report around the documents. In strong investigative pieces, documents drive the narrative rather than just supporting it. Weave documentary evidence throughout the story instead of dumping it all in one section. Make clear to your audience that public records made the investigation possible. This transparency builds trust and reinforces why public records laws matter.