NICAR16: Tackling federal election campaign finance data

In an election year, NICAR was bound to feature plenty of election-themed sessions.One of the more interesting that I caught was “Election: Reverse-engineering campaign finance stories,” in which Aaron Bycoffe, Carrie Levine, and Derek Willis walked the audience through the steps they took to break various campaign finance stories.

Using an open-source parser to find small donations

In quarterly filings with the Federal Election Commission, candidates must declare how much they’ve raised and spent, among other things, during the previous three months. The filings generate plenty of news stories, most of which run the next day and summarize the data.

For FiveThirtyEight’s “Four Ways to Fund a Presidential Campaign,” however, Bycoffe wanted to go beyond summarization and show readers how much each candidate had raised from small donors.

He used the FEC’s electronic-filing search to find each candidate’s most recent filing and then Fech, a Ruby parser campaign filings from the FEC, to find identify small donors and compare those contributions to the total.

For those of us wanting to work with campaign data Boycoffe had two suggestions:

  1. Check out the FEC’s Committee Master file and Operating Expenditures file, which will help you find stories to localize.
  2. Do as much work as possible in a programmatic way so that you have a lighter workload when new filings are submitted.

Following up on traditional reporting with data

Levine found that pre-reporting was key for the Center for Public Integrity’s “Presidential campaign donors hedge bets,” which looked at how donors were distributing contributions widely among multiple candidates.

Through conversations with donors beforehand, she and her team developed a theory about campaign contributions that was then backed up by the data. This pre-reporting allowed Center for Public Integrity to run the story the night FEC filings came in and to beat major news outlets on the story.

Despite the success of the story, Levine stressed the importance of having a backup plan in place for when things inevitably fail. In fact, the hedging story ran into problems because some of the files were so big that the servers couldn’t process them. Instead of running SQL queries as planned, the data was put into Excel to conduct the analysis.

An alternative the campaigns’ filings

Though he’s now at ProPublica Willis was able to tap a unique data source for the New York Times’ “Bernie Sanders’ Early Online Haul: $8.3 million”: ActBlue.

ActBlue is a fundraising group for Democratic candidates and files with the FEC. Through ActBlue filings, Willis was able to see how much Sanders had raised online before his campaign had submitted files. In addition, ActBlue has to report donations of every size — even a dollar — so the New York Times was able to obtain details that normally wouldn’t be in Sanders’ campaign filings.

Willis noted that hundred of candidates use ActBlue, which makes its filings useful even in local races. The downside, Willis said, is that there isn’t a similar platform for Republican campaign contributions. A note of caution: The ActBlue filings are usually extremely large, which means you might want to split the data up before you approach it, he said.

About the author

Benjamin Din

Student Fellow

Latest Posts

  • A Big Change That Will Probably Affect Your Storymaps

    A big change is coming to StoryMapJS, and it will affect many, if not most existing storymaps. When making a storymap, one way to set a style and tone for your project is to set the "map type," also known as the "basemap." When we launched StoryMapJS, it included options for a few basemaps created by Stamen Design. These included the "watercolor" style, as well as the default style for new storymaps, "Toner Lite." Stamen...

    Continue Reading

  • Introducing AmyJo Brown, Knight Lab Professional Fellow

    AmyJo Brown, a veteran journalist passionate about supporting and reshaping local political journalism and who it engages, has joined the Knight Lab as a 2022-2023 professional fellow. Her focus is on building The Public Ledger, a data tool structured from local campaign finance data that is designed to track connections and make local political relationships – and their influence – more visible. “Campaign finance data has more stories to tell – if we follow the...

    Continue Reading

  • Interactive Entertainment: How UX Design Shapes Streaming Platforms

    As streaming develops into the latest age of entertainment, how are interfaces and layouts being designed to prioritize user experience and accessibility? The Covid-19 pandemic accelerated streaming services becoming the dominant form of entertainment. There are a handful of new platforms, each with thousands of hours of content, but not much change or differentiation in the user journeys. For the most part, everywhere from Netflix to illegal streaming platforms use similar video streaming UX standards, and...

    Continue Reading

  • Innovation with collaborationExperimenting with AI and investigative journalism in the Americas.

    Lee este artículo en español. How might we use AI technologies to innovate newsgathering and investigative reporting techniques? This was the question we posed to a group of seven newsrooms in Latin America and the US as part of the Americas Cohort during the 2021 JournalismAI Collab Challenges. The Collab is an initiative that brings together media organizations to experiment with AI technologies and journalism. This year,  JournalismAI, a project of Polis, the journalism think-tank at...

    Continue Reading

  • Innovación con colaboraciónCuando el periodismo de investigación experimenta con inteligencia artificial.

    Read this article in English. ¿Cómo podemos usar la inteligencia artificial para innovar las técnicas de reporteo y de periodismo de investigación? Esta es la pregunta que convocó a un grupo de siete organizaciones periodísticas en América Latina y Estados Unidos, el grupo de las Américas del 2021 JournalismAI Collab Challenges. Esta iniciativa de colaboración reúne a medios para experimentar con inteligencia artificial y periodismo. Este año, JournalismAI, un proyecto de Polis, la think-tank de periodismo...

    Continue Reading

  • AI, Automation, and Newsrooms: Finding Fitting Tools for Your Organization

    If you’d like to use technology to make your newsroom more efficient, you’ve come to the right place. Tools exist that can help you find news, manage your work in progress, and distribute your content more effectively than ever before, and we’re here to help you find the ones that are right for you. As part of the Knight Foundation’s AI for Local News program, we worked with the Associated Press to interview dozens of......

    Continue Reading

Storytelling Tools

We build easy-to-use tools that can help you tell better stories.

View More