ONA15: How news organizations build simple bots to help report the news

It’s no secret that newsrooms are increasingly using bots to cut down on busy work. Software now routinely churns out quarterly earnings stories for The Associated Press and earthquake alerts for Los Angeles Times, freeing reporters to pursue more in-depth projects. And while no bot can write 3,000-word investigative stories, it can assist reporters by alerting them to new data and filtering the information for them.

While the idea of creating a bot may sound daunting, automating parts of the news gathering process can also be as simple as clicking a few buttons, according to some industry pros. At ONA’s Build Bots to Boost Your Reporting session John Keefe, Jenny Ye, Justin Myers, Philana Patterson, and Honest Charley Bodkin showed attendees how common software can help reporters find news.

In just five minutes, Keefe, senior editor at WNYC’s data news team, showed us how his team built a news bot that scored a scoop on a federal court case, using IFTTT.

IFTTT, for the uninitiated, is an acronym for If This Then That, and it’s a web service that allows users to create connections between apps such as Twitter, Dropbox, and Gmail through “recipes.” These recipes can automate a range of digital chores, from sending users a text message when the weather changes to logging their travels in Google Spreadsheets.

In WNYC’s case, Keefe set up the bot to automatically scan PACER, a publicly accessible electronic repository of federal court documents, for new feed items related to the United States v. Silver case. He then asked the bot to send him an email whenever there were new PACER files on the case. And he did it all through IFTTT’s point and click interface.

The result? A scoop for WNYC when an email alerted them to new development on indictment against former New York State Assembly Speaker Sheldon Silver, who faced corruption charges.

For the more code-savvy, WNYC’s Ye demonstrated a JavaScript scraper that fuels Nailbiter Bot, a Twitter account that tweets automatically when the score of a NCAA tournament game is within eight points with less than three minutes left in the game.

Lego block approach

The key to efficient automation is breaking down each project into units that can be built, reused, and mixed like Lego blocks, said Myers, news automation editor at AP. There are four essential parts to building a news bot, he said.

Input: The bot needs to react to new development and gather data. For example, when The Associated Press was investigating health care data breaches, Myers set up a bot to scrape the U.S. Department of Health and Human Services website for new reports of data breaches. He also set up a subscriber list for interested editors and reporters using Google Spreadsheets.

Processing: The bot needs to filter the data and surface useful information. In this case, Myers programmed the bot to filter reports of new breaches according to each reporter and editor’s preferences. For example, the bot might alert an editor only when the breach affected a large number of patients.

Output: The bot needs to tell others about the data. Myers’ bot emailed a customized list of breach reports to each subscriber.

Scheduling: The bot needs to perform the regularly. Bots can run nearly continuously or can be scheduled to run at certain intervals. Myers ran his bot once a day to scan for new breaches.

While bots can be invaluable in saving journalists time and effort in reporting, the danger of “overbot” exists, Myers said. To avoid inundating reporters with email alerts, Myers personally receives a copy of every reporter’s alert to gauge the extent of information overload.

At the end of the day, he said, bot building requires continued conversations between developers and reporters. That’s something bots can’t replace.

Here are the slides from the Build Bots to Boost Your Reporting session at ONA.

 

Latest Posts

  • Another Big TimelineJS Update That You Shouldn’t Even NoticeBut we wanted to warn you ahead of time

    There’s another big but invisible change coming to TimelineJS. In July, we announced a big update to TimelineJS on the day of the release. With some minor exceptions, we were right that most people didn’t notice. Next week, we’ll be making another big update, which, again, we hope you won’t notice. This time, we thought we should announce it ahead of time, because timelines created before January, 2015 will probably stop working unless steps are taken. Timelines...

    Continue Reading

  • Evaluating VR and AR Tools for the ClassroomHow we choose tools for Knight Lab Studio

    In the Knight Lab: Studio class, every Virtual and Augmented Reality project is a blank slate. All of our developers are learning how to make VR and AR for the first time; many of them don’t even consider themselves developers yet. With the exception of a few projects which have run in successive quarters, we’re never building on something that already exists. We go from “New Project” to our final destination in ten weeks. The fact that...

    Continue Reading

  • A Big TimelineJS Update That You Shouldn’t Even Notice

    Today we’re releasing a new version of TimelineJS, but most of you shouldn’t even notice a difference. We make updates to TimelineJS periodically, and we usually don’t say much about it, partly because people who publish timelines using our embed tool are automatically updated to the new version—there’s nothing they need to change. That includes this new release. However, in this case, we thought it was worthwhile posting for two related reasons. First, this release...

    Continue Reading

  • AR Face Filters: How Do They Work and How Are They Changing Us?

    This video explains the mechanisms behind how selfie filters change our digital images and then how this might psychologically affect us. To make this video, I researched “Snapchat Dysmorphia” and also looked for the technical understanding of selfie filters. Before creating this video, I made a selfie filter for the Knight Lab using Spark AR to get a sense of how face deformation would work in Instagram selfie filters. The animation workflow for me looked...

    Continue Reading

  • 9 Important VR Experiences for Journalists to See

    In an era where social media outpaces print newspapers in the U.S. by a whopping 4% (Pew Research Center, 2018), there is much to be said about the role of interactive media technology in minimizing this gap between technology and storytelling. How can publications, and the journalists within them, use interactive media technology to re-engage with this lost audience? And why might this shift towards digital storytelling, such as VR, be more valuable for journalism than...

    Continue Reading

  • 7 Reflections on SRCCON:Productthe first conference for “product thinkers” in media

    On Feb. 8 in Philadelphia, I was lucky to be one of about 150 participants at SRCCON:Product, the first conference for “product thinkers” in media. A few reflections on what I saw and learned: 1. A quarter of a century into the digital age, we are finally figuring out how to build media products In 1995, I was named the first online director for The Miami Herald, with responsibility for launching the “Internet edition” of...

    Continue Reading

Storytelling Tools

We build easy-to-use tools that can help you tell better stories.

View More