What's next for twXplorer? Help us decide.

twXplorer screenshot

Just over two weeks ago we launched twXplorer, a tool to help people make sense of searches and find interesting conversations on Twitter.

When we launched the tool we didn’t know how it would be received or what use people would find for it. So far, we've been pretty happy to have more than 13,000 people use twXplorer and to get a few kind words from The Atlantic (“control your own little battalion of news-finding bots”), The Buttry Diary ("Twitter search just got waaaay better"), All Twitter, and Spain’s RedAssociales.

Kind words are great, of course, but nothing beats honest feedback. If you've used the tool and have some ideas or special use cases that twXplorer might address, we'd love to hear from you. We're likely to make a few tweaks to twXplorer and your feedback will help us determine which direction to take. Drop us a line at KnightLab@northwestern.edu.

In the meantime, a few of the features requested so far:

  • Search date or time range. This is a common request, but unfortunately it's not something we can implement for the simple reason that Twitter's API doesn't support it. A common related question had to do with the number of tweets examined. For now twXplorer looks the most recent 500 tweets that contain the term you searched for.
  • Search by location. Currently twXplorer collects tweets that contain the term you searched for without regard for location. We’ve learned from other projects — specifically NeighborhoodBuzz — that relatively few people geotag tweets, which makes a meaningful analysis difficult. On top of that the search API only supports search by a radius around a point, which is not how most people think about doing searches.
  • An API. There’s some interest in an API. No word on what aspect of twXplorer is most intriguing, but we’re reaching out to folks who use the tool and will learn more as we do.
  • Integration with Storify. Some people want to Storify tweets directly from twXplorer.
  • Sentiment analysis.

  • A better block list — the omission list of most frequent terms – for twXplorer?

  • A better block list. Paul Watson at Storyful looked at the results of a Twitter list analysis and noted that the list of most frequent terms was pretty weak, including words like “says” “get” “new” and “want” among the top five.
  • Analysis over time. In a slight twist from the first bullet in this list, one user wanted to capture the most common hashtags used by her twitter lists over the course of a week. Using the twXplorer as it’s currently configured she could achieve the same result by taking a snapshot a few times each day, but that’s an awful lot of work. Maybe scheduling searches is useful?
  • Download search results/analysis as JSON.
  • Visualizations across snapshots and permalinks to snapshots.
  • Better handling of trigrams. Those of us who are new to computational linguistics are getting a light vocabulary lesson. We’ve got unigrams (single words), bigrams (two-word phrases) and trigrams (three-word phrase). Some folks want us to do a better job with these longer phrases.
  • Facebook equivalent?


Again, that's a pretty long list and we'll be digging deeper over the next few weeks to learn more about how people actually use the tool.

Remember, if you're a twXplorer user, you can help shape its future. What would make the tool really useful for you? What part of Twitter search is the most painful to deal with, either on Twitter itself or on twXplorer? What do you consistently find yourself wanting when you search?

Have an answer? Drop us a line at knightlab@northwestern.edu.

About the author

Ryan Graff

Communications and Outreach Manager, 2011-2016

Journalism, revenue, whitewater, former carny. Recently loving some quality time @KelloggSchool.

Latest Posts

  • A Big Change That Will Probably Affect Your Storymaps

    A big change is coming to StoryMapJS, and it will affect many, if not most existing storymaps. When making a storymap, one way to set a style and tone for your project is to set the "map type," also known as the "basemap." When we launched StoryMapJS, it included options for a few basemaps created by Stamen Design. These included the "watercolor" style, as well as the default style for new storymaps, "Toner Lite." Stamen...

    Continue Reading

  • Introducing AmyJo Brown, Knight Lab Professional Fellow

    AmyJo Brown, a veteran journalist passionate about supporting and reshaping local political journalism and who it engages, has joined the Knight Lab as a 2022-2023 professional fellow. Her focus is on building The Public Ledger, a data tool structured from local campaign finance data that is designed to track connections and make local political relationships – and their influence – more visible. “Campaign finance data has more stories to tell – if we follow the...

    Continue Reading

  • Interactive Entertainment: How UX Design Shapes Streaming Platforms

    As streaming develops into the latest age of entertainment, how are interfaces and layouts being designed to prioritize user experience and accessibility? The Covid-19 pandemic accelerated streaming services becoming the dominant form of entertainment. There are a handful of new platforms, each with thousands of hours of content, but not much change or differentiation in the user journeys. For the most part, everywhere from Netflix to illegal streaming platforms use similar video streaming UX standards, and...

    Continue Reading

  • Innovation with collaborationExperimenting with AI and investigative journalism in the Americas.

    Lee este artículo en español. How might we use AI technologies to innovate newsgathering and investigative reporting techniques? This was the question we posed to a group of seven newsrooms in Latin America and the US as part of the Americas Cohort during the 2021 JournalismAI Collab Challenges. The Collab is an initiative that brings together media organizations to experiment with AI technologies and journalism. This year,  JournalismAI, a project of Polis, the journalism think-tank at...

    Continue Reading

  • Innovación con colaboraciónCuando el periodismo de investigación experimenta con inteligencia artificial.

    Read this article in English. ¿Cómo podemos usar la inteligencia artificial para innovar las técnicas de reporteo y de periodismo de investigación? Esta es la pregunta que convocó a un grupo de siete organizaciones periodísticas en América Latina y Estados Unidos, el grupo de las Américas del 2021 JournalismAI Collab Challenges. Esta iniciativa de colaboración reúne a medios para experimentar con inteligencia artificial y periodismo. Este año, JournalismAI, un proyecto de Polis, la think-tank de periodismo...

    Continue Reading

  • AI, Automation, and Newsrooms: Finding Fitting Tools for Your Organization

    If you’d like to use technology to make your newsroom more efficient, you’ve come to the right place. Tools exist that can help you find news, manage your work in progress, and distribute your content more effectively than ever before, and we’re here to help you find the ones that are right for you. As part of the Knight Foundation’s AI for Local News program, we worked with the Associated Press to interview dozens of......

    Continue Reading

Storytelling Tools

We build easy-to-use tools that can help you tell better stories.

View More