Fall 2009 | Online Exclusives

An Antidote for Web Overload

With a hunger for explanatory guidance amid the raging storm of Web news flashes, a journalist stresses context to attract digital users.

By Matt Thompson
For the longest time, whenever I read the news, I’ve often felt the depressing sensation of lacking the background I need to understand the stories that seem truly important. Day after day would bring front pages with headlines trumpeting new developments out of city hall, and day after day I’d fruitlessly comb through the stories for an explanation of their relevance, history or import. Nut grafs seemed to provide only enough information for me to realize the story was out of my depth.

I came to think of following the news as requiring a decoder ring, attainable only through years of reading news stories and looking for patterns, accumulating knowledge like so many cereal box tops I could someday cash in for the prize of basic understanding. Meanwhile, though, with the advancements of the Web and cable news, the pace of new headlines was accelerating—from daily to minute-by-minute—and I had no idea how I’d ever begin to catch up.

Read “A New Model for News: Studying the Deep Structure of Young Adult News Consumption” »

Jim Kennedy, director of strategic planning at The Associated Press, wrote about this study in the Winter 2008 issue of Nieman Reports.
In 2008, I encountered a study describing others from my generation who seemed to share my dilemma. The Associated Press had commissioned professional anthropologists to track and analyze the behavior of a group of young media consumers. Their key conclusion: “The subjects were overloaded with facts and updates and were having trouble moving more deeply into the background and resolution of news stories.”

The study’s participants seemed to respond to this ever-deepening ocean of news much like I had. We would shy away from stories that seemed to require a years-long familiarity with the news and incline instead toward ephemeral stories that didn’t take much background to understand—crime news, sports updates, celebrity gossip. This approach gave us plenty to talk about with friends, but I sensed it left us deprived of a broader understanding of a range of important issues that affect us without our knowing.

After years of working in online newsrooms, though, I had hit upon a secret—talking to journalists was like having the decoder ring without having to do the work. If I didn’t understand a story or why it was important, I could ask a metro editor about it. Without fail, she’d lay out the history and context in lush narrative detail, often with entertaining depictions of the players involved and fun asides with snippets of political trivia. Ten minutes of conversation with a good reporter could unlock the fundamentals of a beat so thoroughly I’d walk away feeling like an expert on the topic.

I started to realize that “getting” the news didn’t require a decoder ring or years of work. All it took was access to the key pieces of information that newsrooms possessed in abundance. Yet news organizations never really shared that information in an accessible or engaging form. Instead, they cut it up into snippets that they buried within oodles of inscrutable news reports. Once in a while, they’d publish an explainer story, aiming to lay out the bigger picture of a topic. But such stories always got sidelined, quickly hidden in the archives of our news sites and forgotten.

Meanwhile, young news consumers like me were flocking to another Web site—a place structured around context, but which was quickly becoming a go-to destination for news as well.

The Wikipedia Epiphany

In 2007, The New York Times noted that something weird was going on with Wikipedia. This “free encyclopedia that anyone can edit” had taken on a function few could have expected an encyclopedia to perform.

As Jonathan Dee wrote in The New York Times Magazine, “For centuries, an encyclopedia was synonymous with a fixed, archival idea about the retrievability of information from the past. But Wikipedia’s notion of the past has enlarged to include things that haven’t even stopped happening yet. Increasingly, it has become a go-to source not just for reference material but for real-time breaking news—to the point where, following the mass murder at Virginia Tech, one newspaper in Virginia praised Wikipedia as a crucial source of detailed information.”

The following year Martin Nisenholtz, senior vice president of digital operations for The New York Times Company, would play a part in revealing Wikipedia’s strength not just as a breaking news source, but as the place to read about a news story long after the headlines have subsided.

Five years prior, in 2002, blogger Dave Winer had made a bet with Nisenholtz that for most of the top five news stories of 2007, blogs would outrank The New York Times on Google. When Winer and Nisenholtz reconvened to settle the bet in 2008, they unearthed a surprise. By the terms of the bet, Winer had won, but the real news was the site that trounced both the Times and the blogosphere—Wikipedia.

What is it about this site, I wondered, that made it the people’s choice not only for news over time, but for real-time news updates as well? Sure, the site’s ability to instantly marshal an army of amateur editors was a big part of the story. But there was also something quite remarkable about how stories are structured on the site, how breaking news gets folded into an elegant, cohesive record, enabling site visitors to quickly catch up on a topic without having to sort through a torrent of disparate articles and headlines.

If you’re looking for a way to combat information overload, to distill the universe of topics covered by the local newspaper into a manageable stream, it’s difficult to find a more perfect invention than the format Wikipedia has pioneered.

But I saw opportunity for journalists to build on Wikipedia’s model to make something even better. While Wikipedia does a fairly astonishing job of laying out topics of national and international import, it doesn’t scale down very well to the level of local news. And hairy, complex stories such as climate change and health care reform require deft, economical storytelling that Wikipedia’s cacophonous editing process is ill-suited to provide.

So in September 2008, I went to the University of Missouri’s Reynolds Journalism Institute (RJI) to explore how journalists might start winning at the context game, creating a new model of news to serve a generation of news consumers like me.

With Columbia Tomorrow and The Money Meltdown Web sites, Thompson sought to bring context to the news by bringing together vital information about development in Columbia, Missouri on one Web site and the nation’s financial crisis on another.

Two Experiments

Among the assumptions I wanted to test during my time at RJI was the idea that news consumers really are looking for context rather than merely the latest news. After all, during years of working in online newsrooms, I’d seen plenty of deep, contextual news packages ignored by our site users in favor of weather updates and crime reports.

The financial crisis provided an early test of this assumption. At the time, news about the crisis was ubiquitous. All at once, every news organization was unearthing news about a different aspect of the meltdown—the collapse of Fannie Mae and Freddie Mac, the role of the Community Reinvestment Act, the status of the bailout plan wending its way through Congress. Amidst all this news, would people choose context?

The answer was yes. The breakthrough news item of the year wasn’t an investigation that yielded some hot new scoop, it was a piece of on-the-record explanatory reporting by “This American Life” and National Public Radio that went wildly viral. “The Giant Pool of Money” went on to become the most downloaded episode in the history of “This American Life,” garnering the award trifecta of a duPont, Peabody and Polk for its producers. Many listeners said they’d been tuning out all those crisis-related headlines until they heard the episode. For them, “The Giant Pool of Money” was like a decoder ring for this news story. And once you heard it, you wanted more.

But it could have been a fluke, revealing nothing more than a well-told story’s capacity to ignite. So at the beginning of October, I spent two days culling the best links I could find laying out different aspects of the crisis into a spare, simple, one-page site called The Money Meltdown. I posted a link to the site on my blog and for the rest of the month spent a few minutes a day maintaining the page.

That month, more than 50,000 unique users visited The Money Meltdown. A small number for a big news operation, but significant traffic for two days of work by a random guy with a blog. It was enough traffic, at least, to suggest that the hunger for context was real.

The next question I wanted to tackle during my time in Missouri was how journalists might approach the task of building news sites structured around the bigger picture rather than the latest news. Working with a team of about a dozen reporters and a pair of editors from the Missouri School of Journalism, we decided to tackle the story of growth and development in Columbia, Missouri. A college town bordered by rural land in the middle of Missouri, Columbia’s population had boomed over the past two decades, leaving the city grasping for a planning model that could more elegantly handle its explosive growth. It was the type of story that played out in obscure headlines about “tax-increment financing” and “transportation development districts”; a good candidate, I thought, for a dose of context.

I assembled dossiers containing about eight years of coverage of growth and development in Columbia by the city’s two daily newspapers, more than 800 pages of news stories. And I read through the dossiers page by page on my Kindle, attempting to ferret out the tropes that came up time and time again, the arguments the city kept having with itself over the decade. With the assistance of Columbia Missourian editors Scott Swafford and John Schneller, my team and I worked to take all that contextual information buried in the stories—the years of nut grafs, the forgotten explainers—and pull them together into an accessible, engaging package.

The outcome of this effort was a Web site called Columbia Tomorrow. Built in WordPress, the site so far contains about two dozen hierarchically arranged topic pages that attempt to lay out the bigger picture of growth and development in the city, as well as provide a friendly introduction to topics like storm water runoff. As new developments emerge, reporters post about them in blog entries that appear on the relevant topic pages, which are updated to reflect the latest news.

It’s too early to tell whether Columbia Tomorrow will be a breakaway hit with residents of the city. But it does, I think, what I hoped it would do. It points toward the possibility of a new direction for news Web sites, one that can balance the needs of news junkies and casual news consumers alike.

For years, our assumption has been that the Web was going to require more and more news, that the way to succeed online was to generate ever more frequent updates and shovel up ever more numerous headlines, to completely saturate our users with information so they’ll keep clicking. Needless to say, this is a resource-intensive endeavor. And with all signs pointing to fewer resources for employing professional journalists, it looks like a losing one.

But these experiments are prodding us toward the notion that the real value might be found not in publishing more news on increasingly less serious matters, but in distilling the news into an ever-richer contextual record. Instead of just diverting us with trivia, the Web might transform journalism into something that doesn’t need to be decoded, but instead helps us make sense of what’s happening in our world.After writing this article, Matt Thompson created another Web site, deathpanels.org, which deals with the current health care debate.

Matt Thompson, a 2008-2009 Donald W. Reynolds Fellow at the Reynolds Journalism Institute, is an online journalist and coauthor of “Epic 2014/2015.” He blogs at Newsless.org.

12 Comments on An Antidote for Web Overload
Ben Harmann says:
August 31, 2011 at 8:48am
True journalism must evolve outside the traditional corporate network model. Independent journalists, publicly funded, and non-profit media organizations are on the leading edge of a new media model. link : http://www.truthmove.org/content/journalism/
LaterAli says:
December 13, 2010 at 8:41am
Struck on this article in my investigation for a thesis to finish my journalism study in Utrecht, The Netherlands. Found this article very interesting to read, as it more or less supports my thesis. It proves how journalists can add something to the internet, instead of giving the audience more of the same. A content based angle of reflection is much more interesting when we are discussing journalism and digitalization. I was wondering when this article was written, and if there have been more developments related to this story?
Mya Frazier says:
December 18, 2009 at 11:08am
"news consumers"

Can we call them readers?
Jtome says:
November 21, 2009 at 10:55pm
Matt ~ you definitely hit the nail on the head. I may not be in 'your generation' but I too am sick and tired of 'sound bites' and new headlines that are meant to grab your attention, hoping still that there will be more to the story. I miss the days of Paul Harvey and 'the rest of the story' for there is always more to a story than is reported these days. Keep up the great work. The hope of course is that you will be the TRUE journalist. The one who asks the questions the rest of us want to ask. The one who will gather all of the information and deliver it in context for us....and to do that in an unbiased way. TOUGH JOB to be sure. But...I really don't think we have many true journalists today. Raise the bar and keep the standard high, my friend!
Simon Bostock says:
November 18, 2009 at 1:08pm
This is wonderful. And inspiring. Thank you for posting this.

And great ideas in the comments too. I used to work for a firm with an intranet which would have benefited immensely from an idea like this.

The highest praise I can give: I only read the piece half an hour ago and it feels like something I've understood forever. I'm going to rip your idea for Thompson Pages off shamelessly.
Adster says:
November 17, 2009 at 3:26pm
Great article and great research sites - thanks Matt, and thanks Nieman Foundation. The main issue I see is that the research sites all have different user interfaces, and people hate learning new UIs - see Steve Krug's website and his book "Don't Make Me Think".

Could you make your sites look more like Wikipedia and link them together? A better edited news site will one day challenge and maybe even kill wikipedia.
Marcus M. says:
October 28, 2009 at 6:50pm
Matt, thank you for posting this. You've described with uncanny accuracy a problem I have struggled with on and off for years, and have spent much of the last two weeks trying to solve, provisionally, for myself. Despite the growing buzz and hype about the internet, social networking, electronic readers, and the new media vs. the dying Titanic of the newspaper industry and print media, I am growing sick of the internet and the comptuer screen, and in many respects I am endeavoring to cross the digital divide in the other direction, to recover or deprogram myself from the effects and habits of years (ages 10 to 24) of computer overexposure. Meanwhile, I am also attempting to be less hermetic and more aware of (and more comprehending of) current events and developments in culture and society. So a big part of my task these last two weeks has been reseaching (online, of course) the array of print publications, finding which ones are enough in line with my interests and sympathies (not too narrowly construed), balancing the more superficial and timely (e.g., The Week, Guardian Weekly, The Economist, CS Monitor Weekly), through the middle range (The New Yorker, The New Republic, Atlantic Monthly), to the more in-depth (e.g., New York Review of Books) and the more timeless (e.g., Lapham's Quarterly), as well as topical interests (e.g., media: Columbia Journalism Review, perhaps Nieman Reports) and individual favorites (e.g. The Sun, Janus Head), and taking advantage of the "bill me later" offers so I can see and feel many of the publications before making a decision and financial commitment whether to (continue to) subscribe.

I hope that more and more websites appear which aim to do what you describe, Matt: provide context and background for the overabundance of information tossed around as news. For myself, I expect nothing less from any journalist worthy of the name. But the current landscape and culture of blogs and blogging and online social networking and Twitter (the existence or use of which I still haven't found justification for) does not inspire me. I think I will spend the next several months to a year using newsweeklies and magazines (including those mentioned above) as my primary textual and photographic portal to the wider world of culture and current events. The blogosphere and the journalists of the new media have my best wishes. I hope to see some of them in print, or perhaps online again in the moderate future, if things have substantially improved.
Michael Lapides says:
October 3, 2009 at 12:35pm
Excellent. I work as a museum curator and also manage our website. We struggle to understand how to use the web most effectively. As content providers we too want to organize our information to be accessible for those who do not possess the magic decoder ring. Thanks for your thoughtful posting.
bob stepno says:
September 19, 2009 at 11:10am
You've got it. There's great social value in making the wealth of newsroom and what used to be news-morgue knowledge available to those who want it. And the Web could hold it all.

Unfortunately, news organizations' first instincts included trying to monetize some of that value by charging for access to poorly indexed archives with cumbersome interfaces that ignored the hyperlinking possibilities of the Web... instead of imposing well-written, tightly edited narrative structures and creative cross-referencing.

It reminds me of the week about 30 years ago when The Hartford Courant plunked one of its first Atex terminals on my desk (http://bit.ly/3AkvW0), and I fell in love with the glowing green columns of news on the screen -- AP in one column, more wires in the other, so that I could move paragraphs back and forth for "combined wires" stories, paste in some background from yesterday's story...

"Wow!," I said to a net manager, "does this mean we'll have all of the old stories here for research?" "Nope," he said. "The tapes are too expensive and have to be used over." Or something like that.

Now the excuse won't be the cost of storage. But it could be "oops, our last round of cost-cutting eliminated the editors, librarians and rewrite folks who could have done all that."
Patrick Lewis says:
September 17, 2009 at 1:01pm
Fascinating reading and many great ideas. Another model I wish could be adopted would be like IMDB for news. Sometimes I wish I could refer back to a listing of the cast of characters or plot summary without have to comb back through the main article. There seems to be a style of presenting news where, people, places, concepts are only introduced once. It instills in me something akin to the anxiety I feel at a party, trying to remember names, faces, jobs, interests and relationships.
Jason Fry says:
September 17, 2009 at 12:28pm
In other news, I can't spell my own name. Ugh.
Jason Fr says:
September 17, 2009 at 11:03am
Great piece. I think you've nailed why Wikipedia works so well for readers, and how newspapers have invented an explanatory form that doesn't. That ought to be what journalists talk about when they discuss Wikipedia, instead of harping on mistakes and vandalism. (Which is just cover for the amount of shameless Wikipedia cribbing that goes on in every newsroom.)
Submit a Comment
Enter the words above: * Enter the numbers you hear: *
Switch to audio Switch to image
Thank you for your comment. It will be published after it is approved by an editor. Read our comments policy »