NORC Data Visualization Memo

The following is a brief scan of the landscape of data visualization. It is not intended to be a comprehensive report.

Clay Shirky in Pew Internet report on the future of the internet: "[A]ll numeric and graphic forms of rendering knowledge, from the creation and use of databases to all forms of visual display of data will be in a golden age..."

Background Points

- Data are certainly not new, and neither is data visualization. But clearly, we are in the midst of something new and significant in the communication of information. Increasing interest in, use and importance of data generally, and data visualization specifically, are being driven by a much broader megatrend: digital. This broader digital trend is, in fact, new.

- As they pertain to the uptake of data visualization, the relevant aspects of the digital megatrend include:

  1. overall proliferation of internet use
  2. new audio-visual digital devices and interfaces
  3. abundance of raw data (and the need to make meaning from this material)
  4. higher bandwidth
  5. greater server-side processing capacity
  6. more capable web browsers
  7. more mature digital programming languages and frameworks

- These have combined to spawn a fundamental shift in the standard unit of information:

From - the static document

To - native digital information (interactive and computational)

- This is where data visualization, in its contemporary digital form, comes into play. It is a key aspect of this shift to digital native information. It is no doubt one of the most significant and recognizable parts of the shift. However, note that native digital information is not only data visualization, and the two are not synonymous.

The New Requirement (or The Opportunity)

- In 2010, Sir Tim Berners-Lee predicted that data work would define the future of journalism. The same circumstances underlying Sir Tim's prediction for journalism -- one (struggling) player in the information ecosystem -- also directly affect organizations such as NORC and others that collect, analyze and disseminate data to policymakers and the public. Unlike many in journalism, the public interest research sector already has the subject matter expertise and analytical skills it needs. What it lacks is the necessary talent to render that knowledge in innovative, visual and interactive ways for digital media.

- Going forward, the most successful public interest sector organizations will be those that can effectively merge their existing expertise with the new digital and design skills for communicating it. Most importantly, in my opinion, this will be in the area of interactive data visualization for digital media.

- Modern, digital-native data visualization in the public interest research sector is still in its early stages. It lags far behind players in commercial and non-profit journalism. For the sector writ large, this is a significant problem. However, for select entrepreneurial organizations it represents an enormous differentiating opportunity. It will require real institutional commitments and resource allocations to digital and data visualization innovation.

- Institutional commitments: Executive-level mandate and support to supplement conventional data analysis output (reports, working papers, journal articles) with more innovative digital data presentations. Early and deliberate integration of design, communication and digital programming skill with the research process to fundamentally change the institution's output, not just promote ("disseminate") the same output.

- Resource allocations: Highly skilled personnel - visual designers and coders; either new staff, skill development, or freelance support in the areas of graphic/information design and interactive digital programming.

Journalism Leads the Way

- Despite financial challenges, the journalism field leads the way in innovative data visualization for digital media.

- "Data journalism" is the area of greatest activity and innovation in data visualization. This is happening in both commercial and non-profit journalism circles.

- There are some clear leaders in the commercial and non-profit space: The New York Times, Guardian, ProPublica, NPR and others.

See also:

- What distinguishes these innovators is an effective integration of traditional subject matter expertise (and/or reporting/research), visual design skill, and true digital programming chops.

- The focus and conference programming of relevant professional organizations such as NICAR and ONA suggest a very strong and growing emphasis on data-driven journalism, data visualization, and digital tool- and skill-building in the industry.

- The following recent developments in the space add to the strong trend in data journalism and data visualization. They include:

  1. Vox.com (Ezra Klein's "explanatory journalism" venture at Vox Media)
  2. FiveThirtyEight.com (Nate Silver's site relaunched under the ESPN banner this week)
  3. New York Times's announced The Upshot data journalism site
  4. Though not specifically about data visualization, The Washington Post opened a digital "lab" of sorts in New York City to have more direct access to that city's digital talent pool.
  5. The Wall Street Journal has also doubled down on its digital team building, though again not specifically aimed at data visualization.

- Despite these strong trends and new entrants, the journalism industry is still heavily weighted conventional reporting and writing. New skills in visual design, data visualization and digital programming are in the minority. Most departments are small. This will slow the field's overall development and leave the door open for new competitors.

Public Interest Data Visualization Lags

- Data visualization and digital interfacing is much less innovative in the public interest space.

- Though data collection and analysis have long been central to the research and public interest sectors, the field has not been quick to retool for the modern digital data era.

- However, there is some notable work being done by:

Foundations and Data Visualization

  1. Knight: The Knight Foundation is clearly the most visible foundation player in the digital space, which has encompassed sub-issues of data and data visualization. Mostly through its Knight News Challenge, the work is almost entirely aimed at the journalism context, supporting tools and innovations for digital news delivery. Knight sees data and innovation as key parts of journalistic sustainability in the digital age. Knight has walked the walk a little too, doing some information graphics and such for themselves, but minimal.
  2. Ford: Ford hosted a series events over the past few years on data and data visualization and their relevance to social change efforts, which are of particular interest to Ford. The series went under the banners Wired for Change and Change by Design (the latter being more relevant to data visualization specifically). Walking the walk -- Ford's 2011 annual report is an excellent example of a foundation putting data visualization into service for its own communication.
  3. Robert Wood Johnson: on the program side, RWJF just launched a Visualizing Health initiative with the University of Michigan, which labels itself a project to "create a gallery of beautiful and easy-to-make-sense-of graphs, charts, and images that effectively communicate risk information." RWJF is also very interested in doing data visualization for itself. It has hosted clinics and events on the subject, plus engaged in numerous visual information projects, including a large Data Hub feature of its website.
  4. Gates: They have also backed an effort called Markets for Good which touches on data and data visualization in the social sector (in fact, Data Visualization is Markets for Good's current theme in discussion).
  5. Hewlett: Also a backer of the Markets for Good project (see Gates above). Hewlett has also done a couple of interesting data visualization projects on its own, including a visual grant tracking tool.
  6. Casey: Casey has a long track record with data and data communication to advance its issues. Most notable is the KIDSCOUNT initiative, which now includes the KIDSCOUNT Data Center.
  7. Commonwealth Fund: A health foundation in New York now headed by former health IT czar David Blumenthal, the Commonwealth Fund is among the most prolific producers of data graphics (for its own communication purposes) in the foundation sector. Commonwealth has had a lot of success with its digital dissemination strategy. They are also interested in digital technology in the health delivery area, which often includes aspects of data visualization.
  8. MacArthur: Through its Digital Media and Learning program, was one of the early and visible foundations in the digital space.
  9. Sloan: Sloan has a Digital Information Technology program that relates directly to issues of data, data visualization, digital technology and research. Headed by Josh Greenberg, the program has three sub-areas, each of which overlap in ways with data, data communication, and information access.
  10. California HealthCare Foundation: Interested in (health) data generally as a programmatic angle. They have funded the Health Datapalooza along with RWJF for several years. The CHCF communications department has also done several data visualization projects for its own dissemination purposes.
  11. Pew and Kaiser: Operating foundations, not grantmakers, Pew and Kaiser have both used data visualization, interactives and information graphics extensively in their own digital publishing operations.

Important Terms of Art

The "news app": a piece of information, in a journalistic organization, built specifically for digital delivery blending visual design, data, narrative and code. News apps are uniquely digital creations, distinct from traditional text articles, stories and blog posts.

The "interactive": often used synonymously with "news apps," "interactive" is a term more likely to be heard outside of the journalism business. The term might also encompass other digital creations that aren't necessarily data visualization -- things like quizzes, timelines, calculators, slideshows, etc.

The "infographic": also sometimes conflated with "interactive" or "news app," infographics are often static visual representations of information comprising narrative, iconography, charts and illustrations. The most common form is the long vertical, narrow, static visual.

The "viz": A broadly-applied shorthand for interactives, news apps, infographics and other visual representations of data.

"Microsite": a multi-page, or multi-feature digital presentation on a single topic, distinct from a traditional institutional web presence. Microsites have their own internal navigation schemes specific to the topic or story, and may include elements of data visualization (static or interactive), multimedia, and text narrative.

"Data journalism": Broadly speaking, the practice of telling news stories with and from data. Data journalism often involves visual and/or interactive renderings of data, thus blends disciplines of visual/information design, web coding skills and writing.

"Data science": more analysis than storytelling. However, data science often involves visual representations of data and elements of web programming. For this reason, some have described the data scientist as part statistician, part coder.

"Stack": The set of tools and programming languages design and digital practitioners use to produce data visualizations and interactives. There are some emerging industry-standard tools of the trade such as D3.js, R, HTML5/JQuery/CSS3, Ruby on Rails, Python, and many others. While the overall trend is toward creating rich digital-native data and information experiences -- the various tools practitioners use to build these experiences will evolve and be replaced by new ones.

Relevant Twitter Hashtag Streams

#dataviz ("data visualization")

#ddj ("data-driven journalism")

Selected Blogs, Sites, Follows

Selected Resources

Narrative Visualization (by Edward Segel and Jeffrey Heer at Visualization Lab)

Visualize This by Flowing Data's Nathan Yau

The Functional Art by Alberto Cairo (and recent NICAR presentation)

Data Journalism Handbook

Interactive Data Visualization for the Web (on D3.js)

The Best American Infographics 2013 by Gareth Cook

Interactive Visualization by Bill Ferster

Infographics by Column Five Media

Book series by Edward Tufte