LibGuides: New Media Resources (Gaythwaite): Data Analytics

Media Analytics & Data

American Television Global Knowledge Graph
Coded knowledge graph data created from the transcripts of the Internet Archive's Television News Archive.
Documenting Hate News (ProPublica)
This download includes a set of news stories about hate crimes collected by Google News, including the title, date, publisher, location, keywords, and a brief summary of each story. The data is updated weekly.
Local News Survey Data (Pew Research Center)
Survey dataset for the 2019 Pew Research Center report, "For Local News, Americans Embrace Digital but Still Want Strong Community Connection."
Media Cloud
Media Cloud is an open-source platform with three software tools for performing media analysis.
News Measure 2016 Research Project (Rutgers University)
Web archive of the homepages of 663 local news websites representing 100 communities across the United States. Over 2.2TB of unique data and 16 million URLs. (July - September 2016)
PastPages - The News Homepage Archive
A collection of 3.5 million screenshots from roughly 75 different online news organizations, ranging from 2012 to 2018.
Cable TV News Analyzer (Stanford University)
The dataset available for analysis includes near 24-7 recordings of CNN, Fox News, and MSNBC between January 1, 2010 and approximately 36 hours before the present date.
Data Handbook (DataLiteracy.com)
Created by the European Journalism Centre, DataLiteracy.com provides data journalists with this free handbook to promote data literate journalism approaches.
Talking Data Like a Pro: A plain English Guide to Data Analytics (Nesta)
A helpful explainer of common terms found in data analytics, from UK nonprofit organization Nesta.

America's News (NewsBank)
Find current and historical topics related to controversial issues, the environment, health, education, science, the arts, literature, business, economics, criminal justice, and more, from sources including newspapers, newswires, broadcast transcripts, blogs, periodicals, videos and more.

Data Sets

Internet and Social Media Data Sets

DocNow Tweet Catalog
The DocNow Catalog is a collectively curated listing of Twitter datasets.
Pew Internet & Technology Research Projects
Pew Research Center is a nonpartisan fact tank that informs the public about the issues, attitudes and trends shaping the world. It conducts public opinion polling, demographic research, media content analysis and other empirical social science research.
Where to Get Twitter Data for Academic Research (GitHub)
A 2017 guide authored by Justin Littman (GWU), detailing various avenues for obtaining data from Twitter for academic research projects.
World Internet Project
The World Internet Project (WIP) is a major, international, collaborative project looking at the social, political and economic impact of the Internet and other new technologies.
Google Trends
A searchable database of live Google search trends, complete with graphical representations.

U.S. Economic Data

Data.gov
A centralized source for searching U.S. government data
Federal Reserve Economic Data (FRED)
Provides historical U.S. economic and financial data, including daily U.S. interest rates, monetary and business indicators, exchange rates, balance of payments and regional economic data.
Bureau of Labor Statistics
U. S. Department of Labor. Data related to labor market activity, working conditions, and price changes in the U. S. economy.
Bureau of Economic Analysis
U.S. Department of Commerce. National and international economic indicators.
Economic Research Service (U.S. Dept. of Agriculture)
Includes agricultural research reports, market analysis and outlook reports, economic briefs, and data.
U.S. Census Bureau Economic Indicators
U. S. economic data from the census.
The Conference Board
Consumer Confidence Index, Leading Economic Indicators, and other labor & economic data and analysis.

Demographics

U.S. Census Data
From the U.S. Census: demographic, housing, employment, economic, and local government data for U. S. states, cities, towns, and Puerto Rico.
Statistical Abstract of the United States 1878-2012
From the U.S. Census: comprehensive summary of statistics on the social, political, and economic organization of the United States through 2012.

Digging for Data

Twitter Scrapers and Other Online Tools

Datawrapper
Datawrapper is a free charting tool for representing data visually.
Webscraping (Temple University Libraries)
A guide on how to perform web scraping on Twitter and other platforms from Temple University Libraries.
Tweepy
Tweepy Tutorial by Marco Bonzanini
Twitter Scrape
Twitter Scraper
Tweets Analyzer
New York Times APIs