DM-14: Scrape public websites to gather data

Executive Summary: 
A researcher executes an application that runs for a long period of time, scrapes data from public websites, and stores large amounts of data for analysis.
User Importance Summary: 
Some types of research involve pulling data from many public sources and analyzing the aggregated results.
Target Communities and Sizes: 
Researchers who use this research method - 100 < N < 1,000
Documents:
Full description (for review)
Full description (drafting version)
Status: 
User Review
Use Case Author: 
Lee Liming
Use Case End User: 
researchers
Area: 
Scientific Data
Sub-Area: 
Data Management
First Proposed Date: 
2020-10-01
Last Approved Date: 
2020-11-05

National Science Foundation (NSF)

© ACCESS All Rights Reserved.

ACCESS is an advanced computing and data resource supported by the National Science Foundation and made possible through these lead institutions and their partners:
Carnegie Mellon University, University of Colorado Boulder, University of Illinois at Urbana-Champaign, and State University of New York at Buffalo .


Administrative Login