1. General – Data Collection and Working with Digital Data
1. Data Collection – Getting started
This section gives a short introduction to data collection methods and some relevant questions to be considered. This section also lists some tools for collecting data from social media platforms and online media, and discusses best practices for data structuring (wrangling).
The following question should be considered when starting the process of data collection (van Es et al. 2017):
- What ethical considerations have been taken into account when collecting the research data?
- What kind of data is being used?
- How was the data collected? Which tools or software were used, or who supplied the data?
- Which criteria were used to select the data set? Who is included or excluded from the data set?
- What are the limitations of these data-gathering methods? How reliable is the method of data collection?
- What metadata does the data set contain (for example, location, time, date of a tweet)?
- When combining data sets, what biases might result from the different contexts from which the data originated?
Digital research is a constantly developing field, and the same can be said for the digital sphere itself. For this reason, the tools designed for collecting and analysing data from digital resources change constantly, and their usability might not be unending – for example, a platform can change their API policy overnight. Another important thing to consider is whether the tool used conforms with the current legislation and the rules of the data source.
Before starting the process of data collection, familiarize yourself with research ethics and the relevant legislation.
Books and articles
Acker, A., & Kreisberg, A. (2020). Social media data archives in an API-driven world. Archival Science, 20(2), 105–123. https://doi.org/10.1007/s10502-019-09325-9
Es, Karin van; Coombs, Nicolás López & Boeschoten, Thomas (2017). Towards a Reflexive Digital Data Analysis. In Mirko Tobias Schäfer & Karin van Es (eds.) The Datafied Society. Studying Culture through Data. Amsterdam University Press.
Jarlbrink, J. (2020). All the Work that Makes It Work: Digital Methods and Manual Labour. Digital Histories: Emergent Approaches within the New Digital History, 2020, 113–126. https://doi.org/10.33134/hup-5-7
Mancosu, M., & Vegetti, F. (2020). What You Can Scrape and What Is Right to Scrape: A Proposal for a Tool to Collect Public Facebook Data. Social Media and Society, 6(3).
Perriam, J., Birkbak, A., & Freeman, A. (2020). Digital methods in a post-API environment. International Journal of Social Research Methodology, 23(3), 277–290. https://doi.org/10.1080/13645579.2019.1682840
Pink, Sarah; Ruckenstein, Minna; Willim, Robert & Duque, Melisa (2018). Broken data: Conceptualising data in an emerging world. Big Data & Society 5:1, 1–13.
Rogers, R. (2017). Digital Methods for Cross-platform Analysis. In The SAGE Handbook of Social Media.
Venturini, T., Bounegru, L., Gray, J., & Rogers, R. (2018). A reality check(list) for digital methods. New Media and Society, 20(11), 4195–4217. https://doi.org/10.1177/1461444818769236