Information extraction from digital social trace data with applications to social media and scholarly communication data

Abstract

Information extraction (IE) aims at extracting structured data from unstructured or semi-structured data. The thesis starts by identifying social media data and scholarly communication data as a special case of digital social trace data (DSTD). This identification allows us to utilize the graph structure of the data (e.g., user connected to a tweet, author connected to a paper, author connected to authors, etc.) for developing new information extraction tasks. The thesis focuses on information extraction from DSTD, first, using only the text data from tweets and scholarly paper abstracts, and then using the full graph structure of Twitter and scholarly communications datasets. This thesis makes three major contributions.

First, new IE tasks based on DSTD representation of the data are introduced. For scholarly communication data, methods are developed to identify article and author level novelty and expertise. Furthermore, interfaces for examining the extracted information are introduced. A social communication temporal graph (SCTG) is introduced for comparing different communication data like tweets tagged with sentiment, tweets about a search query, and Facebook group posts. For social media, new text classification categories are introduced, with the aim of identifying enthusiastic and supportive users, via their tweets. Additionally, the correlation between sentiment classes and Twitter meta-data in public corpora is analyzed, leading to the development of a better model for sentiment classification.

Second, methods are introduced for extracting information from social media and scholarly data. For scholarly data, a semi-automatic method is introduced for the construction of a large-scale taxonomy of computer science concepts. The method relies on the Wikipedia category tree. The constructed taxonomy is used for identifying key computer science phrases in scholarly papers, and tracking their evolution over time. Similarly, for social media data, machine learning models based on human-in-the-loop learning, semi-supervised learning, and multi-task learning are introduced for identifying sentiment, named entities, part of speech tags, phrase chunks, and super-sense tags. The machine learning models are developed with a focus on leveraging all available data. The multi-task models presented here result in competitive performance against other methods, for most of the tasks, while reducing inference time computational costs.

Finally, this thesis has resulted in the creation of multiple open source tools and public data sets, which can be utilized by the research community. The thesis aims to act as a bridge between research questions and techniques used in DSTD from different domains. The methods and tools presented here can help advance work in the areas of social media and scholarly data analysis. All resources related to this thesis are available at https://shubhanshu.com/phd_thesis/.

Committee

List of resources

Thesis Citation

Mishra, Shubhanshu. 2020. “Information Extraction from Digital Social Trace Data with Applications to Social Media and Scholarly Communication Data.” University of Illinois at Urbana-Champaign. https://shubhanshu.com/phd_thesis/.

Shubhanshu Mishra. 2021. Information extraction from digital social trace data with applications to social media and scholarly communication data. SIGWEB Newsl., Spring, Article 3 (Spring 2021), 4 pages. https://doi.org/10.1145/3460304.3460307

Shubhanshu Mishra. 2021. Information extraction from digital social trace data with applications to social media and scholarly communication data. SIGIR Forum 54, 1, Article 17 (June 2020), 2 pages. https://doi.org/10.1145/3451964.3451981

Bibtext

@phdthesis{MishraThesisDSTDIE2020,
author = {Mishra, Shubhanshu},
school = {University of Illinois at Urbana-Champaign},
title = ,
url = {https://shubhanshu.com/phd{\_}thesis/},
note = {\url{http://hdl.handle.net/2142/107965}},
year = {2020}
}

@article{mishra_information_2021,
	title = {Information extraction from digital social trace data with applications to social media and scholarly communication data},
	copyright = {All rights reserved},
	issn = {1931-1745, 1931-1435},
	url = {https://dl.acm.org/doi/10.1145/3460304.3460307},
	doi = {10.1145/3460304.3460307},
	language = {en},
	number = {Spring},
	urldate = {2022-01-28},
	journal = {ACM SIGWEB Newsletter},
	author = {Mishra, Shubhanshu},
	month = mar,
	year = {2021},
	pages = {1--4},
}

@article{mishra_information_2020-1,
author = {Mishra, Shubhanshu},
title = {Information Extraction from Digital Social Trace Data with Applications to Social Media and Scholarly Communication Data},
year = {2021},
issue_date = {June 2020},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {54},
number = {1},
issn = {0163-5840},
url = {https://doi.org/10.1145/3451964.3451981},
doi = {10.1145/3451964.3451981},
journal = {SIGIR Forum},
month = {feb},
articleno = {17},
numpages = {2}
	note = {\url{http://sigir.org/wp-content/uploads/2020/06/p19.pdf}},
}