This work studies automated user classification on Twitter in the public health domain, a task that is essential to many public health-related research works on social media but has not been addressed. The purpose of this paper is to obtain empirical knowledge on how to optimise the classifier performance on this task.
A sample of 3,100 Twitter users who tweeted about different health conditions were manually coded into six most common stakeholders. The authors propose new, simple features extracted from the short Twitter profiles of these users, and compare a large set of classification models (including state-of-the-art) that use more complex features and with different algorithms on this data set.
The authors show that user classification in the public health domain is a very challenging task, as the best result the authors can obtain on this data set is only 59 per cent in terms of F1 score. Compared to state-of-the-art, the methods can obtain significantly better (10 percentage points in F1 on a “best-against-best” basis) results when using only a small set of 40 features extracted from the short Twitter user profile texts.
The work is the first to study the different types of users that engage in health-related communication on social media, applicable to a broad range of health conditions rather than specific ones studied in the previous work. The methods are implemented as open source tools, and together with data, are the first of this kind. The authors believe these will encourage future research to further improve this important task.
