J Med Internet Res. 2024 May 8;26:e51698. doi: 10.2196/51698.
ABSTRACT
BACKGROUND: Nonprofit organizations are increasingly using social media to improve their communication strategies with the broader population. However, within the domain of human service nonprofits, there is hesitancy to fully use social media tools, and there is limited scope among organizational personnel in applying their potential beyond self-promotion and service advertisement. There is a pressing need for greater conceptual clarity to support education and training on the varied reasons for using social media to increase organizational outcomes.
OBJECTIVE: This study leverages the potential of Twitter (subsequently rebranded as X [X Corp]) to examine the online communication content within a sample (n=133) of nonprofit sexual assault (SA) centers in Canada. To achieve this, we developed a typology using a qualitative and supervised machine learning model for the automatic classification of tweets posted by these centers.
METHODS: Using a mixed methods approach that combines machine learning and qualitative analysis, we manually coded 10,809 tweets from 133 SA centers in Canada, spanning the period from March 2009 to March 2023. These manually labeled tweets were used as the training data set for the supervised machine learning process, which allowed us to classify 286,551 organizational tweets. The classification model based on supervised machine learning yielded satisfactory results, prompting the use of unsupervised machine learning to classify the topics within each thematic category and identify latent topics. The qualitative thematic analysis, in combination with topic modeling, provided a contextual understanding of each theme. Sentiment analysis was conducted to reveal the emotions conveyed in the tweets. We conducted validation of the model with 2 independent data sets.
RESULTS: Manual annotation of 10,809 tweets identified seven thematic categories: (1) community engagement, (2) organization administration, (3) public awareness, (4) political advocacy, (5) support for others, (6) partnerships, and (7) appreciation. Organization administration was the most frequent segment, and political advocacy and partnerships were the smallest segments. The supervised machine learning model achieved an accuracy of 63.4% in classifying tweets. The sentiment analysis revealed a prevalence of neutral sentiment across all categories. The emotion analysis indicated that fear was predominant, whereas joy was associated with the partnership and appreciation tweets. Topic modeling identified distinct themes within each category, providing valuable insights into the prevalent discussions surrounding SA and related issues.
CONCLUSIONS: This research contributes an original theoretical model that sheds light on how human service nonprofits use social media to achieve their online organizational communication objectives across 7 thematic categories. The study advances our comprehension of social media use by nonprofits, presenting a comprehensive typology that captures the diverse communication objectives and contents of these organizations, which provide content to expand training and education for nonprofit leaders to connect and engage with the public, policy experts, other organizations, and potential service users.
PMID:38718390 | DOI:10.2196/51698