Explainable depression symptom detection in social media

Prince M, Patel V, Saxena S, Maj M, Maselko J, Phillips MR, Rahman A. No health without mental health. Lancet. 2007;370(9590):859–77.

Article  Google Scholar 

Mental Health TNS. Wellbeing: mental health: prevalence and impact. Technical report, Australian Institute of Health and Welfare 2022

Organization WH, et al. Depression and other common mental disorders: global health estimates. Technical report, World Health Organization; 2017

Picardi A, Lega I, Tarsitani L, Caredda M, Matteucci G, Zerella MP, Miglio R, Gigantesco A, Cerbo M, Gaddini A, Spandonaro F, Biondi M. SET-DEP Group: a randomised controlled trial of the effectiveness of a program for early detection and treatment of depression in primary care. J Affect Disord. 2016;198:96–101.

Article  Google Scholar 

Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113.

Article  Google Scholar 

De Choudhury M, Gamon M, Counts S, Horvitz E. Predicting depression via social media. In: Proceedings of the international AAAI conference on web and social media. 2013. p. 128–37

Sadeque F, Xu D, Bethard S. Measuring the latency of depression detection in social media. In: Proceedings of the eleventh ACM international conference on web search and data mining. WSDM ’18. New York: Association for Computing Machinery; 2018. p. 495–503

Yates A, Cohan A, Goharian N. Depression and self-harm risk assessment in online forums. In: Proceedings of the 2017 conference on empirical methods in natural language processing. Copenhagen: Association for Computational Linguistics; 2017. p. 2968–78

Cacheda F, Fernandez D, Novoa FJ, Carneiro V. Early detection of depression: social network analysis and random forest techniques. J Med Internet Res. 2019;21(6):12554.

Article  Google Scholar 

Beheshti A, Moraveji-Hashemi V, Yakhchi S, Motahari-Nezhad H.R, Ghafari S.M, Yang J. Personality2vec: enabling the analysis of behavioral disorders in social networks. In: Proceedings of the 13th international conference on web search and data mining. WSDM ’20. New York: Association for Computing Machinery; 2020. p. 825–28

Bucur A.-M, Cosma A, Rosso P, Dinu LP. It’s just a matter of time: detecting depression with time-enriched multimodal transformers. In: European conference on information retrieval; 2023. Springer. p. 200–15

Aragon M, Lopez Monroy A.P, Gonzalez L, Losada D.E, Montes M. DisorBERT: a double domain adaptation model for detecting signs of mental disorders in social media. In: Proceedings of the 61st annual meeting of the association for computational linguistics (vol. 1: Long Papers). Toronto: Association for Computational Linguistics; 2023. p. 15305–18

Callahan A, Inckle K. Cybertherapy or psychobabble? A mixed methods study of online emotional support. Br J Guidance Counsell. 2012;40(3):261–78.

Article  Google Scholar 

Ferraro G, Loo Gee B, Ji S, Salvador-Carulla L. Lightme: analysing language in internet support groups for mental health. Health Inf Sci Syst. 2020;8(1):34.

Article  Google Scholar 

Ríssola EA, Losada DE, Crestani F. A survey of computational methods for online mental state assessment on social media. ACM Trans. Comput. Healthc. 2021;2(2):1–31.

Article  Google Scholar 

Parapar J, Martín-Rodilla P, Losada D.E, Crestani F. eRisk 2023: depression, pathological gambling, and eating disorder challenges. In: Advances in information retrieval: 45th European conference on information retrieval, ECIR 2023, Dublin, Ireland, April 2–6, 2023, Proceedings, Part III. Springer; 2023. p. 585–92

Zirikly A, Atzil-Slonim D, Liakata M, Bedrick S, Desmet B, Ireland M, Lee A, MacAvaney S, Purver M, Resnik R, Yates A, editors. Proceedings of the eighth workshop on computational linguistics and clinical psychology. Seattle: Association for Computational Linguistics; 2022

Walsh CG, Chaudhry B, Dua P, Goodman KW, Kaplan B, Kavuluru R, Solomonides A, Subbian V. Stigma, biomarkers, and algorithmic bias: recommendations for precision behavioral health with artificial intelligence. JAMIA Open. 2020;3(1):9–15.

Article  Google Scholar 

Hauser TU, Skvortsova V, De Choudhury M, Koutsouleris N. The promise of a model-based psychiatry: building computational models of mental ill health. Lancet Digit. Health. 2022;4(11):816–28.

Article  Google Scholar 

Ernala SK, Birnbaum ML, Candan KA, Rizvi AF, Sterling WA, Kane JM, De Choudhury M. Methodological gaps in predicting mental health states from social media: triangulating diagnostic signals. In: Proceedings of the 2019 CHI conference on human factors in computing systems. CHI ’19. New York: Association for Computing Machinery; 2019. p. 1–16

Beck AT, Steer RA, Brown G. Beck Depression Inventory–II. American Psychological Association (APA). 1996

Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J General Internal Med. 2001:16(9):606–613

Pérez A, Parapar J. Barreiro: Automatic depression score estimation with word embedding models. Artif Intell Med. 2022;132:102380.

Article  Google Scholar 

Nguyen T, Yates A, Zirikly A, Desmet B, Cohan A. Improving the generalizability of depression detection by leveraging clinical questionnaires. In: Proceedings of the 60th annual meeting of the association for computational linguistics, vol. 1 (Long Papers). Dublin: Association for Computational Linguistics; 2022. p. 8446–59

Zhang Z, Chen S, Wu M, Zhu K. Symptom identification for interpretable detection of multiple mental disorders on social media. In: Proceedings of the 2022 conference on empirical methods in natural language processing. Abu Dhabi: Association for Computational Linguistics; 2022. p. 9970–85

Zhang Z, Chen S, Wu M, Zhu KQ. Psychiatric scale guided risky post screening for early detection of depression. In: Raedt LD, editor. Proceedings of the thirty-first international joint conference on artificial intelligence, IJCAI-22. AI for Good; 2022. p. 5220–26

Pérez A, Warikoo N, Wang K, Parapar J, Gurevych I. Semantic similarity models for depression severity estimation. In: Bouamor H, Pino J, Bali K, editors. Proceedings of the 2023 conference on empirical methods in natural language processing. Singapore: Association for Computational Linguistics; 2023. p. 16104–18.

Smith KM, Renshaw PF, Bilello J. The diagnosis of depression: current and emerging methods. Compr Psychiatry. 2013;54(1):1–6.

Article  Google Scholar 

Doshi-Velez F, Kim B. Towards a rigorous science of interpretable machine learning. 2017.

Markus AF, Kors JA, Rijnbeek PR. The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategies. J Biomed Inform. 2021;113:103655.

Article  Google Scholar 

Miller T. Explanation in artificial intelligence: insights from the social sciences. Artif Intell. 2019;267:1–38.

Article  MathSciNet  Google Scholar 

OpenAI: introducing ChatGPT. Accessed Aug 1 2023. 2022

Chiang W-L, Li Z, Lin Z, Sheng Y, Wu Z, Zhang H, Zheng L, Zhuang S, Zhuang Y, Gonzalez J.E, Stoica I, Xing EP. Vicuna: an open-source chatbot impressing GPT-4 with 90%* ChatGPT quality. 2023.

Jiang AQ, Sablayrolles A, Mensch A, Bamford C, Chaplot DS, Casas D, Bressand F, Lengyel G, Lample G, Saulnier L, Lavaud LR, Lachaux M-A, Stock P, Scao TL, Lavril T, Wang T, Lacroix T, Sayed WE. Mistral 7B. 2023

Yang K, Zhang T, Kuang Z, Xie Q, Ananiadou S. Mentalllama: interpretable mental health analysis on social media with large language models. To be published at: WWW ’24: the ACM web conference 2023, Singapore May 13–17, 2024. 2023

Perez A, Parapar J, Barreiro A, Lopez-Larrosa S. Bdi-sen: a sentence dataset for clinical symptoms of depression. In: Proceedings of the 46th international ACM SIGIR conference on research and development in information retrieval. 2023.

Islam MR, Kabir MA, Ahmed A, Kamal ARM, Wang H, Ulhaq A. Depression detection from social network data using machine learning techniques. Health Inf Sci Syst. 2018;6(1):8

Li Z, An Z, Cheng W, Zhou J, Zheng F, Hu B. MHA: a multimodal hierarchical attention model for depression detection in social media. Health Inf. Sci. Syst. 2023;11(1):6.

Article  Google Scholar 

Guntuku SC, Yaden DB, Kern ML, Ungar LH, Eichstaedt JC. Detecting depression and mental illness on social media: an integrative review. Big data in the behavioural sciences. Curr Opin Behav Sci. 2017;18:43–49

Skaik R, Inkpen D. Using social media for mental health surveillance: a review. ACM Comput Surv 2020;53(6)

Crestani F, Losada DE, Parapar J. Early detection of mental health disorders by social media monitoring: the first five years of the ERisk project vol. 1018. 2022

Wang T, Brede M, Ianni A, Mentzakis E. Detecting and characterizing eating-disorder communities on social media. In: Proceedings of the tenth ACM international conference on web search and data mining. WSDM ’17. New York: Association for Computing Machinery; 2017. p. 91–100

Shuai H-H, Shen C-Y, Yang D-N, Lan Y-F, Lee W-C, Yu PS, Chen M-S. Mining online social data for detecting social network mental disorders. In: Proceedings of the 25th international conference on world wide web. WWW ’16. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE. 2016. p. 275–85

Halfin A. Depression: the benefits of early and appropriate treatment. Am J Manag Care. 2007;13(4 Suppl):92–7.

Google Scholar 

Guidotti R, Ruggieri S. On the stability of interpretable models. In: 2019 international joint conference on neural networks (IJCNN). 2019. p. 1–8

Tulio Ribeiro M, Singh S, Guestrin C. Model-agnostic interpretability of machine learning. 2016. 1606–05386[stat.ML]

Ribeiro M.T, Singh S, Guestrin C. Anchors: high-precision model-agnostic explanations. Proc AAAI Conf Artif Intell 2018;32(1)

Baehrens D, Schroeter T, Harmeling S, Kawanabe M, Hansen K, Müller K.-R. How to explain individual classification decisions. J Mach Learn Res. 2010;11:1803–31

Ribeiro MT, Singh S, Guestrin C. "Why should i trust you?" Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. 2016. p. 1135–44

Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. In: Advances in neural information processing systems, vol. 30. 2017

Lopez-Larrosa S, Sánchez-Souto V, Losada D.E, Parapar J, Barreiro Ha A.P, Cummings E.M. Using machine learning techniques to predict adolescents’ involvement in family conflict. Soc Sci Comput Rev. 2023;41(5):1581–607

Nordin N, Zainol Z, Mohd Noor M.H, Chan L.F. An explainable predictive model for suicide attempt risk using an ensemble learning and shapley additive explanations (SHAP) approach. Asian J Psychiatry 2023;79:103316

Ustun B, Rudin C. Supersparse linear integer models for optimized medical scoring systems. Mach Learn. 2016;102(3):349–91.

Article  MathSciNet  Google Scholar 

Lakkaraju H, Bach SH, Leskovec J. Interpretable decision sets: A joint framework for description and prediction. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. KDD ’16. New York: Association for Computing Machinery; 2016. p. 1675–84

Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. In: Proceedings of the 31st international conference on neural information processing systems. NIPS’17. Red Hook: Curran Associates Inc.; 2017. p. 4768–77

Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Lu, Polosukhin I. Attention is all you need. In: Guyon I, Luxburg U.V, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R, editors. Advances in neural information processing systems. 2017;30

Mullenbach J, Wiegreffe S, Duke J, Sun J, Eisenstein J. Explainable prediction of medical codes from clinical text. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, vol. 1 (Long Papers). New Orleans: Association for Computational Linguistics; 2018. p. 1101–111

Song H, You J, Chung J-W, Park JC. Feature attention network: Interpretable depression detection from social media. In: Proceedings of the 32nd Pacific Asia conference on language, information and computation. Hong Kong: Association for Computational Linguistics; 2018

Amini H, Kosseim L. Towards explainability in using deep learning for the detection of anorexia in social media. In: Métais E, Meziane F, Horacek H, Cimiano P, editors. Natural language processing and information systems. Cham: Springer; 2020. p. 225–35.

Chapter  Google Scholar 

Wiegreffe S, Pinter Y. Attention is not not explanation. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Hong Kong: Association for Computational Linguistics; 2019. p. 11–20

Tutek M, Šnajder J. Toward practical usage of the attention mechanism as a tool for interpretability. IEEE Access. 2022;10:47011–30.

Article  Google Scholar 

Jain S, Wallace BC. Attention is not explanation. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, vol. 1 (Long and Short Papers). Minneapolis: Association for Computational Linguistics; 2019. p. 3543–56.

Serrano S, Smith NA. Is attention interpretable? In: Proceedings of the 57th annual meeting of the association for computational linguistics. Florence: Association for Computational Linguistics; 2019. p. 2931–51.

Camburu O-M, Rocktäschel T, Lukasiewicz T, Blunsom P. e-snli: natural language inference with natural language explanations. In: Bengio S, Wallach H, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R, editors. Advances in neural information processing systems, vol. 31

Yang K, Ji S, Zhang T, Xie Q, Kuang Z, Ananiadou S. Towards interpretable mental health analysis with large language models. In: Bouamor H, Pino J, Bali K, editors. Proceedings of the 2023 conference on empirical methods in natural language processing, EMNLP 2023, Singapore, December 6–10; 2023. p. 6056–77.

Kojima T, Gu S.S, Reid M, Matsuo Y, Iwasawa Y. Large language models are zero-shot reasoners. In: Koyejo S, Mohamed S, Agarwal A, Belgrave D, Cho K, Oh A, editors. Advances in neural information processing systems. 2022;35:22199–213.

Cambria E, Malandri L, Mercorio F, Mezzanzanica M, Nobani N. A survey on xai and natural language explanations. Inf. Process Manag. 2023;60(1):103111.

Article  Google Scholar 

Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ. Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res. 2020;21(1)

Sutskever I, Vinyals O, Le QV. Sequence to sequence learning with neural networks. In: Proceedings of the 27th international conference on neural information processing systems-volume 2. NIPS’14. Cambridge: MIT Press; 2014. p. 3104–12

Devlin J, Chang M-W, Lee K, Toutanova K. BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, vol 1 (Long and Short Papers). Minneapolis: Association for Computational Linguistics; 2019. p. 4171–86

Wang A, Pruksachatkun Y, Nangia N, Singh A, Michael J, Hill F, Levy O, Bowman SR. SuperGLUE: a stickier benchmark for general-purpose language understanding systems. Red Hook: Curran Associates Inc; 2019.

Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics; 2020. p. 7871–80.

Erliksson KF. Arpteg A, Matskin M, Payberah AH. Cross-domain transfer of generative explanations using text-to-text models. In: Natural language processing and information systems: 26th international conference on applications of natural language to information systems. NLDB 2021, Saarbrücken, Germany, June 23–25, 2021, Proceedings. Berlin, Heidelberg: Springer; 2021. p. 76–89.

Narang S, Raffel C, Lee K, Roberts A, Fiedel N, Malkan K. WT5?! Training Text-to-Text Models to Explain their Predictions 2020.

Ji S, Zhang T, Ansari L, Fu J, Tiwari P, Cambria E. MentalBERT: publicly available pretrained language models for mental healthcare. In: Proceedings of the thirteenth language resources and evaluation conference. Marseille: European Language Resources Association; 2022. p. 7184–90.

Brown T, Mann B, Ryder N, Subbiah M, Kaplan J.D, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A, Agarwal S, Herbert-Voss A, Krueger G, Henighan T, Child R, Ramesh A, Ziegler D, Wu J, Winter C, Hesse C, Chen M, Sigler E, Litwin M, Gray S, Chess B, Clark J, Berner C, McCandlish S, Radford A, Sutskever I, Amodei D. Language models are few-shot learners. In: Larochelle H, Ranzato M, Hadsell R, Balcan MF Lin H, editors. Advances in neural information processing systems, vol. 33. 2020. p. 1877–901.

Dettmers T, Pagnoni A, Holtzman A, Zettlemoyer L. QLoRA: efficient finetuning of quantized LLMs. 2023

Touvron H, Martin L, Stone K, Albert P, Almahairi A, Babaei Y, Bashlykov N, Batra S, Bhargava P, Bhosale S, Bikel D, Blecher L, Ferrer C.C, Chen M, Cucurull G, Esiobu D, Fernandes J, Fu J, Fu W, Fuller B, Gao C, Goswami V, Goyal N, Hartshorn A, Hosseini S, Hou R, Inan H, Kardas M, Kerkez V, Khabsa M, Kloumann I, Korenev A, Koura PS, Lachaux M-A, Lavril T, Lee J, Liskovich D, Lu Y, Mao Y, Martinet X, Mihaylov T, Mishra P, Molybog I, Nie Y, Poulton A, Reizenstein J, Rungta R, Saladi K, Schelten A, Silva R, Smith EM, Subramanian R, Tan XE, Tang B, Taylor R, Williams A, Kuan J.X, Xu P, Yan Z, Zarov I, Zhang Y, Fan A, Kambadur M, Narang S, Rodriguez A, Stojnic R, Edunov S, Scialom T. Llama 2: open foundation and fine-tuned chat models. 2023

Jackson-Koku G. Beck depression inventory. Occup Med. 2016;66(2):174–5.

Article  Google Scholar 

Naseem U, Dunn A.G, Kim J, Khushi M. Early identification of depression severity levels on reddit using ordinal classification. In: Proceedings of the ACM web conference 2022. 2022. p. 2563–72

Nuckols CC, Nuckols CC. The diagnostic and statistical manual of mental disorders, (DSM-5). Philadelphia: American Psychiatric Association; 2013.

Google Scholar 

Ji Z, Lee N, Frieske R, Yu T, Su D, Xu Y, Ishii E, Bang YJ, Madotto A, Fung P. Survey of hallucination in natural language generation. ACM Comput Surv. 2023;55(12):1–38.

Article  Google Scholar 

Lin C-Y. ROUGE: a package for automatic evaluation of summaries. In: Text summarization branches out. Association for Computational Linguistics, Barcelona, Spain; 2004. p. 74–81

Papineni K, Roukos S, Ward T, Zhu W-J. Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Philadelphia, Pennsylvania, USA; 2002. p. 311–18

DeYoung J, Jain S, Rajani N.F, Lehman E, Xiong C, Socher R, Wallace BC. ERASER: a benchmark to evaluate rationalized NLP models. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics; 2020. p. 4443–58.

MacAvaney S, Desmet B, Cohan A, Soldaini L, Yates A, Zirikly A, Goharian N. RSDD-time: temporal annotation of self-reported mental health diagnoses. In: Proceedings of the fifth workshop on computational linguistics and clinical psychology: from keyboard to clinic. New Orleans: Association for Computational Linguistics; 2018. p. 168–73

Mowery D, Smith H, Cheney T, Stoddard G, Coppersmith G, Bryan C, Conway M, et al. Understanding depressive symptoms and psychosocial stressors on twitter: a corpus-based study. J Med Internet Res. 2017;19(2):6895.

Article  Google Scholar 

Findings of the Association for Computational Linguistics. Harrigian K, Aguirre C, Dredze M. Do models of mental health based on social media data generalize? In: EMNLP; 2020. p. 3774–88.

Google Scholar 

Pérez A, Fernández-Pichel M, Parapar J, Losada D.E. DepreSym: a depression symptom annotated corpus and the role of LLMs as assessors of psychological markers. 2023

Feder A, Keith KA, Manzoor E, Pryzant R, Sridhar D, Wood-Doughty Z, Eisenstein J, Grimmer J, Reichart R, Roberts ME, Stewart BM, Veitch V, Yang D. Causal inference in natural language processing: estimation, prediction, interpretation and beyond. Trans Assoc Comput Linguist. 2022;10:1138–58.

Article  Google Scholar 

Barredo Arrieta A, Díaz-Rodríguez N, Del Ser J, Bennetot A, Tabik S, Barbado A, Garcia S, Gil-Lopez S, Molina D, Benjamins R, Chatila R, Herrera F. Explainable artificial intelligence (xai): concepts, taxonomies, opportunities and challenges toward responsible ai. Information Fusion. 2020;58:82–115.

Article  Google Scholar 

Zhao Z, Wallace E, Feng S, Klein D, Singh S. Calibrate before use: improving few-shot performance of language models. In: International conference on machine learning. PML

Comments (0)

No login
gif