Article

Introducing CounseLLMe: A dataset of simulated mental health dialogues for comparing LLMs like Haiku, LLaMAntino and ChatGPT against humans

2024-05-23

Abstract excerpt

<p>We introduce CounseLLMe as a multilingual, multimodal dataset of 400 simulated mental health counselling dialogues between two state-of-the-art Large Language Models (LLMs). These conversations - of 20 quips each - were generated either in English (using OpenAI's GPT 3.5 and Claude-3's Haiku) or Italian (with Claude-3's Haiku and LLaMAntino) and with prompts tuned also with the help of a professional in psychot...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 3ca59867-13d3-561e-b006-3de9f6029d0e
DOI: 10.31234/osf.io/vhmqs

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Introducing CounseLLMe: A dataset of simulated mental health dialogues for comparing LLMs like Haiku, LLaMAntino and ChatGPT against humansDOI 10.31234/osf.io/vhmqsRead

Systematic Review of Large Language Models for Mental Health TherapySemantic proximity Read

Eeyore: Realistic Depression Simulation via Supervised and Preference OptimizationSemantic proximity Read

AI-Driven Mental Healthcare 5.0: A Survey of Opportunities and Challenges in Leveraging Large Language Models and Generative AISemantic proximity Read

A Neuro-Symbolic Knowledge Graph and Large Language Model Hybrid Architecture for Multi-Modality Mental Health CounselingSemantic proximity Read

Development, System Design, Safety, and Performance Metrics of a Conversational Agent for Reducing Depressive and Anxious Symptoms Based on a Large Language Model: The MHAI StudySemantic proximity Read

The Role of Large Language Models in Clinical Psychology: Current Applications, Efficacy, Challenges, and Future DirectionsSemantic proximity Read

The TEA Nets framework combines AI and cognitive network science to model targets, events and actors in textSemantic proximity Read

ΔAPT: Can we build an AI Therapist? Interdisciplinary critical review aimed at maximizing clinical outcomes using Large Language Models for AI Psychotherapy.Semantic proximity Read

Large Language Models Acting as Psychotherapists: A Scoping ReviewSemantic proximity Read

Digital shadows in mental health map how LLMs simulate depression, anxiety, and stress through language and psychometricsSemantic proximity Read

How Large Language Models Handle Ethical Dilemmas When Providing Mental Health SupportSemantic proximity Read