Files and links (1)
Open Access CC BY V4.0
Journal article
Multimodal Analysis of Child-Horse Therapeutic Interactions Using Vision-Language Models in an Australian Aboriginal Equine-Assisted Learning Program for Social and Emotional Wellbeing: A Development and Evaluation Study (Preprint)
Journal of medical Internet research
2026
Abstract
Background:
The human-horse bond has played a role in human development through history and has more recently been applied to mental health promotion through Equine-Assisted Learning (EAL) programs. In EAL settings, therapeutic assessment commonly relies on practitioner observations documented through behavioural checklists, structured interviews, and progress notes, which can pose challenges due to time demands, subjectivity, and inconsistent standardisation across practitioners and contexts.
Objective:
To address these challenges and support more quantitative analysis of therapeutic interactions, this study developed an AI-powered framework based on Visual Language Models (VLMs) to analyse child-horse interactions in EAL settings. The framework was developed in collaboration with the Yawardani Jan-ga EAL program, which supports the social and emotional well-being of Aboriginal youth in the Kimberly region of Western Australia.
Methods:
The proposed framework comprises three core components: (1) an activity classification module employing a VLM with few-shot learning based on SigLIP2 to identify nine therapeutic activities; (2) a proxemics analysis module using a qwen2.5-VL-7B VLM to classify physical contact between the child and horse; and (3) a body posture analysis module applying multimodal Chain-of-Thought (MCoT) prompting and self-consistency techniques to classify children’s body posture into confidence-related states with interpretable reasoning.
Results:
The framework was trained and evaluated using real-world images collected during therapeutic sessions with Aboriginal children participating in the Yawardani Jan-ga program. The activity classification module achieved F1, accuracy, precision, and recall scores of 91.6%, 90.7%, 92.2%, and 91.7%, respectively. The proxemics analysis module achieved an accuracy of 88.6%, precision of 88.3%, and an F1 score of 88.1%. For the body posture analysis module, system reliability was assessed using stability metrics, achieving an average Consistency of 0.916, an Agreement Rate of 0.705, a Rationale Coherence of 0.857, and a Vote Entropy of 0.174.
Conclusions:
The findings suggest that AI- and VLM-based approaches may provide complementary support for therapeutic assessment in EAL and warrant further investigation.
Details
- Title
- Multimodal Analysis of Child-Horse Therapeutic Interactions Using Vision-Language Models in an Australian Aboriginal Equine-Assisted Learning Program for Social and Emotional Wellbeing: A Development and Evaluation Study (Preprint)
- Authors/Creators
- Karma Dechen DemaGuanjin WangSharmila VazCraig OlssonJuli Coffin
- Publication Details
- Journal of medical Internet research
- Identifiers
- 991005912894007891
- Copyright
- © The authors.
- Murdoch Affiliation
- School of Information Technology
- Language
- English
- Resource Type
- Journal article
UN Sustainable Development Goals (SDGs)
This output has contributed to the advancement of the following goals:
Source: SDGs in the Output
Metrics
1 Record Views