Social robot experiences for people with intellectual disabilities to learn, practice and use work skills

Overview

https://research.qut.edu.au/designlab/https://research.qut.edu.au/designlab/

This project aims to investigate the opportunities of using AI-enabled robot technology, such as humanoid robots, to enhance the employability of people with intellectual disability (ID). We propose that access and retention in employment can be enhanced with learning technologies that can support people to acquire, practice, and maintain job-related skills while creating socially inclusive workplaces. Humanoid robots are being marketed for supporting people with practical tasks in homes and workplaces . As a type of social robot, they have the potential provide dignified, inclusive experiences to employees with ID while addressing the cost and limited access to human support.

Vision-language models (VLMs), a branch of the new wave of artificial intelligence (AI) capabilities, are now sufficiently mature to enable entirely new forms of multimodal interaction, where users can express them selves through a blend of verbal, visual and situational modalities and receive information through images, videos and audio channels. These new types of interactions align with the diverse communication modes preferred by people with ID. Non-judgmental human repetition through AI technology can enhance the independent use of executive function skills in employees with ID. Social Robots (SRs) are a natural platform for these multi-modal interactions, as they can hear, see, show, display and talk, adding a layer of non-judgmental personhood to the interaction.

Research activities

Iterative co-design cycles through technology development and customized trials paired with qualitative thematic analysis of interviews and ethnographic observations will generate new deep knowledge of the perspectives of people with ID on co-designing their social robot learning experiences of learning, practising and applying work skills. Participants' engagement with innovative interaction mechanisms that leverage the modalities of the social robots and vision-language models will be explored.

• Literature review.
• Participatory design research.
• Interviews.
• Qualitative data analysis.
• Prototype development.

Outcomes

• Student thesis.
• Co-authored publications.
• Technology prototypes.

Skills and experience

Students applying for this topic should have at least one of:

• experience and/or interest in working with people with disabilities
• experience in participatory design and/or prototyping approaches.

A background in human-computer interaction or human-robot interaction (or similar) is required.

Experience working with social robotics would be preferred.

Students with relevant lived experience are strongly encouraged to apply.

Scholarships

You may be eligible to apply for a research scholarship.

Explore our research scholarships

Keywords

• participatory design
• ai
• robotics
• social robots
• humanoid robots
• people with intellectual disabilities
• intellectual disability
• id
• cognitive disability
• employment
• vision language models
• vlm
• communication
• training
• co-design
• accessibility

Contact

Contact the supervisor for more information.