Integrating extended digital musical instruments as inclusive technology in education

Abstract

Extended Digital Musical Instruments (EDMIs) offer a transformative approach to inclusive technology by integrating advanced digital capabilities to enhance expressive and interactive experiences. This paper presents the development and application of BehCreative, an innovative EDMI designed to incorporate environment, ecology, and bodily immersion into the musical process. Utilizing motion capture systems such as IDS Ethernet cameras and Microsoft Kinect 3D optical sensors, BehCreative enables real-time tracking of user movements, facilitating dynamic and responsive musical interactions. BehCreative leverages Mixed Reality (MR) and sonification algorithms to generate sounds based on user gestures, creating immersive experiences that are therapeutic. By fostering creative empowerment and emotional well-being, BehCreative exemplifies the potential of technology to transform traditional inclusive practices. This study explores the theoretical foundations of BehCreative, drawing from embodied cognition and sensorimotor contingency theories to illustrate how physical interactions within digital environments can enhance therapeutic outcomes. The application of BehCreative in therapeutic settings is evaluated through qualitative and quantitative methodologies, highlighting its impact on user engagement, creativity, and inclusivity. The relevance of EDMIs like BehCreative underscores the interdisciplinary connections between inclusive technology, therapy, and education. By addressing the cognitive and social dimensions of therapeutic practices, BehCreative provides an example of integrating innovative technologies to support diverse needs. EDMIs can support diverse learning needs and promote accessibility in therapeutic and educational settings, promoting creativity and therapeutic outcomes through inclusive learning and inclusive technologies.