Wednesday, 28 May 2025
A musical robot, created by researchers at the University of Nottingham to help musicians with disabilities access music-making in a way that hasn’t previously been possible, has won two prestigious sound awards.
Jess+ was developed as part of the European Research Council funded Digital Score (DigiScore) project by Craig Vear, Professor of Music and Computer Science, for inclusive music making, using AI and robotics. It is the first large-scale collaboration between the university’s Department of Music, School of Computer Science, Orchestras Live and Sinfonia Viva.
The two prestigious awards recently allocated to the project were for the category ‘Best Sound Innovation’ from the Sound of the Year Awards; and ‘Music Tech’ award, presented from the Global Tech Awards.
The Sound of the Year Awards celebrate sound in all its innovative and creative forms, from all corners of the world, and are judged by a panel of leading lights from the international sound community. The Global Tech Awards recognise and celebrate the very best in technology, with a focus on innovation, creativity and excellence. They aim to identify and reward the most exceptional technology solutions and services from around the world.
Being involved with the Jess+ project was an honour and a privilege. I got to work with so many amazing colleagues and was supported by wonderful external organisations such as Orchestra's Live and Sinfonia Viva.”
The robot was used in a series of workshops involving musicians Jess Fisher (who has a physical disability) and Clare Bhabra and Deirdre Bencsik from Sinfonia Viva. During the workshops, the robot moved and drew marks on paper in response to the real-time sound created by a live musician. The musicians in turn would interpret these movements and marks as notational material and make a sound in response, much like a graphic score.
Professor Vear added: "The three musicians at the centre of this project (Jess, Clare and Deidre) were the true stars as they brought a degree of professionalism and creativity that was beyond my expectations. Their contribution is what has led to these wonderful awards. Being acknowledged by external awards such as these means much more as it clearly indicates that my research has impact beyond academia, which is where I truly value it.”
By creating Jess+ the team wanted to build an embodied-AI system that could facilitate co-creation for an improvising ensemble of disabled and non-disabled musicians, so that the expressive qualities of all musicians could be amplified and bound together in a co-creative system.
Musicians Jess Fisher, and Clare Bhabra and Deirdre Bencsik from Sinfonia Viva (Image credit: BBC Research & Development)
There are significant barriers to music-making for disabled musicians. One such barrier, is that while non-disabled people can make music in many ways, this is less true for disabled musicians, who need new accessible instruments, new creative processes, and new hierarchies of “success” (Drake Music). Another is how a mixed ensemble of disabled and non-disabled musicians might improvise together in such a way that dexterity is not a limiting factor. A further barrier is how disabled musicians can be excluded from the creative process in which a music score is created for them. These barriers can leave creative potentials untapped, setup hierarchical measurements of creative involvement, and limit the potential input of disabled musicians.
In 2023, a performance from the Jess+ team was held at the BBC studios in London for a performance as part of the Bridging Responsible AI Divides (BRAID) launch event. BRAID is a three-year national research programme which aims to bring together UK-based researchers from across the arts and humanities to drive responsible AI innovation, in partnership with the BBC and the Ada Lovelace Institute.
The video of the performance at the BBC can be viewed here.
Story credits
More information is available from Professor Craig Vear in the University of Nottingham’s Department of Music, at craig.vear@nottingham.ac.uk
Notes to editors:
About the University of Nottingham
Ranked 97 in the world and 17th in the UK by the QS World University Rankings, the University of Nottingham is a founding member of Russell Group of research-intensive universities. Studying at the University of Nottingham is a life-changing experience, and we pride ourselves on unlocking the potential of our students. We have a pioneering spirit, expressed in the vision of our founder Sir Jesse Boot, which has seen us lead the way in establishing campuses in China and Malaysia - part of a globally connected network of education, research and industrial engagement.
Nottingham was crowned Sports University of the Year by The Times and Sunday Times Good University Guide 2024 – the third time it has been given the honour since 2018 – and by the Daily Mail University Guide 2024.
The university is among the best universities in the UK for the strength of our research, positioned seventh for research power in the UK according to REF 2021. The birthplace of discoveries such as MRI and ibuprofen, our innovations transform lives and tackle global problems such as sustainable food supplies, ending modern slavery, developing greener transport, and reducing reliance on fossil fuels.
The university is a major employer and industry partner - locally and globally - and our graduates are the third most targeted by the UK's top employers, according to The Graduate Market in 2024 report by High Fliers Research.
We lead the Universities for Nottingham initiative, in partnership with Nottingham Trent University, a pioneering collaboration between the city’s two world-class institutions to improve levels of prosperity, opportunity, sustainability, health and wellbeing for residents in the city and region we are proud to call home.
More news…