Creatability is a set of experiments from Google made in collaboration with creators and allies in the accessibility community.

There are over 56 million Americans living with a disability, and many of them don’t use digital tools because the tools available don’t cater to them. Together with Google Creative Lab, we explored how various creative tools such as drawing, music, and more can be made more accessible through web and AI technology.

Whether you’re a teacher, student, researcher, or artist, you can use these experiments in the way that works best for you. Through a diverse set of inputs, from mouse, keyboard, body, wrist, nose, and voice, these seven experiments allow you to make music by moving your face, draw using sight or sound, experience music visually, and much more.

Creativity made more accessible

This experiment lets you play a musical keyboard in different ways. You can use your mouse and keyboard. Or, turn on your webcam and track a point on your body, like your nose. You can customize the scale and number of notes on your screen. And you can control other instruments using MIDI.

Keyboard

Each experiment contains a collapsable left menu that contains specific controls unique to each experiment. The menu contains input fields, radio buttons, sliders, drop-downs, etc to customize each experience. Users have the ability to scroll through the menu or simply tab through each control via a Switch or a similar accessibility controller.

Left menu

Seven experiments total and counting

These other six experiments let you combine speech and music by setting words to your own melody, make music using simple shapes on your screen, experience music or sound, draw using both sight and sound, trigger a musical sampler via various body parts, and turn your body movements into sound.

These collaborations are only just the beginning. By sharing open-source code and various components we hope that it creates an open invitation to the community of developers to engage, interact, and build upon what we started here.