Announcing the Winner of the SSUP's "Hack in a Box" Hackathon Series
The Sensing Solution University Collaboration Program (SSUP) is thrilled to announce the winner of our recent "Hack in a Box" hackathon series, the team “Humming Robot” from the University of Maryland. This initiative, launched in collaboration with Hackster.io, aimed to encourage universities to develop innovative solutions using Sony Semiconductor Solutions' sensing technologies.
The Humming Robot captures the essence of what's possible when curious minds converge with powerful tools like the Spresense board. By humming a melody, users can witness the robot interpret their input and reproduce it on a recorder in real-time.
![](https://wpp-cdn.developer.sony.com/dp-images/image/7x6/2vkl4atWlo/uploads/sites/19/2024/07/Picture1.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJfX2lzaW1hZ2UiOnRydWUsInVybCI6Ii8ydmtsNGF0V2xvL3VwbG9hZHMvc2l0ZXMvMTkvMjAyNC8wNy9QaWN0dXJlMS5qcGciLCJhbHQiOiIiLCJ3aWR0aCI6ODEzLCJoZWlnaHQiOjYxMCwiZm9jdXMiOnsieCI6MC41LCJ5IjowLjV9LCJyYXRpbyI6MS4zMzI3ODY4ODUyNDU5MDE3LCJfX3B1YmxpYyI6dHJ1ZSwiYWxsb3dlZFNpemVzIjpbIjEyMDB4QVVUTyIsIjEwMHg2NSIsIjEwMHhBVVRPIiwiMTEweDgyIiwiNzUweEFVVE8iLCIxMDAweEFVVE8iLCIxMjAweEFVVE8iLCIxMjAweDgwMCIsIjE5MjB4QVVUTyIsIjYwMHhBVVRPIiwiMTkyMHgxMDAwIiwiMjAweDE1MCIsIjIyNXgxNzAiLCIyMjV4QVVUTyIsIjIyOXgzMDAiLCIzNjh4QVVUTyIsIjQ1MHgzNDAiLCI1MDB4QVVUTyIsIjc1MHg1MDAiLCI3eDEwIiwiN3gxMSIsIjd4MTIiLCI3eDE2IiwiN3gzIiwiN3g0IiwiN3g1IiwiN3g2IiwiN3g3IiwiN3g4IiwiN3g5IiwiMXgxIl0sImltYWdlVmVyc2lvbiI6InY2IiwiZXhwIjoxOTA0Njg4MDAwMDAwfQ.VOQGTsECZKigrbqilBzdyFta5Hmnq_nl3pO_S6Z62vM)
SPRESENSE: The Power Behind the Melody
At the heart of this project lies Sony's Spresense microcontroller board. This compact, low-power board computer, equipped with multi-core processors, proved to be the ideal platform for the Humming Robot. Here's how the team made the most of its capabilities:
- Audio Processing: Spresense's high-resolution audio codec and computing power enabled real-time audio capture, analysis, and note detection, the foundation of the robot's musical interpretation.
- Sensor Integration: The team integrated a MEMS microphone with the microcontroller board, enabling it to capture and process humming input with accuracy.
- Robotic Control: The Spresense versatility allowed the team to control the air pump and solenoids that manipulated the recorder, bringing the hummed melody to life.
![](https://wpp-cdn.developer.sony.com/dp-images/image/7x5/2vkl4atWlo/uploads/sites/19/2024/07/Picture2.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJfX2lzaW1hZ2UiOnRydWUsInVybCI6Ii8ydmtsNGF0V2xvL3VwbG9hZHMvc2l0ZXMvMTkvMjAyNC8wNy9QaWN0dXJlMi5qcGciLCJhbHQiOiIiLCJ3aWR0aCI6Nzg0LCJoZWlnaHQiOjU1NSwiZm9jdXMiOnsieCI6MC41LCJ5IjowLjV9LCJyYXRpbyI6MS40MTI2MTI2MTI2MTI2MTI2LCJfX3B1YmxpYyI6dHJ1ZSwiYWxsb3dlZFNpemVzIjpbIjEyMDB4QVVUTyIsIjEwMHg2NSIsIjEwMHhBVVRPIiwiMTEweDgyIiwiNzUweEFVVE8iLCIxMDAweEFVVE8iLCIxMjAweEFVVE8iLCIxMjAweDgwMCIsIjE5MjB4QVVUTyIsIjYwMHhBVVRPIiwiMTkyMHgxMDAwIiwiMjAweDE1MCIsIjIyNXgxNzAiLCIyMjV4QVVUTyIsIjIyOXgzMDAiLCIzNjh4QVVUTyIsIjQ1MHgzNDAiLCI1MDB4QVVUTyIsIjc1MHg1MDAiLCI3eDEwIiwiN3gxMSIsIjd4MTIiLCI3eDE2IiwiN3gzIiwiN3g0IiwiN3g1IiwiN3g2IiwiN3g3IiwiN3g4IiwiN3g5IiwiMXgxIl0sImltYWdlVmVyc2lvbiI6InY2IiwiZXhwIjoxOTA0Njg4MDAwMDAwfQ.fenQEG-jkR1U28w0HC_fSH9qDRx26TUpYv-vNjFNIIQ)
The Potential Applications
The Humming Robot has a wide range of potential applications, including:
- Music Education: The robot can provide a fun and engaging way for people to learn and explore music.
- Assistive Technology: The robot could be adapted to allow people with disabilities to express themselves musically.
- Live Performances: The robot could be incorporated into live music performances.
![](https://wpp-cdn.developer.sony.com/dp-images/image/7x6/2vkl4atWlo/uploads/sites/19/2024/07/Picture3.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJfX2lzaW1hZ2UiOnRydWUsInVybCI6Ii8ydmtsNGF0V2xvL3VwbG9hZHMvc2l0ZXMvMTkvMjAyNC8wNy9QaWN0dXJlMy5qcGciLCJhbHQiOiIiLCJ3aWR0aCI6NTEzLCJoZWlnaHQiOjM5MSwiZm9jdXMiOnsieCI6MC41LCJ5IjowLjV9LCJyYXRpbyI6MS4zMTIwMjA0NjAzNTgwNTYzLCJfX3B1YmxpYyI6dHJ1ZSwiYWxsb3dlZFNpemVzIjpbIjEyMDB4QVVUTyIsIjEwMHg2NSIsIjEwMHhBVVRPIiwiMTEweDgyIiwiNzUweEFVVE8iLCIxMDAweEFVVE8iLCIxMjAweEFVVE8iLCIxMjAweDgwMCIsIjE5MjB4QVVUTyIsIjYwMHhBVVRPIiwiMTkyMHgxMDAwIiwiMjAweDE1MCIsIjIyNXgxNzAiLCIyMjV4QVVUTyIsIjIyOXgzMDAiLCIzNjh4QVVUTyIsIjQ1MHgzNDAiLCI1MDB4QVVUTyIsIjc1MHg1MDAiLCI3eDEwIiwiN3gxMSIsIjd4MTIiLCI3eDE2IiwiN3gzIiwiN3g0IiwiN3g1IiwiN3g2IiwiN3g3IiwiN3g4IiwiN3g5IiwiMXgxIl0sImltYWdlVmVyc2lvbiI6InY2IiwiZXhwIjoxOTA0Njg4MDAwMDAwfQ.N_Vl7Vj4KqN-xj31h1ypt6O9RZ4ztaVgMxgcAMjiNDU)
Taking home the grand prize, the winning team is "elated to have won this competition," and they thank their professor, Dr. Huaishu Peng, makerspace manager Gordon Crago, and Sony for providing the essential Spresense board”.
We're incredibly proud of the University of Maryland team and all the participants who embraced the challenge of the Sony-Hackster University Hackathon Series.
For a closer look at the Humming Robot's technology in action, watch the video below.
More information: