FINGERTIP RHYTHM
HARDWARE
ARDUINO UNO
DESCRIPTION
We want to use Arduino to realize an electronic music light art device, compared with the traditional DJ, this set uses ultrasonic sensors to control the synchronization of music, reducing the complexity of equipment in traditional playing equipment. This device is also equipped with lights that match the rhythm and pitch of the music, and the player can play his own music on the console and create a light show according to his own playing style during the use.
YEAR
MONTH
PLATFORM
2021
December
Arduino CC
PRE-RESEARCH
We first brainstormed and researched existing musical art installations, and then confirmed relevant aural concepts as well as visual concepts.
01 Brain Storm
Analysis of the market
Market size for music products enters the fast lane of growth; emphasis on integrating innovation with technology
02 Background
Find the problem
Traditional and archaic forms of interactive music products on the market: pianos, headphones, phonographs
Look in opportunity
We are thinking of new forms of expression and interaction to meet the needs of young people who love to have fun
2015-2022 China Music Industry Revenue (RMB billion)
PRODUCT REASERACH
Mastercard masks - sensing ambient speech sounds and changing lights
2.Control of each speaker to trigger at a specific time difference, with the ultrasound reaching the focal point simultaneously
3.The ultrasound at the focal point has enough force to create an indentation in the skin, and the touch sensor in the hand detects the vibrations for precise positioning up to a range of 70cm.
1.Creation of multiple small ultrasonic loudspeakers into arrays.
Highlights
Mastercard masks to connect and interact with others in a social environment
1.Creation of multiple small ultrasonic loudspeakers into arrays.
1.Music recognition
2.Lighting control technology
Discover how aerial haptics can enhance all the versatility needed for innovative products and experiences, creating a virtual sense of control over tactile sensations
Ultraleap ultrasonic non-contact haptic technology
Tech
Do
STRATOS Inspire haptic module to add a contactless experience to existing devices
Combining sound and light, multi-sensory interaction for a richer experience
DESIGN INTRODUCTION
01 Design Goal
We have designed a new trendy music interaction device that allows the user to create music without the use of buttons, combined with lighting, to give the user a new type of music entertainment production experience.
02 Interaction methods
One hand controls the music generating device, when the hand touches a position on the device, the device emits a corresponding sound tone and at the same time the lights on the device change in response to the music. At the same time the other hand controls the coloured light changes.
Ultrasonic sensors x 6
1. We will use the Arduino uno board to connect 6 ultrasonic sensors to detect the hand position, according to the hand position output corresponding signal, at the same time 6 ultrasonic sensor signal respectively corresponding to 6 different music tone, ultrasonic signal into the computer, the computer program （Max 8）to play the corresponding music.
2. The lighting of the device is due to the latency of the Arduino uno board, using an LED matrix that has already been programmed.
3. A capacitive screen with pressure detection and a processing programme are used to achieve a paddle light effect.
Software
8x8 RGB LED matrix x 1
Arduino UNO x 2
Processing
Technical realisation
Hardware
Capacitive screens x 1
Max 8
DESIGN PROCESS
We use laser cutting for the design of our products
Product appearance production
SPI (Serial Peripheral Interface) is a serial communication protocol. SPI has a full duplex connection, which means that data can be sent and received at the same time. That is, the master device can send data to the slave device and the slave device can send data to the master device at the same time. SPI is synchronous serial communication meaning that communication needs to be clocked. SPI uses four lines for master/slave communication. SPI can only have one master and can have multiple slaves. The master device is usually a microcontroller and the slaves can be microcontrollers, sensors, ADCs, DACs, LCDs etc.
This product uses the Arduino Uno and does not have enough interfaces to supply sensors, so the master and slave boards need to be processed independently and the complete logic of the lower unit is completed by sending the slave data to the main board via SPI.To simplify the implementation logic, we define the data sent by the lower computer as hexadecimal strings 1-12, corresponding to the six button presses and releases. At the same time, we use a keyboard mapping to control the music board software. The mapping is as follows: the hexadecimal strings 1-12 of the lower unit correspond to the press and release actions of the upper unit's keyboard letters A-F.
Slave
Arduino
Master
Realisation of ultrasonic signal conversion
Due to the limitations of the interface, two arduino uno boards （Master+Slave）were chosen to wire the six ultrasonic sensors.
Parallel ultrasonic sensors + multi-threaded processing approximation to simulate non-blocking key functions
The product is based on the parallel connection of multiple ultrasonic sensors combined with the use of multi-threaded processing to approximate a non-blocking button press function. Specifically, each ultrasound is set to a distance threshold, below which a signal is sent and above which another signal is sent to model the button press and release action. Secondly, to ensure that multiple ultrasound waves process data independently, the Metro library is used to implement the multi-threaded functionality.
Notice：
Since six ultrasonic sensors require 12 analogue interfaces, if an Arduino uno board is to be used, it can only take the form of two Uno boards. Here it could take the form of an Arduino Leonardo board, which has exactly 12 analogue interfaces.
The interactive music programming software, which allows you to program sounds, design effects and process sound effects in a graphical language and in the form of blueprints, fits well with our functional requirements, so MAX 8 was chosen for the development of the sound part of our project.
MAX 8
Blueprint presentation of the final result
PROTOTYPE TESETING
Note: p5js is used - processing
Processing
We use processing and capacitive screens to achieve the effect of the computer screen lights changing when a finger is pressed on the capacitive screen.
FINAL DISPLAY
