Musical Information Visualization System

Abstract

 The visualisation systems are spread widely as personal computer’s software. The system, that are processing audio data are presented in this article. The system visualizes the ratio of spectrum amplitudes and has fixed frequency binding to colours. The technology of audio signals processing by the device and components of the device were considered. For the increasing information processing speed was used 32bit controller and graphic equalizer with seven passbands. Music visualization it is function, that are spread widely in mediaplayer’s software, on a different operation systems. This function shows animated images that are depends on music signal. Images are usually reproduced in the real time mode and synchronized with a played audio-track. Music and visualization are merges in the different kind of art: opera, ballett, music drama or movies. Dependencies of auditory and visual sensations are used for increasing the emotional perseption for ordinary listeners . In the systems, that are currently being actively promoted, are used several tools for personal computers, such as: After Effects – The Audio Spectrum Effect, VSDC Video Editor Free – Audio Spectrum Visualizer, Magic Music Visuals. The software, that are mentioned above, has a one disadvantage: the using of streaming video is not possible with the simultaneous receipt of audio and requires processing and rendering of the resulting video series. The purpose of the work is to determine the features of spectral analysis of music information and taking into account real-time data processing. Propose a variant of the music information visualization system, which displays the spectral composition of music and the amplitude of individual harmonics, and filling the LED-matrix with the appropriate color depending on the amplitude of the audio signal, with the possibility of wireless signal transmission from the music source to the visual effects device. The technology of frequency analysis of the spectrum with estimation of amplitude of spectrum’s components of the musical data, that is arriving on the device is chosen for this project. The method is based on the analysis of the spectrum in the selected frequency bands, which in turn simplifies the function of finding maxima at different frequencies. The proposed variant of the musical information visualization system provides display on the LED-matrix of colors that correspond to the frequencies spectrum’s components in the musical composition. Moreover, the number of involved LEDs is proportional to the ratio of the amplitudes of the signal’s frequency components. The desired result is achieved by using a Fast Fourier Transform and selecting Khan or Heming windows for providing a better analysis results of the signal spectrum. The amplitudes of the individual components of the spectrum are estimated additionally and each frequency band has its own color. The work of the system is to analyze the components of the spectrum and frequency of musical information. This information affects the display of colors on the LED matrix. The using of a 32-bit microcontroller provides sufficient speed of audio signal processing with minimal delays.  For the increasing the accuracy and speed up the frequency analysis, the sound range is divided into seven bands. For this purpose was used seven-band graphic equalizer MSGEQ7. Music information is transmitted to the system via Bluetooth, which greatly simplifies the selection and connection of the music data source. 

Keywords

References

1. M. Vieira, “Interactive Music Visualization - Implementation, Realization, and Evaluation,” Master Dissertation, Universidade da Madeira, Funchal, Madeira, Portugal, 2012, Sep. 2012, 115 p [Online] Available: https://core.ac.uk/download/pdf/62478193.pdf
2. 11 Best Music Visualization Tools (Free) Accessed on: Mar. 29, 2021. [Online]. Available: https://inspirationfeed.com/musicvisualizers/
3. Florian Ramian – Implementation of Real-Time Spectrum Analysis at the Wayback Machine, p. 6, March, 2015, [Online]. Available: https://scdn.rohde
4. schwarz.com/ur/pws/dl_downloads/dl_application/application_notes/1ef77/1EF77_3e_Real-time_Spectrum_Analysis.pdf
5. Frigo, Matteo; Johnson, Steven G. "The Design and Implementation of FFTW3" (PDF). Proceedings of the IEEE. 93 (2): 216–231, 2005. [Online]. Available: http://fftw.org/fftwpaper-ieee.pdf. DOI: 10.1109/JPROC.2004.840301
6. V. S. Yatskovsʹkyy, D. M. Bruslik, "Teoriya ta metody obroblennya syhnaliv [Theory and methods of signal processing]" Electronics and control systems. vol. 31, no. 1, 2012. [Online]. Available: http://jrnl.nau.edu.ua/index.php/ESU/article/viewFile/924/906
7. J. Smith, "Mathematics of the Discrete Fourier Transform (DFT) with Audio Applications", Second Edition, 2007, ISBN 978-0-9745607-4-8.
8. A. B. Ananʹyev, D. V. Prosvirov, "Spektralʹne porivnyannya muzychnykh tvoriv" Akustychnyy visnyk. 2004. vol. 7, no. 3. pp. 7-13. [Online]. Available: http://hydromech.org.ua/content/pdf/av/av-07-3(07-13).pdf
9. MSGEQ7 Datasheet (PDF) - Mixed Signal Integration Accessed on: Mar. 26, 2021. [Online]. Available: https://pdf1.alldatasheet.com/datasheet
10. pdf/view/1132447/MSI/MSGEQ7.html
11. Bluetooth Audio Receiver Board Bluetooth 5.0 mp3 Lossless decoder Board Wireless Stereo Music Module XY-WRBT Accessed on: Mar. 30, 2021. [Online]. Available: https://www.amazon.com/MADONG-Bluetooth-Receiver Lossless-Wireless/dp/B086SW1NQ1
12. ESP32. Technical Reference Manual. Accessed on: Mar. 25, 2021. [Online]. Available: https://www.espressif.com/sites/de fault/files/documentation/esp32_technical_reference_manual_en.pdf

License

Copyright (c) 2026 Роман О. Ярошенко (Автор)