journal article
Jul 18, 2021
A Survey of Music Visualization Techniques
Abstract
Music Information Research (MIR) comprises all the research topics involved in modeling and understanding music. Visualizations are frequently adopted to convey better understandings about music pieces, and the association of music with visual elements has been practiced historically and extensively. We investigated papers related to music visualization and organized the proposals into categories according to their most prominent aspects: their input features, the aspects visualized, the InfoVis technique(s) used, if interaction was provided, and users’ evaluations. The MIR and the InfoVis community can benefit by identifying trends and possible new research directions within the music visualization topic.
Topics
No keywords indexed for this article. Browse by subject →
References
101
[1]
Simon Attfield , Gabriella Kazai , and Mounia Lalmas . 2011 . Towards a science of user engagement (position paper) . In Proceedings of the WSDM Workshop on User Modelling for Web Applications. DOI:https://doi.org/978-1-4503-0493-1/11/02 Simon Attfield, Gabriella Kazai, and Mounia Lalmas. 2011. Towards a science of user engagement (position paper). In Proceedings of the WSDM Workshop on User Modelling for Web Applications. DOI:https://doi.org/978-1-4503-0493-1/11/02
[2]
David Baskerville . 2017. Music Business Handbook and Career Guide ( 11 th ed.). SAGE Publications, Inc. David Baskerville. 2017. Music Business Handbook and Career Guide (11th ed.). SAGE Publications, Inc.
[3]
Tony Bergstrom , Karrie Karahalios , and John C . Hart . 2007 . Isochords : Visualizing structure in music. In Proceedings of the Graphics Interface Conference, Christopher G. Healey and Edward Lank (Eds.), Vol. 234 . ACM Press , 297–304. DOI:https://doi.org/10.1145/1268517.1268565 10.1145/1268517.1268565 Tony Bergstrom, Karrie Karahalios, and John C. Hart. 2007. Isochords: Visualizing structure in music. In Proceedings of the Graphics Interface Conference, Christopher G. Healey and Edward Lank (Eds.), Vol. 234. ACM Press, 297–304. DOI:https://doi.org/10.1145/1268517.1268565
[7]
Elaine Chew and Alexandre R. J. François . 2005 . Interactive multi-scale visualizations of tonal evolution in MuSA.RT Opus 2 . Comput. Entertain. 3 , 4 (2005), 1 – 16 . DOI:https://doi.org/10.1145/1095534.1095545 10.1145/1095534.1095545 Elaine Chew and Alexandre R. J. François. 2005. Interactive multi-scale visualizations of tonal evolution in MuSA.RT Opus 2. Comput. Entertain. 3, 4 (2005), 1–16. DOI:https://doi.org/10.1145/1095534.1095545
10.1145/1095534.1095545
[10]
The CAVE: audio visual experience automatic virtual environment
Carolina Cruz-Neira, Daniel J. Sandin, Thomas A. DeFanti et al.
Communications of the ACM
10.1145/129888.129892
[12]
Alan Dix , Janet Finlay , Gregory D. Abowd , and Russel Beale . 2004. Human–Computer Interaction ( 3 rd ed.). Pearson Education Limited . Alan Dix, Janet Finlay, Gregory D. Abowd, and Russel Beale. 2004. Human–Computer Interaction (3rd ed.). Pearson Education Limited.
[13]
[14]
Brian Evans. 1969. The graphic design of musical structure: Scores for listeners : Incantation and mortuos plango vivos voco first 8 partials from bell analysis key centers for 8 sections. 1–6. Electroacoustic Music Studies Network. http://vassar-sound-design.pbworks.com/f/The+Graphic+Design+of+Musical+Structure.pdf. Brian Evans. 1969. The graphic design of musical structure: Scores for listeners : Incantation and mortuos plango vivos voco first 8 partials from bell analysis key centers for 8 sections. 1–6. Electroacoustic Music Studies Network. http://vassar-sound-design.pbworks.com/f/The+Graphic+Design+of+Musical+Structure.pdf.
[16]
[19]
[23]
Andrea Hanke. 2017. Tools for feature extraction: Exploring essentia. Topics in Computer Music RWTH Aachen 1–9. https://hpac.cs.umu.se/teaching/sem-mus-17/Reports/Hanke.pdf. Andrea Hanke. 2017. Tools for feature extraction: Exploring essentia. Topics in Computer Music RWTH Aachen 1–9. https://hpac.cs.umu.se/teaching/sem-mus-17/Reports/Hanke.pdf.
[24]
[25]
[26]
Rumi Hiraga . 2002. Case study: A look of performance expression . In IEEE Visualization (VIS’ 02). 501–504. DOI:https://doi.org/10.1109/VISUAL.2002.1183815 10.1109/VISUAL.2002.1183815 Rumi Hiraga. 2002. Case study: A look of performance expression. In IEEE Visualization (VIS’02). 501–504. DOI:https://doi.org/10.1109/VISUAL.2002.1183815
[30]
Eric J. Humphrey , Juan Pablo Bello , and Yann LeCun . 2012 . Moving beyond feature design: Deep architectures and automatic feature learning in music informatics . In Proceedings of the 13th International Society for Music Information Retrieval Conference (ISMIR’12) . 403–408. Retrieved from http://ismir 2012.ismir.net/event/papers/403-ismir-2012.pdf. Eric J. Humphrey, Juan Pablo Bello, and Yann LeCun. 2012. Moving beyond feature design: Deep architectures and automatic feature learning in music informatics. In Proceedings of the 13th International Society for Music Information Retrieval Conference (ISMIR’12). 403–408. Retrieved from http://ismir2012.ismir.net/event/papers/403-ismir-2012.pdf.
[31]
Eric J. Isaacson . 2005 . What you see is what you get: On visualizing music . In Proceedings of International Symposium in Music Information Retrieval. 389–395 . Retrieved from http://ismir 2005.ismir.net/proceedings/1129.pdf. Eric J. Isaacson. 2005. What you see is what you get: On visualizing music. In Proceedings of International Symposium in Music Information Retrieval. 389–395. Retrieved from http://ismir2005.ismir.net/proceedings/1129.pdf.
[32]
Brian M. Jackson . 2018. The Music Producer’s Survival Guide: Chaos, Creativity, and Career in Independent and Electronic Music ( 2 nd ed.). Routledge . https://www.routledge.com/The-Music-Producers-Survival-Guide-Chaos-Creativity-and-Career-in/Jackson/p/book/9781138697850. Brian M. Jackson. 2018. The Music Producer’s Survival Guide: Chaos, Creativity, and Career in Independent and Electronic Music (2nd ed.). Routledge. https://www.routledge.com/The-Music-Producers-Survival-Guide-Chaos-Creativity-and-Career-in/Jackson/p/book/9781138697850.
[33]
[34]
[38]
Naoko Kosugi. 2010. Misual: Music visualization based on acoustic data. In Proceedings of the 12th International Conference on Information Integration and Web-based Applications and Services Gabriele Kotsis David Taniar Eric Pardede Imad Saleh and Ismail Khalil (Eds.). ACM 609-616. DOI:https://doi.org/10.1145/1967486.1967581 10.1145/1967486.1967581
10.1145/1967486.1967581
[39]
Naoko Kosugi. 2010. Misual: Music visualization based on acoustic data. In Proceedings of the 12th International Conference on Information Integration and Web-based Applications and Services Gabriele Kotsis David Taniar Eric Pardede Imad Saleh and Ismail Khalil (Eds.). ACM 609-616. DOI:https://doi.org/10.1145/1967486.1967581
10.1145/1967486.1967581
[40]
Jonathan Lazar , Jinjuan Feng , and Harry Hochheiser . 2017. Research Methods in Human-computer Interaction , 2 nd Edition. Morgan Kaufmann . Retrieved from http://www.sciencedirect.com/science/book/9780128053904. Jonathan Lazar, Jinjuan Feng, and Harry Hochheiser. 2017. Research Methods in Human-computer Interaction, 2nd Edition. Morgan Kaufmann. Retrieved from http://www.sciencedirect.com/science/book/9780128053904.
[41]
Arto Lehtiniemi and Jukka Holm . 2012. Using animated mood pictures in music recommendation . In Proceedings of the 16th International Conference on Information Visualisation, Ebad Banissi, Stefan Bertschi, Camilla Forsell, Jimmy Johansson, Sarah Kenderdine, Francis T . Marchese, Muhammad Sarfraz, Liz J. Stuart, Anna Ursyn, Theodor G. Wyeld, Hanane Azzag, Mustapha Lebbah, and Gilles Venturini (Eds.). IEEE Computer Society , 143–150. DOI:https://doi.org/10.1109/IV.2012.34 10.1109/IV.2012.34 Arto Lehtiniemi and Jukka Holm. 2012. Using animated mood pictures in music recommendation. In Proceedings of the 16th International Conference on Information Visualisation, Ebad Banissi, Stefan Bertschi, Camilla Forsell, Jimmy Johansson, Sarah Kenderdine, Francis T. Marchese, Muhammad Sarfraz, Liz J. Stuart, Anna Ursyn, Theodor G. Wyeld, Hanane Azzag, Mustapha Lebbah, and Gilles Venturini (Eds.). IEEE Computer Society, 143–150. DOI:https://doi.org/10.1109/IV.2012.34
[42]
James R. Lewis . 1995 . IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. Int. J. Hum.-comput . Interact. 7 , 1 (1995), 57 – 78 . DOI:https://doi.org/10.1080/10447319509526110 10.1080/10447319509526110 James R. Lewis. 1995. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. Int. J. Hum.-comput. Interact. 7, 1 (1995), 57–78. DOI:https://doi.org/10.1080/10447319509526110
[43]
[44]
Hugo Lima , Carlos Santos , and Bianchi Serique Meiguins . 2019. Visualizing the semantics of music . In Proceedings of the 23rd International Conference on Information Visualisation, Ebad Banissi, Anna Ursyn, Mark W . McK. Bannatyne, Nuno Datia, Rita Francese, Muhammad Sarfraz, Theodor G. Wyeld, Fatma Bouali, Gilles Venturini, Hanane Azzag, Mustapha Lebbah, Marjan Trutschl, Urska Cvek, Heimo Müller, Minoru Nakayama, Sebastian Kernbach, Loredana Caruccio, Michele Risi, Ugo Erra, Autilia Vitiello, and Veronica Rossano (Eds.). IEEE , 352–357. DOI:https://doi.org/10.1109/IV.2019.00066 10.1109/IV.2019.00066 Hugo Lima, Carlos Santos, and Bianchi Serique Meiguins. 2019. Visualizing the semantics of music. In Proceedings of the 23rd International Conference on Information Visualisation, Ebad Banissi, Anna Ursyn, Mark W. McK. Bannatyne, Nuno Datia, Rita Francese, Muhammad Sarfraz, Theodor G. Wyeld, Fatma Bouali, Gilles Venturini, Hanane Azzag, Mustapha Lebbah, Marjan Trutschl, Urska Cvek, Heimo Müller, Minoru Nakayama, Sebastian Kernbach, Loredana Caruccio, Michele Risi, Ugo Erra, Autilia Vitiello, and Veronica Rossano (Eds.). IEEE, 352–357. DOI:https://doi.org/10.1109/IV.2019.00066
[46]
[47]
Wakako Machida and Takayuki Itoh. 2011. Lyricon: A Visual music selection interface featuring multiple icons. In Proceedings of the 15th International Conference on Information Visualisation Ebad Banissi Stefan Bertschi Remo Aslak Burkhard Urska Cvek Martin J. Eppler Camilla Forsell Georges G. Grinstein Jimmy Johansson Sarah Kenderdine Francis T. Marchese Carsten Maple Marjan Trutschl Muhammad Sarfraz Liz J. Stuart Anna Ursyn and Theodor G. Wyeld (Eds.). IEEE Computer Society 145-150. DOI:https://doi.org/10.1109/IV.2011.62 10.1109/IV.2011.62
10.1109/iv.2011.62
[48]
Wakako Machida and Takayuki Itoh. 2011. Lyricon: A Visual music selection interface featuring multiple icons. In Proceedings of the 15th International Conference on Information Visualisation Ebad Banissi Stefan Bertschi Remo Aslak Burkhard Urska Cvek Martin J. Eppler Camilla Forsell Georges G. Grinstein Jimmy Johansson Sarah Kenderdine Francis T. Marchese Carsten Maple Marjan Trutschl Muhammad Sarfraz Liz J. Stuart Anna Ursyn and Theodor G. Wyeld (Eds.). IEEE Computer Society 145-150. DOI:https://doi.org/10.1109/IV.2011.62
10.1109/iv.2011.62
[49]
[50]
Showing 50 of 101 references
Metrics
35
Citations
101
References
Details
- Published
- Jul 18, 2021
- Vol/Issue
- 54(7)
- Pages
- 1-29
- License
- View
Authors
Cite This Article
Hugo B. Lima, Carlos G. R. Dos Santos, Bianchi S. Meiguins (2021). A Survey of Music Visualization Techniques. ACM Computing Surveys, 54(7), 1-29. https://doi.org/10.1145/3461835
Related
You May Also Like
A Survey on Bias and Fairness in Machine Learning
Ninareh Mehrabi, Fred Morstatter · 2021
3,466 citations