Keywords
Finite state machine with datapath
Pure data
Max/MSP
Paradigm shift
Sound synthesis control
How to Cite
Abstract
Music-domain visual programming languages (VPLs) have shown to be Turing complete. However, the common lack of built-in flow control structures can obstruct using VPLs implementing general-purpose algorithms, which harms the direct use of algorithms and algorithm theory in art creation processes using VPLs. In this article, we show how to systematically implement general-purpose algorithms in music-domain visual languages by using the Finite State Machines with Datapath computation model. The results expose a finite state machine and a set of internal state variables that walk paths whose speed can be controlled using a metronome ticks and whose path depends on the initial conditions of the algorithm. These elements can be further mapped to music elements according to the musician's intentions. We demonstrate this technique by implementing Euclid's Greatest Common Divider algorithm and using it to control high-level music elements in an implementation of Terry Riley's In C, and to control audio synthesis parameters in a FM synthesizer.
References
M Puckette. Pure data. In Proceedings, International Computer Music Confer- ence, 1996.
M. Puckette. Combining event and signal processing in the max graphical pro- gramming environment. Computer Music Journal, 15(3):68–77, 1991.
Mark Danks. The graphics environment for max. In Proceedings of the Interna- tional Computer Music Conference, 1996.
Vincent J. Manzo. Max/MSP/Jitter for music: A practical guide to developing interactive music systems for education and more. Oxford University Press, 2016.
M. Puckette, T. Apel, and D. Zicarelli. Real-time audio analysis tools for pd and
msp. In Proceedings, International Computer Music Conference, 1998.
Baptiste Caramiaux, Alessandro Altavilla, Scott G. Pobiner, and Atau Tanaka. Form follows sound. In Proceedings of the 33rd Annual ACM Conference on
Human Factors in Computing Systems - CHI 15. ACM Press, 2015.
Daniele Ghisi and Andrea Agostini. Extending bach: A family of libraries for real-time computer-assisted composition in max. Journal of New Music Research,
(1):34–53, 2017.
Stephen A. Hedges. Dice music in the eighteenth century. Music & Letters,
(2):180–187, 1978.
John Cage. Silence : lectures and writings, chapter Composition as Process I:
Changes, pages 18–34. Wesleyan University Press, 1951.
Iannis Xenakis. Formalized Music: Thoughts in Mathematics and Composition.
Pendragon, 1963.
Roger T. Dean and Jamie Forth. Towards a deep improviser: a prototype deep
learning post-tonal free music generator. Neural Computing and Applications,
(4):969–979, oct 2018.
Jean-Pierre Briot and Fran ̧cois Pachet. Deep learning for music generation: chal-
lenges and directions. Neural Computing and Applications, 32(4):981–993, oct
Curtis Roads and Paul Wieneke. Grammars as representations for music. Com-
puter Music Journal, 3(1):48, mar 1979.
Fr ́ed ́erick Duhautpas, Renaud Meric, and Makis Solomos. Expressiveness and
meaning in the electroacoustic music of iannis xenakis. the case of la l ́egende d’eer. In Proceedings of the Electroacoustic Music Studies Network Conference Meaning and Meaningfulness in Electroacoustic Music, 2012.
Dimitri Bouche, J ́erˆome Nika, Alex Chechile, and Jean Bresson. Computer-aided composition of musical processes. Journal of New Music Research, 46(1):3–14, 2017.
Paul Vickers. Sonification and Music, Music and Sonification. In The Routledge Companion to Sounding Art. Routledge, 201
Paul Vickers and James L. Alty. CAITLIN: A Musical Program Auralisation Tool to Assist Novice Programmers with Debugging. In Proceedings of ICAD 96 International Conference of Auditory Display, 1996.
Paul Vickers and James L. Alty. When bugs sing. Interacting with Computers, 14(6):793–819, December 2002. Publisher: Oxford Academic.
D.H. Jameson. Building real-time music tools visually with Sonnet. In Proceedings Real-Time Technology and Applications, pages 11–18, June 1996.
Andy M. Sarrof, Phillip Hermans, and Sergey Bratus. SOS: Sonify Your Oper- ating System. In Proc. of the 10th International Symposium on Computer Music Multidisciplinary Research, Marseille, France, 2013.
Alexis Kirke and Eduardo Miranda. Pulsed Melodic Affective Processing: Musical structures for increasing transparency in emotional computation. SIMULATION, 90(5):606–622, May 2014. Publisher: SAGE Publications Ltd STM.
R. Camposano and W. Rosenstiel. Synthesizing circuits from behavioural descrip- tions. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 8(2):171–180, Feb 1989.
Frank Vahid. Digital Design with RTL Design, Verilog and VHDL. Wiley Pub- lishing, 2nd edition, 2010.
Robert Kraemer and Cornelius Poepel. On transformations between paradigms in audio programming. In Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion, AM’18, pages 23:1–23:4, New York, NY, USA, 2018. ACM.
Robert Carl. Terry Riley’s in C. Oxford University Press, 2009.
John Chowning. The synthesis of complex audio spectra by means of frequency modulation. Journal of the Audio Engineering Society, pages J. Audio Eng. Soc. 19 21 (7), 526–534., 1973.
W. James. The Principles of Psychology. MacMillan, 1980.
Szelag E., Kanabus M., Kolodziejczyk I., Kowalska J., and Szuchnik J. Individual
differences in temporal information processing in humans. Acta Neurobiol, 64:349–
, 2004.
Marc Wittmann. Moments in time. Frontiers in integrative neuroscience, 5(66),
Eibl-Eibesfeldt Feldhu ̈tter I, Schleidt M. Moving in the beat of seconds: analysis
of the time structure of human action. Ethol Sociobiol, 11:1–10, 1990.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2024 NICS Reports