Prototyping Web instruments with Mosaicode
Resumo
Many HTML 5 features enable you to build audio applications for web browsers, simplifying the distribution of these applications, and turning any computer, mobile, and portable device into a digital musical instrument. Developing such applications is not an easy task for layprogrammers or non-programmers and may require some effort by musicians and artists to encode audio applications based on HTML5 technologies and APIs. In order to simplify this task, this paper presents the Mosaicode, a Visual programming environment that enables the development of Digital Musical Instruments using the visual programming paradigm. Applications can be developed in the Mosaicode from diagrams – blocks, which encapsulate basic programming functions, and connections, to exchange information among the blocks. The Mosaicode, by having the functionality of generating, compiling and executing codes, can be used to quickly prototype musical instruments, and make it easy to use for beginners looking for learn programming and expert developers who need to optimize the construction of musical applications.
Referências
Matthew Wright, Richard Dudas, Sami Khoury, Raymond Wang, and David Zicarelli. Supporting the sound description interchange format in the max/msp environment. In ICMC, 1999.
Antonio Camurri, Shuji Hashimoto, Matteo Ricchetti, Andrea Ricci, Kenji Suzuki, Riccardo Trocca, and Gualtiero Volpe. Eyesweb: Toward gesture and affect recognition in interactive dance and music systems. Computer Music Journal, 24(1):57–69, 2000.
TroikaTronix. Isadora. https://troikatronix.com/. Acessado em: 2018-07-29.
Casey Reas and Ben Fry. Processing: a programming handbook for visual designers and artists. Mit Press, 2007.
Michael Zbyszynski, Mick Grierson, Matthew Yee-King, et al. Rapid prototyping of new instruments with codecircle. In Proceedings of the international conference on new interfaces for musical expression. NIME, 2017.
Bill Manaris, Blake Stevens, and Andrew R Brown. Jython-music: An environment for teaching algorithmic music composition, dynamic coding and musical performativity. Journal of Music, Technology & Education, 9(1):33–56, 2016.
Yann Orlarey, Dominique Fober, and Stéphane Letz. Faust: an efficient functional approach to dsp programming. New Computational Paradigms for Computer Music, 290:14, 2009.
Flávio Luiz Schiavoni, Luan Luiz Gonçalves, and José Mauro da Silva Sandy. Mosaicode and the visual programming of web application for music and multimedia. Revista Música Hodie, 18(1):132–146.
Gary Bradski and Adrian Kaehler. Opencv. Dr. Dobb’s journal of software tools, 3, 2000.
Ross Bencina and Phil Burk. Portaudio-an open source cross platform audio api. In ICMC, 2001.
Hongchan Choi and Jonathan Berger. Waax: Web audio api extension. In NIME, pages 499–502, 2013.
David B Ramsay and Joseph A Paradiso. Grouploop: a collaborative, network-enabled audio feedback instrument. In NIME, pages 251–254, 2015.
John Congote, Alvaro Segura, Luis Kabongo, Aitor Moreno, Jorge Posada, and Oscar Ruiz. Interactive visualization of volumetric data with webgl in real-time. In Proceedings of the 16th International Conference on 3D Web Technology, pages 137–146. ACM, 2011.
Flávio Luiz Schiavoni Schiavoni, Thiago Thadeu Souto Cardoso, André Lucas Nascimento Gomes, Frederico Ribeiro Resende, and José Mauro da Silva Sandy. Utilização do ambiente mosaicode como ferramenta de apoio para o ensino de computação musical. In Proceedings of 8th workshop on ubiquitous music (UbiMus), 2018.
Christopher Dobrian and Daniel Koppelman. The’e’in nime: musical expression with new computer interfaces. In Proceedings of the 2006 conference on New interfaces for musical expression, pages 277–282. IRCAM—Centre Pompidou, 2006.
