Integração de DAW com Infraestruturas Remotas de Processamento de Áudio

  • Carlos E. C. F. Batista UFPB
  • Gabriel B. F. Andrade UFPB
  • Geovana M. S. Lima UFPB
  • Caio M. C. Guedes Music.AI

Resumo


This article introduces Orchestrator Pad, an open-source audio processing plug-in built using JUCE, designed to facilitate access to the capabilities of the Music.AI platform. This service offers advanced features such as stem separation, automatic mastering, and various other forms of audio manipulation through a REST API. It supports the creation of custom workflows that integrate its services, seamlessly invoked by the plug-in using a C++ wrapper library developed in parallel. After remote audio processing, the resulting files can be played within any compatible DAW through the plug-in. This paper details the plug-in's architecture and core functionalities and discusses the advantages of incorporating AI-driven workflows into music production environments. The project repository provides the necessary code and configuration for building the Orchestrator Pad plug-in as either a standalone application or a VST plug-in.

Palavras-chave: Plug-in VST, Processamento de áudio remoto, Biblioteca C, Ferramentas de código aberto

Referências

PIRKLE, Will. Designing audio effect plugins in C++: for AAX, AU, and VST3 with DSP theory. Routledge, 2019.

Music.AI: Advanced AI Audio Processing. [link] Acessado: Julho de 2024.

BANDLAB. [link] Acessado: Julho de 2024.

LALAL.AI. Tools and API. [link] Acessado: Julho de 2024.

JUCE: The Cross-Platform C++ Framework. [link] Acessado: Julho de 2024.

CMake: Cross-Platform Make. [link] Acessado: Julho de 2024.

CRAWL, Kevin. cpr - C++ Requests: Curl for People, a spiritual port of Python Requests. [link] Acessado: Julho de 2024.

LOHMANN, Niels. JSON for Modern C++. [link] Acessado: Julho de 2024.

SONICAPI. Documentação. [link] Acessado: Julho de 2024.

KRISP.AI. Documentação do SDK. [link] Acessado: Julho de 2024.

AUDIOGRIDDER. AudioGridder. [link] Acessado: Julho de 2024.

REN, Shihong; LETZ, Stephane; ORLAREY, Yann; MICHON, Romain; FOBER, Dominique et al. Using Faust DSL to Develop Custom, Sample Accurate DSP Code and Audio Plugins for the Web Browser. Journal of the Audio Engineering Society, v. 68, n. 10, p. 703-716, 2020.

GARCIA, Hugo Flores et al. HARP: Bringing Deep Learning to the DAW with Hosted, Asynchronous, Remote Processing. 37th Conference on Neural Information Processing Systems (NeurIPS 2023)
Publicado
14/10/2024
BATISTA, Carlos E. C. F.; ANDRADE, Gabriel B. F. ; LIMA, Geovana M. S. ; GUEDES, Caio M. C.. Integração de DAW com Infraestruturas Remotas de Processamento de Áudio. In: WORKSHOP DE FERRAMENTAS E APLICAÇÕES - SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 30. , 2024, Juiz de Fora/MG. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2024 . p. 91-94. ISSN 2596-1683. DOI: https://doi.org/10.5753/webmedia_estendido.2024.243690.