Deep Learning Techniques for Music Generation

Deep Learning Techniques for Music Generation
Author: Jean-Pierre Briot
Publisher: Springer
Total Pages: 284
Release: 2019-11-08
Genre: Computers
ISBN: 3319701630

This book is a survey and analysis of how deep learning can be used to generate musical content. The authors offer a comprehensive presentation of the foundations of deep learning techniques for music generation. They also develop a conceptual framework used to classify and analyze various types of architecture, encoding models, generation strategies, and ways to control the generation. The five dimensions of this framework are: objective (the kind of musical content to be generated, e.g., melody, accompaniment); representation (the musical elements to be considered and how to encode them, e.g., chord, silence, piano roll, one-hot encoding); architecture (the structure organizing neurons, their connexions, and the flow of their activations, e.g., feedforward, recurrent, variational autoencoder); challenge (the desired properties and issues, e.g., variability, incrementality, adaptability); and strategy (the way to model and control the process of generation, e.g., single-step feedforward, iterative feedforward, decoder feedforward, sampling). To illustrate the possible design decisions and to allow comparison and correlation analysis they analyze and classify more than 40 systems, and they discuss important open challenges such as interactivity, originality, and structure. The authors have extensive knowledge and experience in all related research, technical, performance, and business aspects. The book is suitable for students, practitioners, and researchers in the artificial intelligence, machine learning, and music creation domains. The reader does not require any prior knowledge about artificial neural networks, deep learning, or computer music. The text is fully supported with a comprehensive table of acronyms, bibliography, glossary, and index, and supplementary material is available from the authors' website.

Hands-On Music Generation with Magenta

Hands-On Music Generation with Magenta
Author: Alexandre DuBreuil
Publisher: Packt Publishing Ltd
Total Pages: 348
Release: 2020-01-31
Genre: Mathematics
ISBN: 1838825762

Design and use machine learning models for music generation using Magenta and make them interact with existing music creation tools Key FeaturesLearn how machine learning, deep learning, and reinforcement learning are used in music generationGenerate new content by manipulating the source data using Magenta utilities, and train machine learning models with itExplore various Magenta projects such as Magenta Studio, MusicVAE, and NSynthBook Description The importance of machine learning (ML) in art is growing at a rapid pace due to recent advancements in the field, and Magenta is at the forefront of this innovation. With this book, you’ll follow a hands-on approach to using ML models for music generation, learning how to integrate them into an existing music production workflow. Complete with practical examples and explanations of the theoretical background required to understand the underlying technologies, this book is the perfect starting point to begin exploring music generation. The book will help you learn how to use the models in Magenta for generating percussion sequences, monophonic and polyphonic melodies in MIDI, and instrument sounds in raw audio. Through practical examples and in-depth explanations, you’ll understand ML models such as RNNs, VAEs, and GANs. Using this knowledge, you’ll create and train your own models for advanced music generation use cases, along with preparing new datasets. Finally, you’ll get to grips with integrating Magenta with other technologies, such as digital audio workstations (DAWs), and using Magenta.js to distribute music generation apps in the browser. By the end of this book, you'll be well-versed with Magenta and have developed the skills you need to use ML models for music generation in your own style. What you will learnUse RNN models in Magenta to generate MIDI percussion, and monophonic and polyphonic sequencesUse WaveNet and GAN models to generate instrument notes in the form of raw audioEmploy Variational Autoencoder models like MusicVAE and GrooVAE to sample, interpolate, and humanize existing sequencesPrepare and create your dataset on specific styles and instrumentsTrain your network on your personal datasets and fix problems when training networksApply MIDI to synchronize Magenta with existing music production tools like DAWsWho this book is for This book is for technically inclined artists and musically inclined computer scientists. Readers who want to get hands-on with building generative music applications that use deep learning will also find this book useful. Although prior musical or technical competence is not required, basic knowledge of the Python programming language is assumed.

Machine Learning and Music Generation

Machine Learning and Music Generation
Author: José M. Iñesta
Publisher: Routledge
Total Pages: 112
Release: 2018-10-16
Genre: Mathematics
ISBN: 1351234536

Computational approaches to music composition and style imitation have engaged musicians, music scholars, and computer scientists since the early days of computing. Music generation research has generally employed one of two strategies: knowledge-based methods that model style through explicitly formalized rules, and data mining methods that apply machine learning to induce statistical models of musical style. The five chapters in this book illustrate the range of tasks and design choices in current music generation research applying machine learning techniques and highlighting recurring research issues such as training data, music representation, candidate generation, and evaluation. The contributions focus on different aspects of modeling and generating music, including melody, chord sequences, ornamentation, and dynamics. Models are induced from audio data or symbolic data. This book was originally published as a special issue of the Journal of Mathematics and Music.

Controllable Monophonic Music Generation Via Latent Variable Disentanglement

Controllable Monophonic Music Generation Via Latent Variable Disentanglement
Author: Ke Chen
Publisher:
Total Pages: 52
Release: 2021
Genre:
ISBN:

Automatic music generation is an attractive topic in the interdisciplinary field of music and computer science. The appearance of deep learning technique has brought in new methodologies to this topic. Diving to this topic inspires us to understand how computers process music elements from notes, beats to melodies, structures and dynamics. This further helps humans to better understand the music if we could afterwards extract creation mechanisms from machines. In the generation problem, how to make human interact with the computer is an interesting problem. Drawing an analogy with automatic image completion systems, we propose Music SketchNet, a neural network framework that allows users to specify partial musical ideas guiding monophonic music generation. We focus on generating the missing measures in incomplete monophonic musical pieces, conditioned on surrounding context, and optionally guided by user-specified pitch and rhythm snippets. First, we introduce SketchVAE, a novel variational autoencoder that explicitly factorizes rhythm and pitch contour to form the basis of our proposed model. Then we introduce two discriminative architectures, SketchInpainter and SketchConnector, that in conjunction perform the guided music completion, filling in representations for the missing measures conditioned on surrounding context and user-specified snippets. In the experiment, we first evaluate the SketchVAE on three standard datasets from different genres including folk, classic and pop songs. Then we evaluate the whole SketchNet on a standard dataset of Irish folk music and compare with models from recent works. When used for music completion, our approach outperforms the state-of-the-art both in terms of objective metrics and subjective listening tests. Finally, we demonstrate that our model can successfully incorporate user-specified snippets during the generation process.

Deep and Shallow

Deep and Shallow
Author: Shlomo Dubnov
Publisher: CRC Press
Total Pages: 430
Release: 2023-12-08
Genre: Computers
ISBN: 1000984532

Providing an essential and unique bridge between the theories of signal processing, machine learning, and artificial intelligence (AI) in music, this book provides a holistic overview of foundational ideas in music, from the physical and mathematical properties of sound to symbolic representations. Combining signals and language models in one place, this book explores how sound may be represented and manipulated by computer systems, and how our devices may come to recognize particular sonic patterns as musically meaningful or creative through the lens of information theory. Introducing popular fundamental ideas in AI at a comfortable pace, more complex discussions around implementations and implications in musical creativity are gradually incorporated as the book progresses. Each chapter is accompanied by guided programming activities designed to familiarize readers with practical implications of discussed theory, without the frustrations of free-form coding. Surveying state-of-the art methods in applications of deep neural networks to audio and sound computing, as well as offering a research perspective that suggests future challenges in music and AI research, this book appeals to both students of AI and music, as well as industry professionals in the fields of machine learning, music, and AI.

Intelligent Computing

Intelligent Computing
Author: Kohei Arai
Publisher: Springer Nature
Total Pages: 1492
Release: 2023-10-02
Genre: Technology & Engineering
ISBN: 3031377176

This book is a collection of insightful and unique state-of the-art papers presented at the Computing Conference which took place in London on June 22–23, 2023. A total of 539 papers were received out of which 193 were selected for presenting after double-blind peer-review. The book covers a wide range of scientific topics including IoT, Artificial Intelligence, Computing, Data Science, Networking, Data security and Privacy, etc. The conference was successful in reaping the advantages of both online and offline modes. The goal of this conference is to give a platform to researchers with fundamental contributions and to be a premier venue for academic and industry practitioners to share new ideas and development experiences. We hope that readers find this book interesting and valuable. We also expect that the conference and its publications will be a trigger for further related research and technology improvements in this important subject.

Artificial Intelligence in Music, Sound, Art and Design

Artificial Intelligence in Music, Sound, Art and Design
Author: Tiago Martins
Publisher: Springer Nature
Total Pages: 428
Release: 2022-04-15
Genre: Computers
ISBN: 3031037898

This book constitutes the refereed proceedings of the 10th European Conference on Artificial Intelligence in Music, Sound, Art and Design, EvoMUSART 2022, held as part of Evo* 2022, in April 2022, co-located with the Evo* 2022 events, EvoCOP, EvoApplications, and EuroGP. The 20 full papers and 6 short papers presented in this book were carefully reviewed and selected from 66 submissions. They cover a wide range of topics and application areas, including generative approaches to music and visual art, deep learning, and architecture.

Artificial Intelligence in Music, Sound, Art and Design

Artificial Intelligence in Music, Sound, Art and Design
Author: Colin Johnson
Publisher: Springer Nature
Total Pages: 438
Release: 2023-03-31
Genre: Computers
ISBN: 3031299566

This book constitutes the refereed proceedings of the 12th European Conference on Artificial Intelligence in Music, Sound, Art and Design, EvoMUSART 2023, held as part of Evo* 2023, in April 2023, co-located with the Evo* 2023 events, EvoCOP, EvoApplications, and EuroGP. The 20 full papers and 7 short papers presented in this book were carefully reviewed and selected from 55 submissions. They cover a wide range of topics and application areas of artificial intelligence, including generative approaches to music and visual art, deep learning, and architecture.