Nonnegative Matrix and Tensor Factorizations

Nonnegative Matrix and Tensor Factorizations
Author: Andrzej Cichocki
Publisher: John Wiley & Sons
Total Pages: 500
Release: 2009-07-10
Genre: Science
ISBN: 9780470747285

This book provides a broad survey of models and efficient algorithms for Nonnegative Matrix Factorization (NMF). This includes NMF’s various extensions and modifications, especially Nonnegative Tensor Factorizations (NTF) and Nonnegative Tucker Decompositions (NTD). NMF/NTF and their extensions are increasingly used as tools in signal and image processing, and data analysis, having garnered interest due to their capability to provide new insights and relevant information about the complex latent relationships in experimental data sets. It is suggested that NMF can provide meaningful components with physical interpretations; for example, in bioinformatics, NMF and its extensions have been successfully applied to gene expression, sequence analysis, the functional characterization of genes, clustering and text mining. As such, the authors focus on the algorithms that are most useful in practice, looking at the fastest, most robust, and suitable for large-scale models. Key features: Acts as a single source reference guide to NMF, collating information that is widely dispersed in current literature, including the authors’ own recently developed techniques in the subject area. Uses generalized cost functions such as Bregman, Alpha and Beta divergences, to present practical implementations of several types of robust algorithms, in particular Multiplicative, Alternating Least Squares, Projected Gradient and Quasi Newton algorithms. Provides a comparative analysis of the different methods in order to identify approximation error and complexity. Includes pseudo codes and optimized MATLAB source codes for almost all algorithms presented in the book. The increasing interest in nonnegative matrix and tensor factorizations, as well as decompositions and sparse representation of data, will ensure that this book is essential reading for engineers, scientists, researchers, industry practitioners and graduate students across signal and image processing; neuroscience; data mining and data analysis; computer science; bioinformatics; speech processing; biomedical engineering; and multimedia.

Matrix and Tensor Factorization Techniques for Recommender Systems

Matrix and Tensor Factorization Techniques for Recommender Systems
Author: Panagiotis Symeonidis
Publisher: Springer
Total Pages: 101
Release: 2017-01-29
Genre: Computers
ISBN: 3319413570

This book presents the algorithms used to provide recommendations by exploiting matrix factorization and tensor decomposition techniques. It highlights well-known decomposition methods for recommender systems, such as Singular Value Decomposition (SVD), UV-decomposition, Non-negative Matrix Factorization (NMF), etc. and describes in detail the pros and cons of each method for matrices and tensors. This book provides a detailed theoretical mathematical background of matrix/tensor factorization techniques and a step-by-step analysis of each method on the basis of an integrated toy example that runs throughout all its chapters and helps the reader to understand the key differences among methods. It also contains two chapters, where different matrix and tensor methods are compared experimentally on real data sets, such as Epinions, GeoSocialRec, Last.fm, BibSonomy, etc. and provides further insights into the advantages and disadvantages of each method. The book offers a rich blend of theory and practice, making it suitable for students, researchers and practitioners interested in both recommenders and factorization methods. Lecturers can also use it for classes on data mining, recommender systems and dimensionality reduction methods.

Nonnegative Matrix Factorization

Nonnegative Matrix Factorization
Author: Nicolas Gillis
Publisher: SIAM
Total Pages: 376
Release: 2020-12-18
Genre: Mathematics
ISBN: 1611976413

Nonnegative matrix factorization (NMF) in its modern form has become a standard tool in the analysis of high-dimensional data sets. This book provides a comprehensive and up-to-date account of the most important aspects of the NMF problem and is the first to detail its theoretical aspects, including geometric interpretation, nonnegative rank, complexity, and uniqueness. It explains why understanding these theoretical insights is key to using this computational tool effectively and meaningfully. Nonnegative Matrix Factorization is accessible to a wide audience and is ideal for anyone interested in the workings of NMF. It discusses some new results on the nonnegative rank and the identifiability of NMF and makes available MATLAB codes for readers to run the numerical examples presented in the book. Graduate students starting to work on NMF and researchers interested in better understanding the NMF problem and how they can use it will find this book useful. It can be used in advanced undergraduate and graduate-level courses on numerical linear algebra and on advanced topics in numerical linear algebra and requires only a basic knowledge of linear algebra and optimization.

Audio Source Separation and Speech Enhancement

Audio Source Separation and Speech Enhancement
Author: Emmanuel Vincent
Publisher: John Wiley & Sons
Total Pages: 517
Release: 2018-10-22
Genre: Technology & Engineering
ISBN: 1119279895

Learn the technology behind hearing aids, Siri, and Echo Audio source separation and speech enhancement aim to extract one or more source signals of interest from an audio recording involving several sound sources. These technologies are among the most studied in audio signal processing today and bear a critical role in the success of hearing aids, hands-free phones, voice command and other noise-robust audio analysis systems, and music post-production software. Research on this topic has followed three convergent paths, starting with sensor array processing, computational auditory scene analysis, and machine learning based approaches such as independent component analysis, respectively. This book is the first one to provide a comprehensive overview by presenting the common foundations and the differences between these techniques in a unified setting. Key features: Consolidated perspective on audio source separation and speech enhancement. Both historical perspective and latest advances in the field, e.g. deep neural networks. Diverse disciplines: array processing, machine learning, and statistical signal processing. Covers the most important techniques for both single-channel and multichannel processing. This book provides both introductory and advanced material suitable for people with basic knowledge of signal processing and machine learning. Thanks to its comprehensiveness, it will help students select a promising research track, researchers leverage the acquired cross-domain knowledge to design improved techniques, and engineers and developers choose the right technology for their target application scenario. It will also be useful for practitioners from other fields (e.g., acoustics, multimedia, phonetics, and musicology) willing to exploit audio source separation or speech enhancement as pre-processing tools for their own needs.

Proceedings of the Fifth SIAM International Conference on Data Mining

Proceedings of the Fifth SIAM International Conference on Data Mining
Author: Hillol Kargupta
Publisher: SIAM
Total Pages: 670
Release: 2005-04-01
Genre: Mathematics
ISBN: 9780898715934

The Fifth SIAM International Conference on Data Mining continues the tradition of providing an open forum for the presentation and discussion of innovative algorithms as well as novel applications of data mining. Advances in information technology and data collection methods have led to the availability of large data sets in commercial enterprises and in a wide variety of scientific and engineering disciplines. The field of data mining draws upon extensive work in areas such as statistics, machine learning, pattern recognition, databases, and high performance computing to discover interesting and previously unknown information in data. This conference results in data mining, including applications, algorithms, software, and systems.

Partitional Clustering Algorithms

Partitional Clustering Algorithms
Author: M. Emre Celebi
Publisher: Springer
Total Pages: 420
Release: 2014-11-07
Genre: Technology & Engineering
ISBN: 3319092596

This book focuses on partitional clustering algorithms, which are commonly used in engineering and computer scientific applications. The goal of this volume is to summarize the state-of-the-art in partitional clustering. The book includes such topics as center-based clustering, competitive learning clustering and density-based clustering. Each chapter is contributed by a leading expert in the field.

Artificial Neural Networks and Machine Learning - ICANN 2011

Artificial Neural Networks and Machine Learning - ICANN 2011
Author: Timo Honkela
Publisher: Springer
Total Pages: 409
Release: 2011-06-13
Genre: Computers
ISBN: 3642217354

This two volume set LNCS 6791 and LNCS 6792 constitutes the refereed proceedings of the 21th International Conference on Artificial Neural Networks, ICANN 2011, held in Espoo, Finland, in June 2011. The 106 revised full or poster papers presented were carefully reviewed and selected from numerous submissions. ICANN 2011 had two basic tracks: brain-inspired computing and machine learning research, with strong cross-disciplinary interactions and applications.

Mathematics of Data Science: A Computational Approach to Clustering and Classification

Mathematics of Data Science: A Computational Approach to Clustering and Classification
Author: Daniela Calvetti
Publisher: SIAM
Total Pages: 199
Release: 2020-11-20
Genre: Mathematics
ISBN: 1611976375

This textbook provides a solid mathematical basis for understanding popular data science algorithms for clustering and classification and shows that an in-depth understanding of the mathematics powering these algorithms gives insight into the underlying data. It presents a step-by-step derivation of these algorithms, outlining their implementation from scratch in a computationally sound way. Mathematics of Data Science: A Computational Approach to Clustering and Classification proposes different ways of visualizing high-dimensional data to unveil hidden internal structures, and nearly every chapter includes graphical explanations and computed examples using publicly available data sets to highlight similarities and differences among the algorithms. This self-contained book is geared toward advanced undergraduate and beginning graduate students in the mathematical sciences, engineering, and computer science and can be used as the main text in a semester course. Researchers in any application area where data science methods are used will also find the book of interest. No advanced mathematical or statistical background is assumed.

Independent Component Analysis and Signal Separation

Independent Component Analysis and Signal Separation
Author: Tulay Adali
Publisher: Springer
Total Pages: 803
Release: 2009-03-16
Genre: Computers
ISBN: 3642005993

This book constitutes the refereed proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation, ICA 2009, held in Paraty, Brazil, in March 2009. The 97 revised papers presented were carefully reviewed and selected from 137 submissions. The papers are organized in topical sections on theory, algorithms and architectures, biomedical applications, image processing, speech and audio processing, other applications, as well as a special session on evaluation.

Matrix Methods in Data Mining and Pattern Recognition

Matrix Methods in Data Mining and Pattern Recognition
Author: Lars Elden
Publisher: SIAM
Total Pages: 226
Release: 2007-07-12
Genre: Computers
ISBN: 0898716268

Several very powerful numerical linear algebra techniques are available for solving problems in data mining and pattern recognition. This application-oriented book describes how modern matrix methods can be used to solve these problems, gives an introduction to matrix theory and decompositions, and provides students with a set of tools that can be modified for a particular application.Matrix Methods in Data Mining and Pattern Recognition is divided into three parts. Part I gives a short introduction to a few application areas before presenting linear algebra concepts and matrix decompositions that students can use in problem-solving environments such as MATLAB®. Some mathematical proofs that emphasize the existence and properties of the matrix decompositions are included. In Part II, linear algebra techniques are applied to data mining problems. Part III is a brief introduction to eigenvalue and singular value algorithms. The applications discussed by the author are: classification of handwritten digits, text mining, text summarization, pagerank computations related to the GoogleÔ search engine, and face recognition. Exercises and computer assignments are available on a Web page that supplements the book.Audience The book is intended for undergraduate students who have previously taken an introductory scientific computing/numerical analysis course. Graduate students in various data mining and pattern recognition areas who need an introduction to linear algebra techniques will also find the book useful.Contents Preface; Part I: Linear Algebra Concepts and Matrix Decompositions. Chapter 1: Vectors and Matrices in Data Mining and Pattern Recognition; Chapter 2: Vectors and Matrices; Chapter 3: Linear Systems and Least Squares; Chapter 4: Orthogonality; Chapter 5: QR Decomposition; Chapter 6: Singular Value Decomposition; Chapter 7: Reduced-Rank Least Squares Models; Chapter 8: Tensor Decomposition; Chapter 9: Clustering and Nonnegative Matrix Factorization; Part II: Data Mining Applications. Chapter 10: Classification of Handwritten Digits; Chapter 11: Text Mining; Chapter 12: Page Ranking for a Web Search Engine; Chapter 13: Automatic Key Word and Key Sentence Extraction; Chapter 14: Face Recognition Using Tensor SVD. Part III: Computing the Matrix Decompositions. Chapter 15: Computing Eigenvalues and Singular Values; Bibliography; Index.