Enhancing Surrogate-Based Optimization Through Parallelization

Enhancing Surrogate-Based Optimization Through Parallelization
Author: Frederik Rehbach
Publisher: Springer Nature
Total Pages: 123
Release: 2023-05-29
Genre: Technology & Engineering
ISBN: 3031306090

This book presents a solution to the challenging issue of optimizing expensive-to-evaluate industrial problems such as the hyperparameter tuning of machine learning models. The approach combines two well-established concepts, Surrogate-Based Optimization (SBO) and parallelization, to efficiently search for optimal parameter setups with as few function evaluations as possible. Through in-depth analysis, the need for parallel SBO solvers is emphasized, and it is demonstrated that they outperform model-free algorithms in scenarios with a low evaluation budget. The SBO approach helps practitioners save significant amounts of time and resources in hyperparameter tuning as well as other optimization projects. As a highlight, a novel framework for objectively comparing the efficiency of parallel SBO algorithms is introduced, enabling practitioners to evaluate and select the most effective approach for their specific use case. Based on practical examples, decision support is delivered, detailing which parts of industrial optimization projects can be parallelized and how to prioritize which parts to parallelize first. By following the framework, practitioners can make informed decisions about how to allocate resources and optimize their models efficiently.

Advances in Intelligent Systems Research and Innovation

Advances in Intelligent Systems Research and Innovation
Author: Vassil Sgurev
Publisher: Springer Nature
Total Pages: 489
Release: 2021-11-03
Genre: Technology & Engineering
ISBN: 3030781240

This book represents the experience of successful researchers from four continents on a broad range of intelligent systems, and it hints how to avoid anticipated conflicts and problems during multidisciplinary innovative research from Industry 4.0 and/or Internet of Things through modern machine learning, and software agent applications to open data science big data/advance analytics/visual analytics/text mining/web mining/knowledge discovery/deep data mining issues. The considered intelligent part is essential in most smart/control systems, cyber security, bioinformatics, virtual reality, robotics, mathematical modelling projects, and its significance rapidly increases in other technologies. Theoretical foundations of fuzzy sets, mathematical and non-classical logic also are rapidly developing.

Data Analytics

Data Analytics
Author: Thomas A. Runkler
Publisher: Springer
Total Pages: 158
Release: 2016-07-26
Genre: Computers
ISBN: 3658140755

This book is a comprehensive introduction to the methods and algorithms of modern data analytics. It provides a sound mathematical basis, discusses advantages and drawbacks of different approaches, and enables the reader to design and implement data analytics solutions for real-world applications. This book has been used for more than ten years in the Data Mining course at the Technical University of Munich. Much of the content is based on the results of industrial research and development projects at Siemens.

Machine Learning and Data Mining

Machine Learning and Data Mining
Author: Ryszad S. Michalski
Publisher: Wiley
Total Pages: 472
Release: 1998-04-22
Genre: Computers
ISBN: 9780471971993

Master the new computational tools to get the most out of your information system. This practical guide, the first to clearly outline the situation for the benefit of engineers and scientists, provides a straightforward introduction to basic machine learning and data mining methods, covering the analysis of numerical, text, and sound data.

Machine Learning and Knowledge Discovery in Databases

Machine Learning and Knowledge Discovery in Databases
Author: Peggy Cellier
Publisher: Springer Nature
Total Pages: 688
Release: 2020-03-27
Genre: Computers
ISBN: 3030438236

This two-volume set constitutes the refereed proceedings of the workshops which complemented the 19th Joint European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD, held in Würzburg, Germany, in September 2019. The 70 full papers and 46 short papers presented in the two-volume set were carefully reviewed and selected from 200 submissions. The two volumes (CCIS 1167 and CCIS 1168) present the papers that have been accepted for the following workshops: Workshop on Automating Data Science, ADS 2019; Workshop on Advances in Interpretable Machine Learning and Artificial Intelligence and eXplainable Knowledge Discovery in Data Mining, AIMLAI-XKDD 2019; Workshop on Decentralized Machine Learning at the Edge, DMLE 2019; Workshop on Advances in Managing and Mining Large Evolving Graphs, LEG 2019; Workshop on Data and Machine Learning Advances with Multiple Views; Workshop on New Trends in Representation Learning with Knowledge Graphs; Workshop on Data Science for Social Good, SoGood 2019; Workshop on Knowledge Discovery and User Modelling for Smart Cities, UMCIT 2019; Workshop on Data Integration and Applications Workshop, DINA 2019; Workshop on Machine Learning for Cybersecurity, MLCS 2019; Workshop on Sports Analytics: Machine Learning and Data Mining for Sports Analytics, MLSA 2019; Workshop on Categorising Different Types of Online Harassment Languages in Social Media; Workshop on IoT Stream for Data Driven Predictive Maintenance, IoTStream 2019; Workshop on Machine Learning and Music, MML 2019; Workshop on Large-Scale Biomedical Semantic Indexing and Question Answering, BioASQ 2019. The chapter "Supervised Human-guided Data Exploration" is published open access under a Creative Commons Attribution 4.0 International license (CC BY).

Recommender Systems Handbook

Recommender Systems Handbook
Author: Francesco Ricci
Publisher: Springer
Total Pages: 1008
Release: 2015-11-17
Genre: Computers
ISBN: 148997637X

This second edition of a well-received text, with 20 new chapters, presents a coherent and unified repository of recommender systems’ major concepts, theories, methodologies, trends, and challenges. A variety of real-world applications and detailed case studies are included. In addition to wholesale revision of the existing chapters, this edition includes new topics including: decision making and recommender systems, reciprocal recommender systems, recommender systems in social networks, mobile recommender systems, explanations for recommender systems, music recommender systems, cross-domain recommendations, privacy in recommender systems, and semantic-based recommender systems. This multi-disciplinary handbook involves world-wide experts from diverse fields such as artificial intelligence, human-computer interaction, information retrieval, data mining, mathematics, statistics, adaptive user interfaces, decision support systems, psychology, marketing, and consumer behavior. Theoreticians and practitioners from these fields will find this reference to be an invaluable source of ideas, methods and techniques for developing more efficient, cost-effective and accurate recommender systems.

Automated Machine Learning

Automated Machine Learning
Author: Frank Hutter
Publisher: Springer
Total Pages: 223
Release: 2019-05-17
Genre: Computers
ISBN: 3030053180

This open access book presents the first comprehensive overview of general methods in Automated Machine Learning (AutoML), collects descriptions of existing systems based on these methods, and discusses the first series of international challenges of AutoML systems. The recent success of commercial ML applications and the rapid growth of the field has created a high demand for off-the-shelf ML methods that can be used easily and without expert knowledge. However, many of the recent machine learning successes crucially rely on human experts, who manually select appropriate ML architectures (deep learning architectures or more traditional ML workflows) and their hyperparameters. To overcome this problem, the field of AutoML targets a progressive automation of machine learning, based on principles from optimization and machine learning itself. This book serves as a point of entry into this quickly-developing field for researchers and advanced students alike, as well as providing a reference for practitioners aiming to use AutoML in their work.

Computational Intelligence in Intelligent Data Analysis

Computational Intelligence in Intelligent Data Analysis
Author: Christian Moewes
Publisher: Springer
Total Pages: 298
Release: 2012-08-23
Genre: Technology & Engineering
ISBN: 3642323782

Complex systems and their phenomena are ubiquitous as they can be found in biology, finance, the humanities, management sciences, medicine, physics and similar fields. For many problems in these fields, there are no conventional ways to mathematically or analytically solve them completely at low cost. On the other hand, nature already solved many optimization problems efficiently. Computational intelligence attempts to mimic nature-inspired problem-solving strategies and methods. These strategies can be used to study, model and analyze complex systems such that it becomes feasible to handle them. Key areas of computational intelligence are artificial neural networks, evolutionary computation and fuzzy systems. As only a few researchers in that field, Rudolf Kruse has contributed in many important ways to the understanding, modeling and application of computational intelligence methods. On occasion of his 60th birthday, a collection of original papers of leading researchers in the field of computational intelligence has been collected in this volume.