Transfer Learning for Multiagent Reinforcement Learning Systems

Transfer Learning for Multiagent Reinforcement Learning Systems
Author: Felipe Felipe Leno da Silva
Publisher: Springer Nature
Total Pages: 111
Release: 2022-06-01
Genre: Computers
ISBN: 3031015916

Learning to solve sequential decision-making tasks is difficult. Humans take years exploring the environment essentially in a random way until they are able to reason, solve difficult tasks, and collaborate with other humans towards a common goal. Artificial Intelligent agents are like humans in this aspect. Reinforcement Learning (RL) is a well-known technique to train autonomous agents through interactions with the environment. Unfortunately, the learning process has a high sample complexity to infer an effective actuation policy, especially when multiple agents are simultaneously actuating in the environment. However, previous knowledge can be leveraged to accelerate learning and enable solving harder tasks. In the same way humans build skills and reuse them by relating different tasks, RL agents might reuse knowledge from previously solved tasks and from the exchange of knowledge with other agents in the environment. In fact, virtually all of the most challenging tasks currently solved by RL rely on embedded knowledge reuse techniques, such as Imitation Learning, Learning from Demonstration, and Curriculum Learning. This book surveys the literature on knowledge reuse in multiagent RL. The authors define a unifying taxonomy of state-of-the-art solutions for reusing knowledge, providing a comprehensive discussion of recent progress in the area. In this book, readers will find a comprehensive discussion of the many ways in which knowledge can be reused in multiagent sequential decision-making tasks, as well as in which scenarios each of the approaches is more efficient. The authors also provide their view of the current low-hanging fruit developments of the area, as well as the still-open big questions that could result in breakthrough developments. Finally, the book provides resources to researchers who intend to join this area or leverage those techniques, including a list of conferences, journals, and implementation tools. This book will be useful for a wide audience; and will hopefully promote new dialogues across communities and novel developments in the area.

Reinforcement Learning

Reinforcement Learning
Author: Marco Wiering
Publisher: Springer Science & Business Media
Total Pages: 653
Release: 2012-03-05
Genre: Technology & Engineering
ISBN: 3642276458

Reinforcement learning encompasses both a science of adaptive behavior of rational beings in uncertain environments and a computational methodology for finding optimal behaviors for challenging problems in control, optimization and adaptive behavior of intelligent agents. As a field, reinforcement learning has progressed tremendously in the past decade. The main goal of this book is to present an up-to-date series of survey articles on the main contemporary sub-fields of reinforcement learning. This includes surveys on partially observable environments, hierarchical task decompositions, relational knowledge representation and predictive state representations. Furthermore, topics such as transfer, evolutionary methods and continuous spaces in reinforcement learning are surveyed. In addition, several chapters review reinforcement learning methods in robotics, in games, and in computational neuroscience. In total seventeen different subfields are presented by mostly young experts in those areas, and together they truly represent a state-of-the-art of current reinforcement learning research. Marco Wiering works at the artificial intelligence department of the University of Groningen in the Netherlands. He has published extensively on various reinforcement learning topics. Martijn van Otterlo works in the cognitive artificial intelligence group at the Radboud University Nijmegen in The Netherlands. He has mainly focused on expressive knowledge representation in reinforcement learning settings.

Federated and Transfer Learning

Federated and Transfer Learning
Author: Roozbeh Razavi-Far
Publisher: Springer Nature
Total Pages: 371
Release: 2022-09-30
Genre: Technology & Engineering
ISBN: 3031117484

This book provides a collection of recent research works on learning from decentralized data, transferring information from one domain to another, and addressing theoretical issues on improving the privacy and incentive factors of federated learning as well as its connection with transfer learning and reinforcement learning. Over the last few years, the machine learning community has become fascinated by federated and transfer learning. Transfer and federated learning have achieved great success and popularity in many different fields of application. The intended audience of this book is students and academics aiming to apply federated and transfer learning to solve different kinds of real-world problems, as well as scientists, researchers, and practitioners in AI industries, autonomous vehicles, and cyber-physical systems who wish to pursue new scientific innovations and update their knowledge on federated and transfer learning and their applications.

Machine Learning and Knowledge Discovery in Databases

Machine Learning and Knowledge Discovery in Databases
Author: Walter Daelemans
Publisher: Springer Science & Business Media
Total Pages: 714
Release: 2008-09-04
Genre: Computers
ISBN: 354087478X

This book constitutes the refereed proceedings of the joint conference on Machine Learning and Knowledge Discovery in Databases: ECML PKDD 2008, held in Antwerp, Belgium, in September 2008. The 100 papers presented in two volumes, together with 5 invited talks, were carefully reviewed and selected from 521 submissions. In addition to the regular papers the volume contains 14 abstracts of papers appearing in full version in the Machine Learning Journal and the Knowledge Discovery and Databases Journal of Springer. The conference intends to provide an international forum for the discussion of the latest high quality research results in all areas related to machine learning and knowledge discovery in databases. The topics addressed are application of machine learning and data mining methods to real-world problems, particularly exploratory research that describes novel learning and mining tasks and applications requiring non-standard techniques.

Agents and Multi-agent Systems: Technologies and Applications 2023

Agents and Multi-agent Systems: Technologies and Applications 2023
Author: Gordan Jezic
Publisher: Springer Nature
Total Pages: 421
Release: 2023-05-27
Genre: Technology & Engineering
ISBN: 9819930685

This book highlights new trends and challenges in research on agents and the new digital and knowledge economy. It includes papers on business process management, agent-based modeling and simulation and anthropic-oriented computing that were originally presented at the 17th International KES Conference on Agents and Multi-Agent Systems: Technologies and Applications (KES-AMSTA 2023), held in Rome, Italy, in June 14–16, 2023. The respective papers cover topics such as software agents, multi-agent systems, agent modeling, mobile and cloud computing, big data analysis, business intelligence, artificial intelligence, social systems, computer embedded systems and nature-inspired manufacturing, all of which contribute to the modern digital economy.

Distributed Autonomous Robotic Systems

Distributed Autonomous Robotic Systems
Author: Nak-Young Chong
Publisher: Springer
Total Pages: 475
Release: 2016-01-14
Genre: Technology & Engineering
ISBN: 4431558799

This volume of proceedings includes 32 original contributions presented at the 12th International Symposium on Distributed Autonomous Robotic Systems (DARS 2014), held in November 2014. The selected papers in this volume are authored by leading researchers from Asia, Australia, Europe, and the Americas, thereby providing a broad coverage and perspective of the state-of-the-art technologies, algorithms, system architectures, and applications in distributed robotic systems.

Adaptive Learning Agents

Adaptive Learning Agents
Author: Matthew E. Taylor
Publisher: Springer Science & Business Media
Total Pages: 149
Release: 2010-03-24
Genre: Computers
ISBN: 3642118135

This volume constitutes the thoroughly refereed post-conference proceedings of the Second Workshop on Adaptive and Learning Agents, ALA 2009, held as part of the AAMAS 2009 conference in Budapest, Hungary, in May 2009. The 8 revised full papers presented were carefully reviewed and selected from numerous submissions. They cover a variety of themes: single and multi-agent reinforcement learning, the evolution and emergence of cooperation in agent systems, sensor networks and coordination in multi-resource job scheduling.

Optinformatics in Evolutionary Learning and Optimization

Optinformatics in Evolutionary Learning and Optimization
Author: Liang Feng
Publisher: Springer Nature
Total Pages: 144
Release: 2021-03-29
Genre: Technology & Engineering
ISBN: 3030709205

This book provides readers the recent algorithmic advances towards realizing the notion of optinformatics in evolutionary learning and optimization. The book also provides readers a variety of practical applications, including inter-domain learning in vehicle route planning, data-driven techniques for feature engineering in automated machine learning, as well as evolutionary transfer reinforcement learning. Through reading this book, the readers will understand the concept of optinformatics, recent research progresses in this direction, as well as particular algorithm designs and application of optinformatics. Evolutionary algorithms (EAs) are adaptive search approaches that take inspiration from the principles of natural selection and genetics. Due to their efficacy of global search and ease of usage, EAs have been widely deployed to address complex optimization problems occurring in a plethora of real-world domains, including image processing, automation of machine learning, neural architecture search, urban logistics planning, etc. Despite the success enjoyed by EAs, it is worth noting that most existing EA optimizers conduct the evolutionary search process from scratch, ignoring the data that may have been accumulated from different problems solved in the past. However, today, it is well established that real-world problems seldom exist in isolation, such that harnessing the available data from related problems could yield useful information for more efficient problem-solving. Therefore, in recent years, there is an increasing research trend in conducting knowledge learning and data processing along the course of an optimization process, with the goal of achieving accelerated search in conjunction with better solution quality. To this end, the term optinformatics has been coined in the literature as the incorporation of information processing and data mining (i.e., informatics) techniques into the optimization process. The primary market of this book is researchers from both academia and industry, who are working on computational intelligence methods and their applications. This book is also written to be used as a textbook for a postgraduate course in computational intelligence emphasizing methodologies at the intersection of optimization and machine learning.

Introduction to Transfer Learning

Introduction to Transfer Learning
Author: Jindong Wang
Publisher: Springer Nature
Total Pages: 333
Release: 2023-03-30
Genre: Computers
ISBN: 9811975841

Transfer learning is one of the most important technologies in the era of artificial intelligence and deep learning. It seeks to leverage existing knowledge by transferring it to another, new domain. Over the years, a number of relevant topics have attracted the interest of the research and application community: transfer learning, pre-training and fine-tuning, domain adaptation, domain generalization, and meta-learning. This book offers a comprehensive tutorial on an overview of transfer learning, introducing new researchers in this area to both classic and more recent algorithms. Most importantly, it takes a “student’s” perspective to introduce all the concepts, theories, algorithms, and applications, allowing readers to quickly and easily enter this area. Accompanying the book, detailed code implementations are provided to better illustrate the core ideas of several important algorithms, presenting good examples for practice.