Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles
Author: Teng Liu
Publisher: Morgan & Claypool Publishers
Total Pages: 99
Release: 2019-09-03
Genre: Technology & Engineering
ISBN: 1681736195

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles
Author: Teng Liu
Publisher: Springer Nature
Total Pages: 90
Release: 2022-06-01
Genre: Technology & Engineering
ISBN: 3031015037

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles
Author: Teng Liu
Publisher: Synthesis Lectures on Advances
Total Pages: 99
Release: 2019-09-03
Genre: Computers
ISBN: 9781681736204

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Hybrid Electric Vehicles

Hybrid Electric Vehicles
Author: Simona Onori
Publisher: Springer
Total Pages: 121
Release: 2015-12-16
Genre: Technology & Engineering
ISBN: 1447167813

This SpringerBrief deals with the control and optimization problem in hybrid electric vehicles. Given that there are two (or more) energy sources (i.e., battery and fuel) in hybrid vehicles, it shows the reader how to implement an energy-management strategy that decides how much of the vehicle’s power is provided by each source instant by instant. Hybrid Electric Vehicles: •introduces methods for modeling energy flow in hybrid electric vehicles; •presents a standard mathematical formulation of the optimal control problem; •discusses different optimization and control strategies for energy management, integrating the most recent research results; and •carries out an overall comparison of the different control strategies presented. Chapter by chapter, a case study is thoroughly developed, providing illustrative numerical examples that show the basic principles applied to real-world situations. The brief is intended as a straightforward tool for learning quickly about state-of-the-art energy-management strategies. It is particularly well-suited to the needs of graduate students and engineers already familiar with the basics of hybrid vehicles but who wish to learn more about their control strategies.

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles
Author: Yeuching Li
Publisher: Morgan & Claypool Publishers
Total Pages: 135
Release: 2022-02-14
Genre: Computers
ISBN: 1636393020

The urgent need for vehicle electrification and improvement in fuel efficiency has gained increasing attention worldwide. Regarding this concern, the solution of hybrid vehicle systems has proven its value from academic research and industry applications, where energy management plays a key role in taking full advantage of hybrid electric vehicles (HEVs). There are many well-established energy management approaches, ranging from rules-based strategies to optimization-based methods, that can provide diverse options to achieve higher fuel economy performance. However, the research scope for energy management is still expanding with the development of intelligent transportation systems and the improvement in onboard sensing and computing resources. Owing to the boom in machine learning, especially deep learning and deep reinforcement learning (DRL), research on learning-based energy management strategies (EMSs) is gradually gaining more momentum. They have shown great promise in not only being capable of dealing with big data, but also in generalizing previously learned rules to new scenarios without complex manually tunning. Focusing on learning-based energy management with DRL as the core, this book begins with an introduction to the background of DRL in HEV energy management. The strengths and limitations of typical DRL-based EMSs are identified according to the types of state space and action space in energy management. Accordingly, value-based, policy gradient-based, and hybrid action space-oriented energy management methods via DRL are discussed, respectively. Finally, a general online integration scheme for DRL-based EMS is described to bridge the gap between strategy learning in the simulator and strategy deployment on the vehicle controller.

Intelligent Control for Modern Transportation Systems

Intelligent Control for Modern Transportation Systems
Author: Arunesh Kumar Singh
Publisher: CRC Press
Total Pages: 203
Release: 2023-10-16
Genre: Technology & Engineering
ISBN: 1000963462

The book comprehensively discusses concepts of artificial intelligence in green transportation systems. It further covers intelligent techniques for precise modeling of complex transportation infrastructure, forecasting and predicting traffic congestion, and intelligent control techniques for maximizing performance and safety. It further provides MATLAB® programs for artificial intelligence techniques. It discusses artificial intelligence-based approaches and technologies in controlling and operating solar photovoltaic systems to generate power for electric vehicles. Highlights how different technological advancements have revolutionized the transportation system. Presents core concepts and principles of soft computing techniques in the control and management of modern transportation systems. Discusses important topics such as speed control, fuel control challenges, transport infrastructure modeling, and safety analysis. Showcases MATLAB® programs for artificial intelligence techniques. Discusses roles, implementation, and approaches of different intelligent techniques in the field of transportation systems. It will serve as an ideal text for professionals, graduate students, and academicians in the fields of electrical engineering, electronics and communication engineering, civil engineering, and computer engineering.

Principles and Applications in Speed Sensing and Energy Harvesting for Smart Roads

Principles and Applications in Speed Sensing and Energy Harvesting for Smart Roads
Author: Taha, Luay
Publisher: IGI Global
Total Pages: 326
Release: 2024-06-24
Genre: Technology & Engineering
ISBN: 1668492164

In the industry of transportation, the demand for sustainable energy solutions and intelligent traffic management has reached a critical juncture. One of the key challenges faced is the efficient utilization of roadways to generate power and support the infrastructure of smart highways. Road piezoelectric energy harvesting (RPEH) is a concept that has sparked widespread interest in both industry and academia. The book, titled Principles and Applications in Speed Sensing and Energy Harvesting for Smart Roads, unravels the intricacies of RPEH and presents a visionary solution to power traffic ancillary facilities and wireless sensor devices on highways. Within its pages lies a transformative proposal – harnessing energy from piezoelectric stacks to not only address the power needs of these critical components but also to enable intelligent vehicle speed sensing. This book is for academic scholars and practitioners alike, navigating the intricate landscape of smart highways. Focused on the latest energy harvesting technologies and vehicle speed sensing, it extends an invitation to delve into communication with smart road displays. Tailored for diverse engineering disciplines—electrical, computer, mechanical, and civil—the book contains cutting-edge research in the domain. Aspiring to be a one-stop source for up-to-date information, it guides researchers, students, and industry professionals through state-of-the-art technologies, fostering a deeper understanding of smart highway systems.

Modeling for Hybrid and Electric Vehicles Using Simscape

Modeling for Hybrid and Electric Vehicles Using Simscape
Author: Shuvra Das
Publisher: Springer Nature
Total Pages: 208
Release: 2022-06-01
Genre: Technology & Engineering
ISBN: 3031015088

Automobiles have played an important role in the shaping of the human civilization for over a century and continue to play a crucial role today. The design, construction, and performance of automobiles have evolved over the years. For many years, there has been a strong shift toward electrification of automobiles. It started with the by-wire systems where more efficient electro-mechanical subsystems started replacing purely mechanical devices, e.g., anti-lock brakes, drive-by-wire, and cruise control. Over the last decade, driven by a strong push for fuel efficiency, pollution reduction, and environmental stewardship, electric and hybrid electric vehicles have become quite popular. In fact, almost all the automobile manufacturers have adopted strategies and launched vehicle models that are electric and/or hybrid. With this shift in technology, employers have growing needs for new talent in areas such as energy storage and battery technology, power electronics, electric motor drives, embedded control systems, and integration of multi-disciplinary systems. To support these needs, universities are adjusting their programs to train students in these new areas of expertise. For electric and hybrid technology to deliver superior performance and efficiency, all sub-systems have to work seamlessly and in unison every time and all the time. To ensure this level of precision and reliability, modeling and simulation play crucial roles during the design and development cycle of electric and hybrid vehicles. Simscape, a Matlab/Simulink toolbox for modeling physical systems, is an ideally suited platform for developing and deploying models for systems and sub-systems that are critical for hybrid and electric vehicles. This text will focus on guiding the reader in the development of models for all critical areas of hybrid and electric vehicles. There are numerous texts on electric and hybrid vehicles in the market right now. A majority of these texts focus on the relevant technology and the physics and engineering of their operation. In contrast, this text focuses on the application of some of the theories in developing models of physical systems that are at the core of hybrid and electric vehicles. Simscape is the tool of choice for the development of these models. Relevant background and appropriate theory are referenced and summarized in the context of model development with significantly more emphasis on the model development procedure and obtaining usable and accurate results.

Decision Making, Planning, and Control Strategies for Intelligent Vehicles

Decision Making, Planning, and Control Strategies for Intelligent Vehicles
Author: Haotian Cao
Publisher: Springer Nature
Total Pages: 128
Release: 2022-05-31
Genre: Technology & Engineering
ISBN: 3031015061

The intelligent vehicle will play a crucial and essential role in the development of the future intelligent transportation system, which is developing toward the connected driving environment, ultimate driving safety, and comforts, as well as green efficiency. While the decision making, planning, and control are extremely vital components of the intelligent vehicle, these modules act as a bridge, connecting the subsystem of the environmental perception and the bottom-level control execution of the vehicle as well. This short book covers various strategies of designing the decision making, trajectory planning, and tracking control, as well as share driving, of the human-automation to adapt to different levels of the automated driving system. More specifically, we introduce an end-to-end decision-making module based on the deep Q-learning, and improved path-planning methods based on artificial potentials and elastic bands which are designed for obstacle avoidance. Then, the optimal method based on the convex optimization and the natural cubic spline is presented. As for the speed planning, planning methods based on the multi-object optimization and high-order polynomials, and a method with convex optimization and natural cubic splines, are proposed for the non-vehicle-following scenario (e.g., free driving, lane change, obstacle avoidance), while the planning method based on vehicle-following kinematics and the model predictive control (MPC) is adopted for the car-following scenario. We introduce two robust tracking methods for the trajectory following. The first one, based on nonlinear vehicle longitudinal or path-preview dynamic systems, utilizes the adaptive sliding mode control (SMC) law which can compensate for uncertainties to follow the speed or path profiles. The second one is based on the five-degrees-of-freedom nonlinear vehicle dynamical system that utilizes the linearized time-varying MPC to track the speed and path profile simultaneously. Toward human-automation cooperative driving systems, we introduce two control strategies to address the control authority and conflict management problems between the human driver and the automated driving systems. Driving safety field and game theory are utilized to propose a game-based strategy, which is used to deal with path conflicts during obstacle avoidance. Driver's driving intention, situation assessment, and performance index are employed for the development of the fuzzy-based strategy. Multiple case studies and demos are included in each chapter to show the effectiveness of the proposed approach. We sincerely hope the contents of this short book provide certain theoretical guidance and technical supports for the development of intelligent vehicle technology.

Artificial Intelligent Techniques for Electric and Hybrid Electric Vehicles

Artificial Intelligent Techniques for Electric and Hybrid Electric Vehicles
Author: Chitra A.
Publisher: John Wiley & Sons
Total Pages: 288
Release: 2020-07-21
Genre: Computers
ISBN: 1119681901

Electric vehicles are changing transportation dramatically and this unique book merges the many disciplines that contribute research to make EV possible, so the reader is informed about all the underlying science and technologies driving the change. An emission-free mobility system is the only way to save the world from the greenhouse effect and other ecological issues. This belief has led to a tremendous growth in the demand for electric vehicles (EV) and hybrid electric vehicles (HEV), which are predicted to have a promising future based on the goals fixed by the European Commission's Horizon 2020 program. This book brings together the research that has been carried out in the EV/HEV sector and the leading role of advanced optimization techniques with artificial intelligence (AI). This is achieved by compiling the findings of various studies in the electrical, electronics, computer, and mechanical domains for the EV/HEV system. In addition to acting as a hub for information on these research findings, the book also addresses the challenges in the EV/HEV sector and provides proven solutions that involve the most promising AI techniques. Since the commercialization of EVs/HEVs still remains a challenge in industries in terms of performance and cost, these are the two tradeoffs which need to be researched in order to arrive at an optimal solution. Therefore, this book focuses on the convergence of various technologies involved in EVs/HEVs. Since all countries will gradually shift from conventional internal combustion (IC) engine-based vehicles to EVs/HEVs in the near future, it also serves as a useful reliable resource for multidisciplinary researchers and industry teams.