Performance Evaluation and Benchmarking of Intelligent Systems

Performance Evaluation and Benchmarking of Intelligent Systems
Author: Raj Madhavan
Publisher: Springer Science & Business Media
Total Pages: 351
Release: 2010-04-29
Genre: Computers
ISBN: 144190493X

To design and develop capable, dependable, and affordable intelligent systems, their performance must be measurable. Scienti?c methodologies for standardization and benchmarking are crucial for quantitatively evaluating the performance of eme- ing robotic and intelligent systems’ technologies. There is currently no accepted standard for quantitatively measuring the performance of these systems against user-de?ned requirements; and furthermore, there is no consensus on what obj- tive evaluation procedures need to be followed to understand the performance of these systems. The lack of reproducible and repeatable test methods has precluded researchers working towards a common goal from exchanging and communic- ing results, inter-comparing system performance, and leveraging previous work that could otherwise avoid duplication and expedite technology transfer. Currently, this lack of cohesion in the community hinders progress in many domains, such as m- ufacturing, service, healthcare, and security. By providing the research community with access to standardized tools, reference data sets, and open source libraries of solutions, researchers and consumers will be able to evaluate the cost and be- ?ts associated with intelligent systems and associated technologies. In this vein, the edited book volume addresses performance evaluation and metrics for intel- gent systems, in general, while emphasizing the need and solutions for standardized methods. To the knowledge of the editors, there is not a single book on the market that is solely dedicated to the subject of performance evaluation and benchmarking of intelligent systems.

Designing Performance Measurement Systems

Designing Performance Measurement Systems
Author: Fiorenzo Franceschini
Publisher: Springer
Total Pages: 220
Release: 2018-11-23
Genre: Business & Economics
ISBN: 3030011925

Given our rapidly changing world, companies are virtually forced to engage in continuous performance monitoring. Though Key Performance Indicators (KPIs) may at times seem to be the real driving force behind social systems, economies and organizations, they can also have far-reaching normative effects, which can modify organizational behavior and influence key decisions – even to the point that organizations themselves tend to become what they measure! Selecting the right performance indicators is hardly a simple undertaking. This book describes in detail the main characteristics of performance measurement systems and summarizes practical methods for defining KPIs, combining theoretical and practical aspects. These descriptions are supported by a wealth of practical examples. The book is intended for all academics, professionals and consultants involved in the analysis and management of KPIs.