Human-Machine Interface E-Book
173,99 €
Mehr erfahren.
- Herausgeber: John Wiley & Sons
- Kategorie: Wissenschaft und neue Technologien
- Sprache: Englisch
HUMAN-MACHINE INTERFACE
The book contains the latest advances in healthcare and presents them in the frame of the Human-Machine Interface (HMI).
The Human-Machine Interface (HMI) industry has witnessed the evolution from a simple push button to a modern touch-screen display. HMI is a user interface that allows humans to operate controllers for machines, systems, or instruments. Most medical procedures are improved by HMI systems, from calling an ambulance to ensuring that a patient receives adequate treatment on time.
This book describes the scenario of biomedical technologies in the context of the advanced HMI, with a focus on direct brain-computer connection. The book describes several HMI tools and related techniques for analyzing, creating, controlling, and upgrading healthcare delivery systems, and provides details regarding how advancements in technology, particularly HMI, ensure ethical and fair use in patient care.
Audience
The target audience for this book is medical personnel and policymakers in healthcare and pharmaceutical professionals, as well as engineers and researchers in computer science and artificial intelligence.
Sie lesen das E-Book in den Legimi-Apps auf:
Seitenzahl: 817
Veröffentlichungsjahr: 2023
Ähnliche
Table of Contents
Cover
Table of Contents
Series Page
Title Page
Copyright Page
Dedication Page
Foreword
Preface
Acknowledgement
Part I: Advanced Patient Care with HMI
1 Introduction to Human-Machine Interface
1.1 Introduction
1.2 Types of HMI
1.3 Transformation of HMI
1.4 Importance and COVID Relevance With HMI
1.5 Applications
1.6 Challenges
1.7 Conclusion and Future Prospects
References
2 Improving Healthcare Practice by Using HMI Interface
2.1 Background of Human-Machine Interaction
2.2 Introduction
2.3 Evolution of HMI Design
2.4 Anatomy of Human Brain
2.5 Signal Associated With Brain
2.6 HMI Signal Processing and Acquisition Methods
2.7 Human-Machine Interface–Based Healthcare System
2.8 Working Model of HMI
2.9 Challenges and Limitations of HMI Design
2.10 Role of HMI in Healthcare Practice
2.11 Application of HMI Technology in Medical Fields
2.12 Conclusion and Future Perspective
References
3 Human-Machine Interface and Patient Safety
3.1 Introduction
3.2 Detecting Anesthesia-Related Drug Administration Errors and Predicting Their Impact
3.3 Systematic Approaches to Improve Patient Safety During Anesthesia
3.4 The Triumph of Software
3.5 Environments that Audit Themselves
3.6 New Risks and Dangers
3.7 Conclusion
References
4 Human-Machine Interface Improving Quality of Patient Care
4.1 Introduction
4.2 An Advanced Framework for Human-Machine Interaction
4.3 Human–Computer Interaction (HCI)
4.4 Multimodal Processing
4.5 Integrated Multimodality at a Lower Order (Stimulus Orientation)
4.6 Higher-Order Multimodal Integration (Perceptual Binding)
4.7 Gains in Performance From Multisensory Stimulation
4.8 Amplitude Envelope and Alarm Design
4.9 Recent Trends in Alarm Tone Design for Medical Devices
4.10 Percussive Tone Integration in Multimodal User Interfaces
4.11 Software in Hospitals
4.12 Brain–Machine Interface (BCI) Outfit
4.13 BCI Sensors and Techniques
4.14 New Generation Advanced Human-Machine Interface
4.15 Conclusion
References
5 Smart Patient Engagement through Robotics
5.1 Introduction
5.2 Theoretical Framework
5.3 Objectives
5.4 Research Methodology
5.5 Primary and Secondary Data
5.6 Factors for Consideration
5.7 Robotics Implementation
5.8 Tools for Analysis
5.9 Analysis of Patient’s Perception
5.10 Review of Literature
5.11 Hospitals Considered for the Study (Through Indirect Sources)
5.12 Analysis and Interpretation
5.13 Conclusion
References
Annexure
6 Accelerating Development of Medical Devices Using Human-Machine Interface
6.1 Introduction
6.2 HMI Machineries
6.3 Brain–Computer Interface and HMI
6.4 HMI for a Mobile Medical Exoskeleton
6.5 Human Artificial Limb and Robotic Surgical Treatment by HMI
6.6 Cognitive Enhancement by HMI
6.7 Soft Electronics for the Skin Using HMI
6.8 Safety Considerations
6.9 Conclusion
References
7 The Role of a Human-Machine Interaction (HMI) System on the Medical Devices
7.1 Introduction
7.2 Machine Learning for HCI Systems
7.3 Patient Experience
7.4 Cognitive Science
7.5 HCI System Based on Image Processing
7.6 Blockchain
7.7 Virtual Reality
7.8 The Challenges in Designing HCI Systems for Medical Devices
7.9 Conclusion
References
8 Human-Machine Interaction in Leveraging the Concept of Telemedicine
8.1 Introduction
8.2 Innovative Development in HMI Technologies and Its Use in Telemedicine
8.3 Advantages of Utilizing HMI in Healthcare for Telemedicine
8.4 Obstacles to the Utilize, Accept, and Implement HMI in Telemedicine
8.5 Conclusions
References
9 Making Hospital Environment Friendly for People: A Concept of HMI
9.1 Introduction
9.2 A Scenario for Ubiquitous Computing and Ambient Intelligence
9.3 Emergence of Ambient Intelligence
9.4 Framework for Advanced Human-Machine Interfaces
9.5 Brain Computer Interface (BCI)
9.6 Development in MHI Technologies and Their Applications
9.7 Techniques of Signal Acquisition and Processing Applied to HMI
9.8 Hospital-Friendly Environment for Patients
9.9 Applications of HMI for Patient-Friendly Hospital Environment
9.10 Conclusion
References
Part II : Emerging Application and Regulatory Prospects of HMI in Healthcare
10 HMI: Disruption in the Neural Healthcare Industry
10.1 Introduction
10.2 Stimulation of Muscles
10.3 Cochlear Implants
10.4 Peripheral Nervous System Interaction
10.5 Sleeve Electrodes
10.6 Flat-Interfaced Nerve Electrodes
10.7 Transverse and Longitudinal Intrafascicular Electrode (LIFE and TIME)
10.8 Multi-Channel Arrays That Penetrate
10.9 Spinal Cord Stimulation and Central Nervous System Interaction
10.10 Computer–Brain Interfaces
10.11 Conclusion
References
11 Dynamics of EHR in M-Healthcare Application
11.1 Introduction
11.2 Background Related Work
11.3 Methodology
11.4 Tools and Technologies
11.5 Limitations
11.6 Future Scope
11.7 Discussion
11.8 Conclusion
References
12 Role of Human-Machine Interface in the Biomedical Device Development to Handle COVID-19 Pandemic Situation in an Efficient Way
12.1 Introduction: Background and Driving Forces
12.2 Methods
12.3 Results
12.4 Conclusion
Acknowledgment
References
13 Role of HMI in the Drug Manufacturing Process
13.1 Introduction
13.2 Types of HMI
13.3 Advantages and Disadvantages of HMI
13.4 Roles of HMI in the Pharmaceutical Manufacturing Process
13.5 Common Applications for Human-Machine Interfaces
13.6 Healthcare System-Based Human–Computer Interaction
13.7 Performance Test of Healthcare System Based on HCI
13.8 Human-Machine Interface for Healthcare and Rehabilitation
13.9 Human-Machine Interface for Research Reactor: Instrumentation and Control System
13.10 Future Scope of Human-Machine Interface (HMI)
13.11 Conclusion
References
14 Breaking the Silence: Brain–Computer Interface for Communication
14.1 Introduction
14.2 Survey of BCI
14.3 Techniques of BCI
14.4 BCI Components
14.5 BCI Signal Acquisition Methods
14.6 BCI Invasion
14.7 BCI With Limited Invasion
14.8 BCI Not Invasive
14.9 BCI Applications
14.10 BCI Healthcare Challenges
14.11 Conclusion
References
15 Regulatory Perspective: Human-Machine Interfaces
Abbreviations
15.1 Introduction
15.2 Why are Regulations Needed?
15.3 US Regulatory Perspective
15.4 Conclusion
References
16 Towards the Digitization of Healthcare Record Management
16.1 Introduction
16.2 Digital Health Records: Concept and Organization
16.3 Mechanism and Operation of Digital Health Record
16.4 Benefits of Digital Health Records
16.5 Limitations of Digital Health Records
16.6 Risk & Problems Associated With the System
16.7 Future Benefits
16.8 Miscellaneous
16.9 Conclusion
References
17 Intelligent Healthcare Supply Chain
17.1 Introduction
17.2 Supply Chain – Method Networking?
17.3 Healthcare Supply Chain and Steps Involved
17.4 Importance of HSC
17.5 Risks and Complexities Affecting the Globally Distributed HSC
17.6 Technologies Come to Aid to Build an Intelligent HSC
17.7 Blockchain
17.8 Robotics
17.9 Cloud Computing
17.10 Big Data Analytics (BDA)
17.11 Industry 4.0
17.12 Internet of Things (IoT)
17.13 Digital Twins
17.14 Supply Chain Control Tower
17.15 Predictive Maintenance
17.16 A Digital Transformation Roadmap
17.17 Prerequisite for Designing Intelligent HSC
17.18 HMI—Usage in HSC Management
17.19 HMI—A Face of the Supply Chain Control Tower
17.20 The Intelligent Future of the Healthcare Industry
17.21 Conclusion
References
Index
End User License Agreement
List of Illustrations
Chapter 1
Figure 1.1 Applications of HMI in different industries.
Chapter 2
Figure 2.1 Basic design of HMI.
Figure 2.2 Human brain structure.
Figure 2.3 Classification of BCI control signals.
Figure 2.4 Mechanism of HMI signal processing and acquisition.
Figure 2.5 Components involved healthcare practice.
Figure 2.6 Features of machine-based healthcare practice system.
Figure 2.7 Working model of HMI.
Figure 2.8 HMI role in healthcare.
Figure 2.9 Devices associated with HMI working mechanism.
Chapter 3
Figure 3.1 A biotechnological system in which the anesthesiologist and the anesthetic technology...
Figure 3.2 Those systems that are neither linear nor simple are called nonlinear systems...
Figure 3.3 An unbiased look at a self-assessing operating room. Medical devices like infusion pumps...
Chapter 4
Figure 4.1 Diagrammatic representation of a common human–computer interaction at a high level (HCI).
Figure 4.2 Block diagram of a common brain–computer interaction at a high level (BCI).
Figure 4.3 (a) Leap motion controller (b) Myo armband.
Figure 4.4 Conceptual model of the “intention to action” paradigm.
Chapter 5
Chart 5.1 Chart showing the percentage of robots recruitment.
Figure 5.1 Framework for robotics intelligence & implementation.
Chart 5.2 Chart showing the percentage increase in robots usage in healthcare.
Chapter 6
Figure 6.1 Schematic layout of the HMI.
Figure 6.2 Six subscales of index.
Figure 6.3 EMG signals affected by the muscles’ force and their activation level.
Figure 6.4 EOG signal.
Chapter 7
Figure 7.1 Benefits of making an intelligent hospital.
Figure 7.2 Treatment of patients based on the equality in HMI system.
Chapter 8
Figure 8.1 Emerging technologies of human-machine interface used in telemedicine.
Chapter 9
Figure 9.1 Brain architecture.
Figure 9.2 Signals in the brain.
Figure 9.3 Human-machine interface system.
Chapter 10
Figure 10.1 A system diagram for Inspire Upper Airway Stimulation...
Figure 10.2 1) Due to depolarization of the point of contact, monopolar arrangement produces...
Figure 10.3 An illustration of stimulation form in the intraneural case of the face using a multichannel...
Chapter 12
Figure 12.1 Positive cases from March 2021 to December 2021 globally.
Figure 12.2 CID for finding major influencing factors associated with “new COVID-19 cases.”
Figure 12.3 Block diagram of the proposed conceptual system.
Chapter 13
Figure 13.1 HMI system diagram.
Figure 13.2 Flowchart for the complete dialogue system.
Figure 13.3 Traditional medicine and physiology teaching.
Figure 13.4 HMI interaction.
Figure 13.5 Design of modern interaction principles.
Chapter 15
Figure 15.1 Device user interface in operational perspective (adapted from Redmill, F., & Rajan, J. (1997). The causes of human error. Human factors in safety critical systems).
Figure 15.2 Interactions among HFE/UE considerations result in either safe and effective use or unsafe or ineffective...
Chapter 16
Figure 16.1 Revolution in healthcare industry.
Figure 16.2 Information included in EHR.
Figure 16.3 Flow of information in an EHR.
Chapter 17
Figure 17.1 Risks affecting globally distributed (HSCs).
Figure 17.2 Benefits from intelligent automation, industry 4.0 and IoT.
Figure 17.3 A roadmap to support digital transformation of the biopharma supply chain.
Figure 17.4 End-to-end visibility of the supply chain.
Figure 17.5 Risk management and four pillars of a resilient supply chain.
List of Tables
Chapter 1
Table 1.1 HMI and SCADA.
Chapter 2
Table 2.1 HMI design evolution.
Table 2.2 Information about various HMI-based medical devices.
Chapter 3
Table 3.1 Estimates of drug administration error in anesthesia using dedicated, prospective incident reporting.
Table 3.2 Features of a new multimodal system designed to improve safety during anesthesia.
Chapter 5
Table 5.1 Percentage increase in robots usage in healthcare.
Table 5.2 Table showing the types of robots used in healthcare.
Table 5.3 The crosstab of patient’s age and factors considered for the level of acceptance of robotics.
Table 5.4 The crosstab of patient’s age and factors considered for the level of acceptance of robotics.
Table 5.5 The model fit summary.
Table 5.6 The model fit summary.
Table 5.7 Inception of robotics and factors to be considered through mean value.
Table 5.8 Extraction values of robotic assistance factors at hospital.
Table 5.9 Four factor conversion of robotic assistance factors at hospital.
Table 5.10 Comparison of robotic assistance factors at hospital.
Table 5.11 Impact of robotic assistance factors at hospital using regression analysis.
Table 5.12 Basic descriptives values of robotic assistive and supportive factors at hospital
Table 5.13 Basic descriptives values of robotic assistive and supportive factors at hospital.
Table 5.14 Basic descriptives values of robotic assistive and supportive factors at hospital.
Table 5.15 Basic descriptives values of robotic assistive and supportive factors at hospital.
Table 5.16 Basic descriptives values of robotic assistive and supportive factors at hospital.
Chapter 6
Table 6.1 Stretchy sensors and their uses [96].
Chapter 8
Table 8.1 Telemedicine services and its applications.
Chapter 11
Table 11.1 Blockchain in healthcare.
Chapter 12
Table 12.1 Worldwide COVID-19 situation up to June 2021.
Table 12.2 A sample study for those European countries with daily COVID-19 positive cases and temperature.
Table 12.3 Comparative study of the COVID-19 daily infection rate per million between India and Nepal.
Chapter 15
Table 15.1 International and national standards recognized by FDA...
Chapter 16
Table 16.1 Internet of things examples.
Table 16.2 Best smart watches to monitor health and fitness in 2022.
Chapter 17
Table 17.1 SWOT analysis of legacy HSC.
Guide
Cover
Table of Contents
Series Page
Title Page
Copyright Page
Dedication Page
Foreword
Preface
Acknowledgement
Begin Reading
Index
End User License Agreement
Pages
ii
iii
iv
v
xxiii
xxv
xxvi
xxvii
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
Scrivener Publishing100 Cummings Center, Suite 541JBeverly, MA 01915-6106
Publishers at ScrivenerMartin Scrivener ([email protected])Phillip Carmical ([email protected])
Human-Machine Interface
Making Healthcare Digital
Edited by
Rishabha Malviya
Department of Pharmacy, School of Medical and Allied Sciences, Galgotias University, Noida, India
Sonali Sundram
Department of Pharmacy, School of Medical and Allied Sciences, Galgotias University, Noida, India
Bhupendra Prajapati
Department of Pharmaceutics, Shree S.K.Patel College of Pharmaceutical Education and Research, Ganpat University, Gujarat, India
and
Sudarshan Kumar Singh
Department of Pharmaceutical Science, Chiang Mai University, Chiang Mai, Thailand
This edition first published 2024 by John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, USA and Scrivener Publishing LLC, 100 Cummings Center, Suite 541J, Beverly, MA 01915, USA© 2024 Scrivener Publishing LLCFor more information about Scrivener publications please visit www.scrivenerpublishing.com.
All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, except as permitted by law. Advice on how to obtain permission to reuse material from this title is available at http://www.wiley.com/go/permissions.
Wiley Global Headquarters111 River Street, Hoboken, NJ 07030, USA
For details of our global editorial offices, customer services, and more information about Wiley products visit us at www.wiley.com.
Limit of Liability/Disclaimer of WarrantyWhile the publisher and authors have used their best efforts in preparing this work, they make no representations or warranties with respect to the accuracy or completeness of the contents of this work and specifically disclaim all warranties, including without limitation any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created or extended by sales representatives, written sales materials, or promotional statements for this work. The fact that an organization, website, or product is referred to in this work as a citation and/or potential source of further information does not mean that the publisher and authors endorse the information or services the organization, website, or product may provide or recommendations it may make. This work is sold with the understanding that the publisher is not engaged in rendering professional services. The advice and strategies contained herein may not be suitable for your situation. You should consult with a specialist where appropriate. Neither the publisher nor authors shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages. Further, readers should be aware that websites listed in this work may have changed or disappeared between when this work was written and when it is read.
Library of Congress Cataloging-in-Publication Data
ISBN 978-1-394-19991-4
Cover image: Pixabay.ComCover design by Russell Richardson
Dedication
This book is dedicated to all those wonderful readers who are working in healthcare and put their effort into improved patient care.
Foreword
It gives me immense pleasure to write the foreword for this book edited by Dr. Rishabha Malviya. Dr. Malviya is a highly dedicated and enthusiastic individual who works tirelessly to achieve his goals. His commitment to his work is unparalleled, and he is truly one of the most exceptional people I have had the pleasure of meeting.
As for the book’s topic, Human-Machine Interface (HMI) is a hot trend in the medical field. Developers are always exploring ways to enhance the technologies that play a crucial role in daily life. In the context of a hospital, HMI holds immense significance as it enables devices to function better and enhance the experience of both healthcare professionals and patients. The implementation of HMI in a clinical setup offers a range of advantages. The development of dynamic human-machine interfaces and user interfaces has significantly benefited the healthcare sector. As new and innovative techniques for patient care emerge, HMI will continue to evolve, offering even more benefits for healthcare professionals and patients alike.
As a comprehensive resource, this book empowers readers to utilize their skills and expertise to advance healthcare through HMI. The book delves into a variety of HMI tools and related strategies that can be used to evaluate, design, regulate, and upgrade healthcare delivery systems and processes. Finally, it offers a comprehensive overview of the state-of-the-art applications of computational intelligence in the healthcare sector, providing insights into how these technologies can be utilized to improve patient care and outcomes. I fully believe that this book will be a helpful reference for healthcare professionals, academicians, students, and computer engineers who work on, or want to learn about, medical systems.
Mr. Dhruv GalgotiaCEO, Galgotias University, Greater Noida, India
Preface
With increasing healthcare expenditures and greater demand for affordable, user-friendly medical devices, Human-Machine Interface (HMI) has emerged as an essential trend in product development. HMI systems offer the controls necessary for a user to operate a device or instrument. When done correctly, they facilitate simple, dependable accessibility and streamline technological operations. HMI systems are vital in the medical sector and can accelerate recovery, improve clinical monitoring, and even save lives.
Most medical procedures are improved by HMI systems, from calling an ambulance to ensuring that a patient receives adequate treatment. This book describes biomedical technologies in the context of advanced HMI, with a focus on direct brain-computer connection. This book describes several HMI tools and related techniques for analyzing, creating, controlling, and upgrading healthcare delivery systems, and provides details regarding how advancements in technology, particularly HMI, ensure ethical and fair use in patient care.
Written by renowned authors from various regions, this book starts an introduction to basics of the human-machine interface and moves on to a second chapter that deals with how HMI can improve healthcare practices. A third chapter explains the connection between patient safety and security using HMI, and a fourth discusses how HMI improves the quality of patient care. Chapter 5 explores the most advanced application of the technology in the form of robotics for healthcare, while the sixth and seventh chapters investigate the latest research in the development of medical devices that use HMI. Chapter 8 provides current information about the robust technology framework that enables telemedicine. Chapter 9 discusses the hot topic, the “environment-friendly hospital.” This chapter gives a better understanding of how to improve the environment of hospitals and therefore make future healthcare places and spaces more responsive to patient needs.
The second half of the book explores and investigates how the most recent advancement of this technology can improve patient care. Chapter 10 explains HMI’s emergence as a highly successful means of treating mental health issues, depression, Alzheimer’s disease, dementia, and paralysis by repairing human cognitive or sensory-motor functions. The next chapter deals with the privacy of patients and the security of their information, specifically with the adoption of electronic records in the healthcare industry, while Chapter 12 explores the latest progress made in combating COVID-19 with advanced medical devices. Chapter 13 outlines how pharmaceutical manufacturing has entered a new level of productivity and quality assurance thanks to HMI. The next chapter discusses how the brain-computer interface is used for communication, while Chapter 15 focuses on important regulatory perspectives about the implementation of HMI. The book concludes with two chapters that address record and supply chain management.
Potential readers of the book include practitioners and researchers interested in applying the ideas of human-computer interaction. Our thanks go to all the authors for their great contributions to this book’s success. We also want to express our regards to the prestigious Wiley and Scrivener Publishing for their continuous kind support and guidance.
EditorsAugust 2023
Acknowledgement
Firstly, we would like to express our gratitude toward the superpower that enables us to complete this work.
We are also grateful for our friends who always encourage and motivate us to start this work. A special word of gratitude to the management of Galgotias University, who believe in us and give us the opportunity so we can serve our nation through our education.
We are eternally grateful to our families for their continuous support and encouragement that made it possible to complete this task. They all kept us going beyond all the ups and downs.
Many thanks to all contributors, without their participation, this task cannot be completed. At last, we would like to thank, our publisher whose constant support and guidance assisted us in making the best possible book.
Part IADVANCED PATIENT CARE WITH HMI
1Introduction to Human-Machine Interface
Shama Mujawar1*, Aarohi Deshpande1, Aarohi Gherkar1, Samson Eugin Simon2 and Bhupendra Prajapati3
1MIT School of Bioengineering Sciences and Research, MIT-Art, Design and Technology University, Loni Kalbhor, Pune, India
2Department of Hematology, University of Tennessee Health Science Centre, Memphis, Tennessee, USA
3Department of Pharmaceutics and Pharmaceutical Technology Shree S.K., Patel College of Pharmaceutical Education and Research, Ganpat University, Gujarat, India
Abstract
Human-machine interface or HMI is quite omnipresent today due to its innumerable advantages in various fields from basic everyday vending machines to massive and complex industrial operations. Its only goal is to make machines more user-friendly and automatic so that they may be operated with a single-button press as opposed to having it done manually. It is incredibly helpful in some of the most significant healthcare and life sciences areas by allowing lucid and coherent communication between a human and a machine. By providing efficient patient monitoring systems and keeping track of some of the crucial factors like blood pressure, oxygen levels, ECG monitors, etc. They can aid in speeding up the recovery of patients. Another regular execution of HMI in medical systems is the display monitors in hospitals, interfaces of medical equipment, touch screen devices, etc. portraying the accurate levels of a patient’s daily health status. One of the main advantages of HMI is its potential to bridge the communication gaps even when physicians could not treat patients during pandemics like COVID. It has provided us with systems that can interconnect monitors in hospitals, which feed into a single or wide range of computers to consistently be updated about a patient’s doses, medicine timings, treatment plan, etc. The capability of software or hardware to be able to transmit appropriate information to an end user in an uncomplicated way is what makes HMI more personalized and handier to the entire population. In this chapter, we have introduced HMI along with its origins and history and highlighted some of its most significant uses in various industries. Applications from areas, such as medicine, manufacturing, automation and processing, biomedical engineering, robotic surgery, etc., have also been highlighted, illuminating the function that HMIs and AI play and demonstrate how they have been a consistent support in a multitude of fields.
Keywords: Human-machine interface, Covid-19, SCADA, healthcare, biomedical
1.1 Introduction
Man has long desired a more transparent and cordial relationship with machines. In the beginning, was the push button, and with the push button were the lights and the switches. After that, hardwired gadgets turned into electronic panels, and the integrated circuit came into existence. The advancement in electronics has paved the way for operators to communicate with machines seamlessly, be it to monitor the machine data or send the data to operate the machines. From push buttons to PCs, text-based to graphical, CRT to LCD, the shape and role of what has come to be called “visualization” has changed dramatically over a few short years. Human-machine interface also sometimes referred to computer–human interface, man–machine interface, or human–computer interface [1], from an industrialist’s perspective can be defined as an “eye” through which an operator views and controls the machine or a whole plant’s worth of machinery or equipment. It is a part of the supervisory control and data acquisition (SCADA) system. SCADA is a generic term for any computerized system that can acquire data, process it, and apply operational controls over great distances, such as a pipeline system or a power transmission and distribution network [2]. HMIs are designed for better usability by specific users to achieve their specific goals. The design of an HMI depends on the application for which it has to be used [2]. It is and rather should be customized according to the operators of certain management that use interfaces to control their systems (Table 1.1).
A typical HMI consists of two components: hardware and software components. The hardware part of HMI has a processor (can be 16- or 32-bit), data storage, an input, and display unit, a membrane switch (works to open and close the electronic circuit), a rubber keypad, several types of pushbuttons (illuminated, double, door opening/closing) and switches, such as emergency stop, keylock, and ID switches, lever switches, illuminated selector switches, universal switches, etc. [3–5]. The HMI software has two main types: supervisory level and machine level. The supervisory level is more commonly used for control room environments, whereas the machine level uses multiple machine-level devices embedded within the production facility [6]. Another major component that works with HMIs is the PLCs or programmable logic controllers. The main purpose of using these is to monitor and control processes and automate systems. In order to manage any task that may be readily carried out once understood by the user, the HMI systems feature a graphical interface that consists of a variety of images, buttons, clicks, videos, gifs, and animations [7]. These interfaces, which are built into large machineries like factories, multinational corporations, and industries, make it convenient to operate equipment on a daily basis without having to pay attention to them constantly. They also allow users to communicate instructions via the PLC (for example, Touchscreen). In addition to sending out orders, they also collect and transmit feedback data from the PLC which is displayed on the screen [8].
Table 1.1 HMI and SCADA.
HMI
SCADA
Human-machine interface
Is the hardware and software through which operators can monitor and control equipment in an industrial environment
Includes touchscreen, buttons, etc.
Supervisory control and data acquisition
Used to monitor and control on a larger scale such as an industrial plant, oil and gas pipelines, electrical substations, etc.
Include several other systems (PLCs, RTUs, sensors, and HMI)
Some of the most desirable advantages provided by HMIs include the conversion of hardware into software and the facilitation of human-machine interaction. To begin with, HMI increases User Satisfaction. Any industry (manufacturing, automotive, processing, etc.) that deals with the exchange of information between a human and a machine can benefit from having an HMI because it makes systems simpler and easier to understand, making them much easier to use and ramping up user satisfaction with the tasks they are given to complete. It also makes operations easier by digitizing several functions that can be used to track, control, and assist other systems. Second of all, HMIs are customizable. Every industry has very different needs and priorities in terms of process control and monitoring. HMIs can represent different equipment shapes and functions which differ from industry to industry. For example, a manufacturing plant may have huge vessels, such as bioreactors, whereas a packaging plant may be more compact with robotic assembly lines. Taking into consideration these differences, an HMI can be customized to suit the needs. Third, HMIs are convenient and safe. With HMIs, one does not need to go to the equipment to start or stop them. It can be controlled remotely. This makes it convenient and safe for the operators. For example, consider a pump in a plant that is located in a hazardous area such as a crude oil refinery, which must be operated and troubleshooted remotely. HMI can provide the necessary functions. Lastly, HMIs are cost effective. By eliminating a lot of the manual work (documentation and keeping a track record) done in various industries, HMIs reduce the amount of manual intervention that is required to analyze and store information, especially in a batch process. This is beneficial to a firm financially as it helps reduce labor costs by automating the systems that do not require any external resources to intercede in their processes. Since the information is stored on a cloud, the storage cost is reduced and promotes a paper-free environment.
HMIs are ubiquitous in today’s era. They can be found in almost every industry, including food processing, pharmaceutical industry, medical industry, automobile industry, Household applications, Smart technology, etc. This chapter has discussed some of the applications of HMI in various industries, including pharmaceutical, in brief, and also the potential of HMI lying in the biological field.
1.2 Types of HMI
HMIs can be broadly categorized into three basic types: the pushbutton replacer, the data handler, and the overseer [9].
1.2.1 The Pushbutton Replacer
The main purpose of the pushbutton replacer is to act as a control function for switches, ON/OFF buttons, LEDs, or any other mechanical device in the overall architecture. This has reduced manufacturing functions by combining all the different tasks for each button into a central spot. The visual representation of all these devices is displayed on the screen, which also performs the same function, making the integration of the devices more likely.
1.2.2 The Data Handler
This type of HMI is better suited for applications that require constant feedback from the system as well as monitoring. It involves functions such as recipes, data training, data logging, and alarm handling/logging. These are often equipped with large memories.
1.2.3 The Overseer
This type of HMI is involved in and highly beneficial for applications concerning SCADA and/or manufacturing execution system (MES). MES is dynamic software that is used to track, monitor, and document the manufacturing process of any good right from its raw material to the final product [10]. It provides data in real-time, something that majorly differentiates it from an ERP or Enterprise resource planning, which generates a generic report over a long period [11]. The overseer has several ethernet ports and usually requires a window for its operation.
1.3 Transformation of HMI
We consider HMIs as a system that facilitates simpler communication between machines and people. Up until now, the operator had to continuously monitor the process and rely on push buttons or specific commands for each action. However, this has drastically altered as a result of technical improvements, increased networking, and bandwidth, providing it an advantage in the modern era [12]. HMI was referred to as man–machine interface (MMI) in view of the fact that it had very confined boundaries for development in processing capabilities for machines, complex processes, and the inability of machines to understand operations and sophisticated applications of MMI in various fields. The HMIs that were being used in the earlier times can be termed as a ‘first generation HMI’. The first-generation HMIs came into existence due to the appropriate use of electricity for signaling purposes [13]. The use of the human-machine interface was initiated with dial panels, wired buttons, alphanumeric operators, operator terminals, and other basic components that a computer consists of. Now the prime drawback of these systems was figured out to be the importance of humans looking over every process carried out in these systems. They were not developed to be intelligent enough for administering the whole process; operators had to be present for any machine breakdowns, starting, and terminating these processes which became more subjective to human errors. Companies went into loss as a result of the laborers’ miscalculations that were not fixed in time [13]. The lack of knowledge that HMIs could be used on a wide scale for carrying out a number of processes is what was pulling back machines from communicating with humans to solve bigger problems. As these MMIs were a basic fix to controlling other machines, only basic operations were carried out which used to provide a basic interface for those operations, which users could visualize by screens [14]. This provoked the need for better interfacing systems that can monitor a range of other systems connected to it and provide a general overview of processes existing in machines.
Times started to change when buttons were substituted by electronic terminals was the word given by ‘Marco H. Wishart’ (business manager at Rockwell automation) due to its cost-effectiveness [14]. Not only did bandwidth and networking play a big role but also connecting and integrating the internet to ethernet caused a major shift in how HMI’s were being used [13]. Internet connections made the use of mobile phones, computers, and laptops much more easier and entertaining which created opportunities for mass-scale visualization techniques to be implemented for better usage of available machines. This widens the scope for screening and visualization in machines that could be controlled by humans who did not necessarily have to be in the same area. Depending on the type of operation we wish to conduct, visualization platforms can be customized which talks about the up-scaling of machines and their appropriate usage.
The recasting of HMI set in when systems using older versions of microprocessors and control systems slowed down as new technological advances emerged such as inbuilt networks, better speed of operation, enhanced microprocessor optimization, and rational use of computing. One main reason for the late development of HMI can be the level of complexity of systems it had to handle back then which was near to nothing fancy compared to what we control under machines now [13]. HMI’s these days have been constructed in a way that they are able to withstand any kind of abnormalities during their usage. Resistance towards high temperatures, high pressures, vapor, pH levels, etc. is making machines and displaying interfaces more advanced according to the activities performed in them. Reading and monitoring processes inside a machine became easier with sensors, buttons, and easy-to-use touchscreens integrated onto machine surfaces. Alarm sensing and threat monitoring became simplified just by viewing information displayed on the interfaces thereby reducing unnecessary damage to heavy equipment and machinery. Specialized machines are designed to be tolerant towards hazardous chemicals that are used in pharmaceutical or large chemical factories.
Furthermore, Industrial HMI’s have become massive considering that HMI‘s can keep surveillance of the control systems according to the environment, and command specifications and drive the whole process by themselves upon understanding any crisis.
Capacitive and multi-touch-resistant screens enabled workers to utilize interactive tools in touchscreens using various icons, 3D touches, and logic controllers [15]. Application and website interfaces are a more live example of how a man can develop nothing without them. We collect, store, sort, analyze, integrate, interrelate, and conclude all kinds of data from the internet on a daily basis. It is an example of how we depend on the information we see on the interface of these systems to give a final reading on our part. There are a number of ways to spreading information on a huge scale; the Internet being the prime source, we rely on data available here which would’ve only been possible due to interfacing and the advancement of being able to share data.
Majority of HMI’s today are touch screen devices, colorful display systems, and user-friendly interfaces which can be smoothly operated by humans which is another milestone achieved by drastically improving technology. This increased support of advancements in all fields has led to the various applications of HMI in almost every field which was not a privilege we had in the past due to lack of knowledge and advancements. The foremost reason for such wide-scale dependency on human-machine interfaces is seen even more with the COVID-19 pandemic where humans couldn’t help but rely on technology for a number of reasons. More emphasis on the mentioned topic is done below.
1.4 Importance and COVID Relevance With HMI
Since the COVID-19 pandemic has left a significant mark on the whole world, correlating dependency on smartphones, tablets, computers, or any other gadgets has shot up exceedingly. Interfaces and machine dependency were one of the ways in which information about COVID and other related news was spread out on a larger scale for awareness purposes. Official websites and applications used these HMI to reach out to people for awareness, donations, funds, campaigns, etc. which played a major role in combating the pandemic. HMIs helped not only in one country but on a global scale which majorly focused on networking, and connections and helped hospitals, doctors, and the common man to stay in touch with the latest and updated news.
Following this period, not only companies but people in every sector felt the need for better interfacing tools in their professional lives [15]. People all around the world found touchscreens more appealing to work with on a daily basis, which consisted of a wide number of features such as easy to maintain and use, touch resolution, multi-touch resistivity, accessibility, faster response time, high display resolution (4K-Ultra HD), interactive, durability, the ease with which they can be designed (depending on the application whether it has to be vertical on a wall or flat on a table for planning designs or similar work), continuity to be evolved, etc. Digi-Key enables the showcase of all the information stored and control mechanisms in a single area. By doing this, the danger of subjecting the user to possibly hazardous cultures and conditions involving nanobots, handling equipment, and organic and chemical threats are diminished. The potential to showcase precise information about errors has also been incorporated. The HMI can identify the interruption; pinpoint its exact coordinates, offering comprehensive instructions on how to fix it instead of going to have to rely on the markers to notify the user of a breakdown.
Due to these capabilities, touchscreens being a main spot for interfacing activities, started to come into use more often than before.
During the pandemic, medical attention was of utmost importance. Medicine was in great demand for all countries and not being able to communicate physically stood out to be a problem bigger than expected during Covid times. HMIs have contributed to combating this pandemic across the whole world substantially. Connecting doctors across seas for medical assistance would’ve never been unattainable without networking and the capacity of HMI to provide persistent support throughout the two most crucial years. Treating patients in such a huge number physically was impractical but HMIs have helped a ton in connecting people in need to doctors and hospitals. Hospitals were at full capacity after a point and HMI gave us a solution of being able to treat ourselves at home, quarantined, resulting in safer and better outcomes for patients. There is a need to design HMIs in a way that they can smoothly run with medical kits, personal protective equipment (PPEs), biohazard suits, gloves, anti-contamination gear, etc. [15]. HMI needs to be redesigned with COVID-19 in mind so that doctors may use it to monitor patients who are infected with the virus. HMIs are currently challenging to manufacture and not adequately accustomed to the huge population. It is possible that there’s a need for an HMI featuring a more adaptive design that can be instantly constructed in bulk to fulfill existing and anticipated requirements given the growing manufacturing of non-invasive ventilation and Emergency department beds by several suppliers, including Ford, Motors, Philips, etc. [15].
Furthermore, a useful example of HMI is the recently installed food ordering systems in restaurants. A contact-free, safer, and precautionary measure taken after these tough times involves ordering food through apps and placing it on sanitized systems in the restaurant with no contact whatsoever with staff present there. This also reduced the overall workforce that used to work in the restaurant making it more hygienic for people.
Another aspect of HMI interconnecting with humans is the usage of various platforms for education. The education domain has vastly gotten a hold of teaching through online mode all over the world in the past two years. Platforms that we all often used for educational purposes show how human-machine interfaces are gradually encroaching on various industries. Instead, the continued usage of online tools for purposes such as office meetings, and family gatherings also shows how significantly HMIs have become popular. The ease with which online tuitions, meetings, connecting people, and medical practices were conducted shows another milestone man might’ve been able to achieve with the help of HMI’s.
1.5 Applications
HMIs are widely used in several fields including biological, industrial, manufacturing, processing, and automotive. We have listed down a handful of important applications of HMI in various sectors of life (Figure 1.1).
Figure 1.1 Applications of HMI in different industries.
1.5.1 Biological Applications
1.5.1.1 HMI Signal Detection and Procurement Method
Using various signal harvesting techniques, the various physiological signals in the HMI technology are recorded. These primarily fall under the categories of invasive, semi-invasive, and non-invasive procedures. Invasive approaches use a medical procedure termed a craniotomy to install electrodes deep within the brain and record signals from the cerebral cortex region of the brain. The implants are placed using a semi-invasive method and located just outside the brain’s gray matter, but underneath the cranium membrane. Because the mucoperiosteal flap does not need to be mirrored from its position and does not cut off the blood supply to tissues, less invasive techniques allow for quick recovery and minimally painful surgery [16]. By performing specific tasks, such as target-oriented motions of the limbs/extremities, ECoG can be employed to survey brain functioning and associated brain conditions. Particularly in patients with chronic epilepsy disorders, ECoG plays a crucial role in the assessment of neurophysiological illness [16].
1.5.1.2 Healthcare and Rehabilitation
HMI has been the main spot playing an important role in different domains, such as neurosurgery, medical diagnosis, rehabilitation, neurosciences, neuroimaging, etc. The HMI-based mobile healthcare devices with efficient and accurate results are extensively implemented for medical diagnostics whenever measuring hyperglycemia, heart rate, hypertension, as well as other extensive diseases related to the well-being of a patient [16]. One such example of HMI Technology used to enable direct brain-computer communication for severely disabled people is discussed in [17]. The brain–computer interface (BCI) establishes a direct connection to pathways between the brain and the external world, by not relying on the usual output pathways of the central nervous system, such as peripheral nerves or muscles [17]. This creates a great potential to help individuals with speech impairment in communication and augmentative environmental control, disabilities involving the spinal cord by Neural Prosthetics and making new customized sources of entertainment through virtual reality and advanced control systems [17].
1.5.1.3 Magnetoencephalography
It is a non-invasive technique wherein mechanical signals are recorded from the inference of electrical waves emerging from the brain’s activity during different events brain activity mapping is used to research numerous diseases, including schizophrenia, early-onset dementia, and Parkinson’s diseases, alcoholism, and developmental problems, psychosis, as well as language and memory processes and sensory processing [16].
1.5.1.4 Flexible Hybrid Electronics (FHE)
An FHE is an electronic device that can be stretched and is sufficiently flexible to be worn [18]. It is a cohesive system with numerous functional chip components, compliant membranes, and a combination of soft functional materials that makes it possible. HMIs have recently been employed in non-invasive, extremely sensitive wearable FHBs to enable the collection of physiological data (EMG, EOG, and EEG) for the treatment of patients [18].
1.5.1.5 Robotic-Assisted Surgeries
Robot-assisted surgeries are the new trend as more and more hospitals are turning toward them to provide more sophisticated treatments with minimum risk of complications. It provides surgeons with an enhanced view of the real-time, high-resolution, magnified images with 3D capabilities. HMI’s makes it possible by acting as a channel allowing the flow of information between the user and the device. The type of HMI, such as force sensing/reflecting devices, tactile instruments, graphical HMI with or without virtual reality facilities, and natural language interfaces, depends on the system’s input parameters [19–21]. For instance, the HMI for the 2008-proposed telerobotic surgery system neuroArm makes use of two force-feedback hand controllers based on visual data from a stereoscopic viewing device and two liquid crystal displays [21]. FAce MOUSe is another example of an HMI illustration that was introduced in 2003 for managing the location of the laparoscope and enabling endoscopic surgeons to conduct solo operations [21]. A telerobotic surgical system’s HMI is in charge of receiving system commands and disseminating optical, acoustic, and haptic input. The requirements for performance, attractiveness, and led screens have shaped the creation of the neuroArm GUI. Webcam feeds have been given the highest priority based on their frequency of utilization and usefulness in order to successfully deliver the surgeon all of the vital visual data [21]. A terminal that the human operator uses to operate, oversees, and gathers data from a robotics system can also be utilized to develop the system. An arm pole, pendant interface, spin key, or visual display unit can serve as this type of human-machine interface [22].
1.5.1.6 Flexible Microstructural Pressure Sensors
Flexible microstructural pressure sensors (FMPSs), in particular, have drawn a lot of interest due to their adjustable shape, compact size, and excellent sensitivity. For FMPSs to enhance sensitivity and response time, microstructures are crucial. The FMPSs offer excellent application opportunities in the sectors of medicine, social connection, electronic equipment, etc. in depth a variety of microstructures (such as wave, pillar, and pyramid shapes) that have been intricately constructed to drastically improve the sensing capability of FMPSs has been introduced recently [23].
1.5.1.7 Biomedical Applications
The HMI for telemonitoring exoskeleton technology is created to accommodate crisis situations and those with different medical impairments and related illnesses to stand up, walk, move around, and carry out daily specific anatomical movements. They have been seen to assist in military activities, such as disaster management. With the aid of these mobile robots and exoskeleton systems, a person with a physical impairment or afflicted by any congenital defect can still have their operating potential boosted. Exoskeletons and robotic systems with GUI control systems are employed expressly to raise a patient’s safety standards by helping and supporting them in possible hazards like explosive device tracking and destruction chores to improve the load-carrying capacity. It minimizes the level of discomfort in the individual carrying the equipment [24].
With the use of sophisticated human-machine interface (HMI) technologies, adaptation hypotheses and methods can be investigated in great depth. The HMI proposed solution consists of:
Interface for medical equipment
Controls for vital equipment
Membrane keypads for infrastructure and medical gear
Complete sealed panels
[22]
1.5.1.8 CB-HMI
Highly skilled human-machine interfaces that have the ability to perceive and understand biological signals are indeed necessary. With this in mind, we created a multimodal cryptographic biohuman–machine interface (CB-HMI) that converts human touch-based inputs into encrypted biological processes, biomechanical, and biometric parameters. To simultaneously measure the user’s heart rate, blood oxygen level, and fingerprint minute pattern, CB-HMI has a hardware sensor and related algorithms. By modernizing the typical virtual objects with the CB-HMI, interactive solutions for medication usage and driving safety were created. The primary objective of CB-HMI through several levels of bio perception was to achieve profound awareness of patients’ behavioral and physiological states and demands. Electrochemical sensors coated with hydrogel were employed to achieve the same [24]. Nowadays, owing to broad networking and the availability of data related to HMI, psychological investigations on the brain and other essential organs are possible [22] which helps us understand the complexity of the human body and untangle the problems associated with them.
1.5.1.9 HMI in Medical Devices
With the introduction of newer, more sophisticated HMI-embedded medical equipment; disease diagnosis has become considerably quicker and more effective. The accurate and understandable representation of medical information (such as MRI or X-ray data) on medical diagnostic equipment has also improved treatments (www.eao.com). To administer a shock to individuals who are experiencing cardiac arrest, a medical instrument called an automated external defibrillator (AED) is an example. The voice instructions provided by the HMI in this device are intended to enable anyone utilizing it to revive the patient. It essentially functions as a portable, lightweight version of the clinical defibrillators used in hospitals to administer an electrical shock. The electrocardiogram (ECG) patches used in the majority of AEDs evaluate the cardiac rhythm by being applied to specific body parts [25]. It determines whether or not a shock is necessary based on that.
1.5.2 Industrial Applications
HMIs are employed by line service providers, executives, and directors across the business for integrating massive models into informative information. HMIs are being used, for instance, to inspect if the equipment is functioning effectively. Virtually actual data about tank levels, pressures and seismic assessments, motors and valve performance, and other aspects are given significant context by simple visual displays. Nevertheless, supervisors and executives can now accomplish much more than supervise procedures thanks to the increased features of today’s HMIs [26].
1.5.2.1 Metal Industries
An HMI may make it simple to regulate the speed and technique of slicing and bending metal in the fabrication of metals. Xie et al., 2021 have employed HMI and DNN to regulate the mechanical qualities of steel online and to direct the manufacturing of steel plates with certain mechanical properties.
1.5.2.2 Video Game Industry
This includes several remote rendering applications. It refers to the process of rendering a specific industrial GUI on a robust 3D accelerated server machine, capturing, and encrypting the displayed program to a video, and simultaneously broadcasting the finished product to a receiving consumer. The client could be a computing device, a touchpad system installed on a device, a computer in a command center, or even a cell phone. The client’s work is limited to showing an encrypted live stream and obtaining data from the user (such as touch signals) in order to feed it again to the processing servers [27]. Due to the availability of games that were remotely created on the internet, the video lives telecasting-based approach has gradually received much interest. A variety of for-profit internet gaming organizations are presently offering their products relying upon remote rendering systems [27].
1.5.2.3 Aerospace and Defense
In the military and aerospace fields, where technologies like geographic information systems/topographic maps, cross-domain guard information security systems, and deployed methodologies for defense and aerospace applications are often used, human-machine interface (HMI) plays a critical role. Through these technologies, the technical procedures and machines used to serve the ideal representatives are best defined [22].
1.5.2.4 Water Purification Plant HMI Based on Multi-Agent Systems (MAS) [28]
Multi-agent systems are structures consisting of several autonomous agents, each focusing on solving a specific task by considering multiple inputs [29]. These have a tremendous potential to solve complex problems by breaking them into smaller separate errands. It is not only used in computer networks but also in various modeling complex systems and smart grids [29]. One such example has been proposed in [29] that is designed to supervise the filtration stage of a water purification plant. The main purpose of using this type of advanced HMI was to make a more collaborative system that can work with multiple agents to overcome the projection and integration problems faced by distributed architectures. The design for this system in a water treatment plant was simulated, validated, and implemented by using the unified modeling language (UML) and Petri nets (PN) [28].
1.5.2.5 Virtual and Haptic Interfaces
The touch-sensitive GUI is used to manage operations in the haptic interface (human engagement with digital reality). To regulate and balance primary and secondary driving operations effectively, the auditory interaction offers a variety of voice entries using natural language processing (NLP) voice recognition software. The visual interface gives the driver reviews via virtual server projections or monitor shows, basically telling them to offer supplementary information to the automobile monitoring system [29].
1.5.2.6 Space Crafts
One of the most crucial components of every space trip is the crew seating arrangement in the spacecraft. The seating arrangement in spacecraft is a perfect illustration of the majority of contemporary HMI systems, which show the crew’s technical and clinical trends in both regular and crises. One of the main concerns of the HMI systems in space applications is for the pilot to be able to access the control and display panels despite rotational and linear accelerations of the seats and roller, pitching, and vertical movements. There are two other essential components to the HMI-based automatic monitoring technologies used in spacecraft. Initially, it should be simple to operate and free of extraneous information that could confound the crew. Furthermore, there should be no uncertainty as it may cause imprecise navigation. The majority of interactions between operators at the ground control station and the unmanned aircraft vehicles (UAV) are supported by next-generation HMI systems, which carry out all transmission, command, and signal conditioning automatically. The adaptive human interface and interactions offer three-tier processes of detecting, judging, and remodeling for anything from intelligent transportation systems to guidance systems, safety procedures, and mission systems [29].
1.5.2.7 Car Wash System
Automatic car washing stations are common in developed countries. It is a structure of several electronic pieces of electronic hardware that deliver car cleaning and maintenance services. They use cleaning supplies, such as water, detergents, several sprayers, scrubbing rollers and brushes, and a dryer system. They promote the more economical use of water and provide a convenient and faster method of maintaining vehicles. HMIs can be beneficial in applications, such as these to further ease the communication between the user and the machine. It can offer customized services such as rinsing, drying a wet vehicle, or cleaning it thoroughly, etc. Mumtaz et al.[30] propose an HMI-based automatic car servicing system using the (HMI) weintek 8071IP along with the software easy builder version 6.03 visual monitoring and control.
