Robotics and Automation in Industry 4.0 E-Book
36,10 €
Mehr erfahren.
- Herausgeber: Bentham Science Publishers
- Kategorie: Fachliteratur
- Sprache: Englisch
Robotics and Automation in Industry 4.0 explores the transformative role of robotics, automation, and emerging technologies in the modern industrial landscape. The book is divided into four comprehensive sections, each focusing on key areas of Industry 4.0. These are: 1) Robotics: Applications and Advancements, 2) Renewable Energy Applications, 3), FinTech, and 4) Multidisciplinary approaches. It compiles 13 chapters offering insights into the latest advancements and provides practical guidance for navigating the evolving industrial landscape.
Robotics and Automation in Industry 4.0 provides a comprehensive overview of technical advancements within the context of Industry 4.0. Chapters cover nanorobotics, deep Q-learning for robot path planning, and the design of smart devices. The content also explores the integration of renewable energy in industrial processes and the impact of Industry 4.0 on manufacturing. Additionally, it explains FinTech innovations, including blockchain applications in healthcare and IoT systems. The final section addresses deep learning, IT sector attrition, and solid-state devices, emphasizing a multidisciplinary approach to modern challenges.
This book is a valuable resource for professionals, researchers, and students seeking to understand the implications of Industry 4.0 for different industries.
Readership
Professionals, researchers, and students.
Das E-Book können Sie in Legimi-Apps oder einer beliebigen App lesen, die das folgende Format unterstützen:
Seitenzahl: 383
Veröffentlichungsjahr: 2024
Ähnliche
BENTHAM SCIENCE PUBLISHERS LTD.
End User License Agreement (for non-institutional, personal use)
This is an agreement between you and Bentham Science Publishers Ltd. Please read this License Agreement carefully before using the book/echapter/ejournal (“Work”). Your use of the Work constitutes your agreement to the terms and conditions set forth in this License Agreement. If you do not agree to these terms and conditions then you should not use the Work.
Bentham Science Publishers agrees to grant you a non-exclusive, non-transferable limited license to use the Work subject to and in accordance with the following terms and conditions. This License Agreement is for non-library, personal use only. For a library / institutional / multi user license in respect of the Work, please contact: [email protected].
Usage Rules:
All rights reserved: The Work is the subject of copyright and Bentham Science Publishers either owns the Work (and the copyright in it) or is licensed to distribute the Work. You shall not copy, reproduce, modify, remove, delete, augment, add to, publish, transmit, sell, resell, create derivative works from, or in any way exploit the Work or make the Work available for others to do any of the same, in any form or by any means, in whole or in part, in each case without the prior written permission of Bentham Science Publishers, unless stated otherwise in this License Agreement.You may download a copy of the Work on one occasion to one personal computer (including tablet, laptop, desktop, or other such devices). You may make one back-up copy of the Work to avoid losing it.The unauthorised use or distribution of copyrighted or other proprietary content is illegal and could subject you to liability for substantial money damages. You will be liable for any damage resulting from your misuse of the Work or any violation of this License Agreement, including any infringement by you of copyrights or proprietary rights.Disclaimer:
Bentham Science Publishers does not guarantee that the information in the Work is error-free, or warrant that it will meet your requirements or that access to the Work will be uninterrupted or error-free. The Work is provided "as is" without warranty of any kind, either express or implied or statutory, including, without limitation, implied warranties of merchantability and fitness for a particular purpose. The entire risk as to the results and performance of the Work is assumed by you. No responsibility is assumed by Bentham Science Publishers, its staff, editors and/or authors for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products instruction, advertisements or ideas contained in the Work.
Limitation of Liability:
In no event will Bentham Science Publishers, its staff, editors and/or authors, be liable for any damages, including, without limitation, special, incidental and/or consequential damages and/or damages for lost data and/or profits arising out of (whether directly or indirectly) the use or inability to use the Work. The entire liability of Bentham Science Publishers shall be limited to the amount actually paid by you for the Work.
General:
Any dispute or claim arising out of or in connection with this License Agreement or the Work (including non-contractual disputes or claims) will be governed by and construed in accordance with the laws of Singapore. Each party agrees that the courts of the state of Singapore shall have exclusive jurisdiction to settle any dispute or claim arising out of or in connection with this License Agreement or the Work (including non-contractual disputes or claims).Your rights under this License Agreement will automatically terminate without notice and without the need for a court order if at any point you breach any terms of this License Agreement. In no event will any delay or failure by Bentham Science Publishers in enforcing your compliance with this License Agreement constitute a waiver of any of its rights.You acknowledge that you have read this License Agreement, and agree to be bound by its terms and conditions. To the extent that any other terms and conditions presented on any website of Bentham Science Publishers conflict with, or are inconsistent with, the terms and conditions set out in this License Agreement, you acknowledge that the terms and conditions set out in this License Agreement shall prevail.Bentham Science Publishers Pte. Ltd. 80 Robinson Road #02-00 Singapore 068898 Singapore Email: [email protected]
PREFACE
An automated machine that performs like a human and replaces the efforts of humans is termed a robot. When these kinds of devices get interlinked with other interdisciplinary technologies for better efficiency, speed, accuracy, output, management and operation, it is termed robotics. Research on the interdisciplinary branches of mechanical devices, data science, the Internet of things, solid-state devices, and others can together make automation more efficient, and it can lead to a revolution in robotics and automation in Industry 4.0. Whenever we say Industry 4.0, it means the fourth Industrial Revolution, which will not only lead the manufacturing sector to a greater height, but will also transform the service and communication sector. Industrial Revolution 4.0 will mostly deal with unmanned vehicles, 3D printing, advanced robotics and new materials. This revolution will support organizational efficiency. Many techniques and areas are designed, such as cloud computing, machine learning, nanobots, supply chain management, information security, etc. Hence, the main motive of this book is to explore the application and different technologies associated with robotics and automation in Industry 4.0.
The Objective of the Book
The objective of this book is to get insights into the tools and technologies of the automation-based Industrial Revolution, which mostly increase organizational efficiency by improving manufacturing, communication and services using new technologies. It also helps to understand different aspects of robotics and automation. It can help different users such as students, research scholars, academicians, industry people, etc.
Organization of the Book
The book contains 13 chapters that are organized into four sections as follows. Section 1 discusses the application and advancement of robotics. Section 2 highlights the application of renewable energy, which indicates the demand for a sustainable future. Section 3discusses the systematic analysis and application of financial technology. Section 4 discusses some multidisciplinary areas along with techniques and applications.
Section 1: Robotics: Applications and Advancements (Chapters 1-3)
The section discusses different applications and advancements of robotics.
Chapter 1
This chapter discusses different types, principles and applications of nanorobots that are used in different emerging areas. It also discusses the principles of different explored and programmed bots for repairing specific targets.
Chapter 2
This chapter discusses robot path planning systems in a dynamic environment. The Deep Q-learning technique is used in this chapter by using a neural network. It helps to avoid different obstacles in the environment, which are dynamically created by the user.
Chapter 3
This chapter only focuses on innovative design analysis of customized solar frames but not the working of the solar frames or air purifiers. This innovative design is going to change the concept of cycling in the future.
Section 2: Application of Renewable Energy: Power for a Sustainable Future (Chapters 4-5)
The section discusses different renewable energy applications for power management based on a sustainable future.
Chapter 4
This chapter discusses a hybrid optimization technique for profit-based unit commitment. It solves the uncertainty issues for energy source management in wintertime and summertime. It helps reduce several noises that are related to gases that are harmful to fossil fuels and cause diseases and sicknesses.
Chapter 5
This chapter illustrates the impact of Industry 4.0 based on the manufacturing system. The chapter contains several challenges and opportunities based on data production and integrating new technology in the sector of manufacturing.
Section 3: FinTech: Systematic Analysis and its Applications (Chapters 6-8)
The section discusses the systematic analysis of financial technology based on new and innovative applications.
Chapter 6
In this chapter, the authors narrow down the overview of smart financial businesses and their complex challenges. It helps to manage the entire smart FinTech Ecosystem using the fusion of artificial intelligence and data science. It helps to enable smart FinTech and discusses some research problems among global academic and researcher communities.
Chapter 7
This chapter provides insight into blockchain methodology applied in IoT healthcare security. It helps to provide the potential for the medical care environment. It also discusses how customary clinical frameworks and organizations have been occupied with the medical services area throughout the previous years.
Chapter 8
This chapter provides a design development for pharmaceutical applications through the fusion of IoT and blockchain. In this chapter, it is suggested to avoid counterfeit drugs, delivering the pharmaceutical products to customers at the right time, and environmental parameters such as temperature and humidity are also monitored throughout the supply chain to avoid spoilage of pharmaceutical products.
Section 4: Multidisciplinary Approach: Understanding, Benefits and Applications (Chapters 9-13)
The section discusses a different multidisciplinary approach based on new technologies and techniques that help in the automation system.
Chapter 9
This chapter presents a holistic view of attrition and retention of employees on psychological aspects during this cut-throat competitive environment in India. Biology has a little role in management, though one cannot ignore biology in psychology. In broader terms, attrition is somehow related to psychology, and psychology and physiology are two sides of a coin.
Chapter 10
This chapter provides a system for predicting the changes in the ecosystem. The changes in the ecosystem affect the living creatures who depend upon the ecosystem. One of the subsets of machine learning that play a vital role in saving the lives of living creatures is deep learning, which is used in this work for prediction purposes.
Chapter 11
This chapter thoroughly examines solid-state drive subjects, ranging from the physical features of a flash memory cell to the design pattern. The subjects pertaining to the flash translation layer are described within the context of interconnected system-level operations.
Chapter 12
This chapter discusses profit-based unit commitment using the global and local search methods. It suggests the combination of chaotic maps with Harris Hawks Optimizer and chaotic Sine Cosine Algorithm advancement strategy and assesses the execution of the proposed improved technique considering Plug-in Electric Vehicles.
Chapter 13
This chapter discusses the classification of deep learning techniques for object detection. It uses an audit on a machine learning approach for classification. The applications of the protest location have been summarized, along with the diverse approaches to the location of the objects using template-based, portion-based, and region-based methods.
List of Contributors
Nanorobots: Types, Principles and Applications
Parkarsh Kumar1,Santosh Kumar Das1,*Abstract
Nanobots or Nanorobots are one of the emerging applications in both nanotechnology and robotics. These bots are programmed to carry out specific applications for a specific purpose. Owing to their properties such as smaller volume, efficiency and accuracy, nanobots are being explored in different fields of study, especially nanomedicine, automation, drug delivery, chemistry, aerospace and others. These bots can be programmed and explored in such a way that they can be used to repair the specific target in the body, which is impossible using bare hands. In this chapter, we are going to explore such types of applications and their principles.
INTRODUCTION
In 1959, Professor Richard Feynman, through his talk “Plenty of Room at the Bottom”, laid the fundamentals of nanotechnology [1]. In one of the chapters, he discussed molecular machines, the application of which includes nanorobotic surgery, drug delivery, and others. As suggested by Professor Feynman, the miniaturization of robotics has been explored, and advancements have been made in this field over time. These are types of nanodevices whose application can be explored in many fields, but currently, it is mostly being explored in the field of biomedicals. One of the first studies on nanobots was conducted by Robert Freitas, which is based on the principle of molecular manufacturing [2]. This nanodevice was created to function like an artificial erythrocyte.
Compared to natural red cells, these artificial devices were capable of transporting a similar amount of carbon dioxide and 236 times more oxygen to tissues. These devices were fabricated using hard diamondoid materials and consist of different types of chemicals, pressure and thermal sensors to monitor complex responses and behavior. Since then, nanobots have evolved in multidimensional fields with increasing applications. Mavroidis et al. [3] explained theevolution of fully
functional autonomous nanorobots and the integration of different components into a system. Owing to its small size, durability, self-replication and mobility, multiple applications of nanobots have been developed to solve problems related to the environment, agriculture, biology and medicine. The design of different nanorobots is inspired by different kinds of species present in the environment to perform specific operations. These nanobots seem to be very promising in areas of invasive surgery, drug delivery, contamination screening, controlling pests and plant viruses, antimicrobial activity, breaking blood clots, parasite removals, and others [4-6]. In order to scale up, researchers across different organizations are trying to overcome limitations in terms of high-quality design, cost analysis, biocompatibility, interfacing with blood, which is viscous, and control issues. Overcoming the challenges will help in achieving unlimited applications especially in the field of biomedical. The current trend of nanorobots in precision medicine, which includes surgeries, therapy, imaging and diagnosis, is being studied [7]. These bots will have the ability to locate specific positions in the body and deliver the precise dosage. With noninvasive medication and various groundbreaking innovations, it is expected that the market of nanobots will exponentially increase to 21.45 billion dollars in 2030 from its present value of 6.19 billion dollars.
Fig. (1)) Types of nanorobots.TYPES
Further, we are going to discuss different types of nanobots based on a few parameters such as design, nanorobotic devices, actuation types and manufacturing approaches. These are just a few parameters, which can be further subdivided into many categories. Some types of robots based on the subdivision of parameters can be similar in nature. Nanobots classification and their respective subcategories are shown in Fig. (1).
On the basis of design: Based on the applications, many designs of nanobots have been proposed, but they are generally classified into three categories on the basis of design. Arvidsson et al. described them as Helices, DNA Nanobots and Nanorods [8-11]. They are discussed in detail in further sections.On the basis of actuation: In general, the movement of nanobots takes place in a medium having a low Reynolds number, where inertial force is negligible as compared to viscous force. This makes it difficult to operate, and hence nanobots need to be uninterruptedly powered for actuation. Since it is very difficult to load energy sources on nanorobots, researchers have started focusing on actuation technologies for nanorobotics. Xu et al. [12] summarized different types of actuation techniques into two sub-categories, which are self-actuation and external field actuation. In order to actuate nanobots using a variant magnetic field, as explained by Dreyfus et al. [13], it is subject to get a constant and oscillating magnetic field along the horizontal and perpendicular direction, respectively. Later, many other techniques, such as U-shaped, fish-like structure, freestyle swimmer, sea star and other types of magnetically actuated nanobots, have been proposed for different applications. Although there is a safety issue related to high-intensity magnetic fields, strong pungent power and no harm to the biological system make it viable to experiment on. We know that an electric and magnetic field can be transformed into each other, so robotic systems with certain conditions and without complicated mechanical parts were proposed, which could utilize an external electric field for actuation. For actuation, some researchers use the finite element technique to produce a magnetic field using coil assembly. The concept of quad nanopore devices is also used for the purpose of actuation. Other types of external field actuation include light field actuation and acoustic actuation. Experiments were conducted to establish a relationship between laser intensity and the speed of nanoswimmers for biomedical and soft matter applications. Based on such principles, needle-shaped nanoswimmers, electrochemical actuators, and photoresponsive DNA signaling molecules have been designed over time. On the other hand, researchers used the principle of ultrasonic bubble-gathering effect for the movement of robots. Rod-shaped nanobots that can rotate, arrange, suspend and assemble in the ultrasonic range are fabricated. Some researchers achieve cell manipulation and actuation using acoustic radiation force in standing waves. In the case of self-actuation methods, the static balance of nanorobots gets disturbed for the purpose of movement. Before breaking the static balance, an asymmetrical chemical field needs to be created. Whitesides et al. [13] was one of the first researchers who performed self-actuation in robots by converting chemical energy into kinetic energy using the principle of oxidation-reduction. Later, tubular and platinum-based V-shaped robots were developed for self-actuation. Some researchers even worked on a hybrid Au/Pt (z-shaped) self-actuation system for targeted drug delivery. These chemical self-actuation devices were biocompatible, but these methods also have safety issues, short action time and nontoxic urea. Biological self-actuation can be used to overcome the issue of safety. These types of nanobots have been developed by taking inspiration from nature. Flagella and Magnetotactic bacteria give promising results for actuating force and smart nanobots. Droplets of different bacteria were placed in a solution of glucose and water to generate movement with the help of ethylenediaminetetraacetic acid [14].On the basis of devices: Nanobots can be broadly classified into four categories. Mavroidis et al. [3] mentioned these four systems as Nanomanipulators, BioNano Robotics, Magnetically Guided Nanorobotics and Bacteria-based Nanorobotics. The microscopic viewing system that helps in viewing small-scale objects is termed the nanomanipulator. Scanning probe microscopes are used to enlarge images, which helps in a better understanding of devices and manipulation at atomic scales. Some biological elements, such as DNA and proteins, are capable of generating force or signal at the cellular level. Devices made from these elements are called nanocomponents, and the robotic system is called the bio nanorobotic system. Developed in 2003, these systems are now capable of transformation into motors, sensors, joints and other components of robotic systems. It has been hard to develop full-scale nanorobots, but with the development of the ferromagnetic material-based magnetically guided nanorobotic system, nanobots with six degrees of freedom (DOF) can be realized and external magnetic force can be used for propulsion and actuation. Another type, called bacteria-based nanorobotic system, is developed by taking information from nature [15]. Although it has similarities with both magnetic and bio nanorobotic systems, it differs in terms of design, control and guidance.On the basis of manufacturing: Based on the approaches for manufacturing nanorobots, they can either be classified as NUbots or bacteria-based [16]. The bacteria-based approach uses flagellum and electromagnetic field for propulsion and control of motion by taking inspiration from microorganism bacterium such as E. coli. It is the same as what we have discussed in other classifications of nanobots. Nubots are also called nucleic acid robots. They are a type of molecular machine thatis fabricated and activated using molecules, proteins and DNA.These are the limited classifications. Further subcategories of nanobots can be created by conducting a comparative study on nanobots on the basis of different parameters related to them.
Applications and Recent Developments
We have discussed different types of nanobots, their principle and their fabrication approaches. It is yet to be fully scaled, but based on the approaches, it has been slightly used in different parts of devices, especially in biomedical devices. Experts from different fields of study came together to make advancements in nanobots, which is certainly the future of precision medicine, non-invasive diagnostics, environmental science, agriculture, military, space and others. Most of the devices are still in the preliminary phase of development, and lots of research and trials need to be performed in order to make them commercially and economically viable.
With research advancement and commercialization, full-scale, economically viable nanobots can be developed to solve problems related to medicine, like cancer treatment, by replacing damaged neurons or by transferring specific drugs to specific sites, thereby safeguarding patients from the harmful process of chemotherapy [4] [13]. It can also be used in the body to monitor abnormalities and provide noninvasive ways to treat them. Using this kind of surveillance technique, it can help in checking the contents of blood and provide warning about any kind of possible diseases. Other medical problems that can be monitored and diagnosed are blood clots, body clots, diabetes, gout, and others.
With rapid development in the field of materials and biochemistry, the future of nanobots is near, but challenges remain in terms of removal of toxicity, proper miniaturization of devices, compatibility, energy harvesting, positional nano assembly, noise interference and dynamics of robotic systems [17]. Some decision making, AI-powered tools and machine learning can also be integrated in the future for better outcomes [18-23]. Some challenges are also present during the designing of nanorobots, such as high complexity, interface design, cost, etc. There are several post-quantum cryptography techniques available to implement security in the nanorobots [24-27]. They help to reduce several attacks in the context of different applications. Lightweight cryptography also helps to protect against some attacks [28-34].
CONCLUSION
The need to describe rarefied flows in a variety of applications that involve micro and nanoscale pores or channels has stimulated the development of a multitude of theoretical and numerical methodologies. A comparison of the predictions of the mesoscopic approaches with those of the Navier-Stokes formulation complemented by a non-slip flow condition revealed that the latter can be safely employed for very small Knudsen number values only. The DSMC method was used to determine the flow field in different types of porous media and processes.
REFERENCES
[1]Feynman R.P.. Plenty of room at the bottom., Eng. Sci.. 23(5): 22-36.1959;[2]Frcitas R.A.. Exploratory design in medical nanotechnology: A mechanical artificial red cell., Artif. Cells Blood Substit. Immobil. Biotechnol..1998; 26(4): 411-430. [CrossRef] [PubMed][3]Mavroidis C., Ferreira A.. , . Nanorobotics.. Berlin, Germany: Springer-Verlag; 2013. Nanorobotics: Past present and future.; p. 3.-27.[4]Nistor M.T., Rusu A.G.. , . Polymeric Nanomaterials in Nanotherapeutics. Elsevier; 2019. Nanorobots with applications in medicine.; p. 123.-149.[5]Saadeh Y., Vyas D.. Nanorobotic applications in medicine: Current proposals and designs., Am. J. Robot. Surg.. 1(1): 4-11.2014; [CrossRef] [PubMed][6]Cavalcanti A., Wood W.W., Kretly L.C., Shirinzadeh B.. Computational nanorobotics: Agricultural and environmental perspectives., Nanomedicine. 2: 82-87.2003;[7]Soto F., Wang J., Ahmed R., Demirci U.. Medical micro/nanorobots in precision medicine., Adv. Sci.. 7(21): 2002203.2020; [CrossRef] [PubMed][8]Qiu F., Nelson B.J.. Magnetic helical micro and nanorobots: Toward their biomedical applications., Engineering. 1: 021-026.2015;[9]Zhou H., Mayorga-Martinez C.C., Pané S., Zhang L., Pumera M.. Magnetically driven micro and nanorobots., Chem. Rev.. 121(8): 4999-5041.2021; [CrossRef] [PubMed][10]Xu Y., Bian Q., Wang R., Gao J.. "Micro/nanorobots for precise drug delivery via targeted transport and triggered release: A review". Int. J. Pharm.. 616: 121551.2022; [CrossRef] [PubMed][11]Wang Z., Xu Z., Zhu B., Zhang Y., Lin J., Wu Y., Wu D.. Design, fabrication and application of magnetically actuated micro/nanorobots: A review., Nanotechnology. 33(15): 152001.2022; [CrossRef] [PubMed][12]Xu K., Liu B.. Recent progress in actuation technologies of micro/nanorobots., Beilstein J. Nanotechnol.. 12: 756-765.2021; [CrossRef] [PubMed][13]Dreyfus R., Baudry J., Roper M.L., Fermigier M., Stone H.A., Bibette J.. Microscopic artificial swimmers., Nature. 437(7060): 862-865.2005; [CrossRef] [PubMed][14]Wang L., Hortelão A.C., Huang X., Sánchez S.. Lipase-powered mesoporous silica nanomotors for triglyceride degradation., Angew. Chem. Int. Ed.. 58(24): 7992-7996.2019; [CrossRef] [PubMed][15]Behkam B., Sitti M.. Bacterial flagella-based propulsion and on/off motion control of microscale objects., Appl. Phys. Lett.. 90(2): 023902.2007; [CrossRef][16]Upadhye SS, Kothali BK, Apte AK, Kulkarni AA, Khot VS, Patil AA, Mujawar RN.. A review ON nanorobots., Am. J. PharmTech Res.. 9(2): 1-20.2019;[17]Padshala R., Rajan V., Patani P.. Nanobots: Future and Development., J. Pharm. Negat. Results. 7: 1967-1975.2022; [CrossRef][18]Decision-Making C.. , . Systems in Engineering.. IGI Global; 2023.[19]Constraint Decision-Making Systems in Engineering. IGI Global; 2022.[20]AI-empowered knowledge management. Springer; 2021.[21]A Non-Linear Multi-Objective Technique for Hybrid Peer-to-Peer Communication., Inf. Sci... 2023[22]Constraint Decision-Making Systems in Engineering. IGI Global; 2023. An optimal data communication system in wireless sensor network using artificial neural network.; p. 120.-134.[23]Data-Driven Approach for Bio-medical and Healthcare. Springer Nature; 2022.[24]Sarker A.. Error detection architectures for hardware/software co-design approaches of number-theoretic transform., IEEE Trans. Comput. Aided Des. Integrated Circ. Syst... 2022[25]Kermani M.M., Azarderakhsh R.. Integrating emerging cryptographic engineering research and security education., 2015 ASEE Annual Conference & Exposition.2015: 26-989.[26]Mozaffari-Kermani M.. , . Doctoral dissertation, The University of Western Ontario, Canada. 2011. Reliable and high-performance hardware architectures for the Advanced Encryption Standard/Galois Counter Mode..[27]Sarker A., Kermani M.M., Azarderakhsh R.. Efficient error detection architectures for postquantum signature falcon’s sampler and KEM SABER., IEEE Trans. Very Large Scale Integr. (VLSI) Syst..2022; 30(6): 794-802.[28]Canto A.C., Kaur J., Kermani M.M., Azarderakhsh R.. Algorithmic security is insufficient: A comprehensive survey on implementation attacks haunting post-quantum security., arXiv:2305.13544.. 2023[29]Azarderakhsh R., Koziel B., Langroudi S. F., Kermani M. M.. FPGA-SIDH: High-performance implementation of supersingular isogeny Diffie-Hellman key-exchange protocol on FPGA., Proc. eprint. 672: 1-18.2016;[30]Dubrova E., Ngo K., Gärtner J., Wang R.. Breaking a fifth-order masked implementation of crystals-kyber by copy-paste., Proceedings of the 10th ACM Asia Public-Key Cryptography Workshop.2023: 10-20. [CrossRef][31]Kaur J., Canto A.C., Kermani M.M., Azarderakhsh R.. A comprehensive survey on the implementations, attacks, and countermeasures of the current NIST lightweight cryptography standard., arXiv:2304.06222.. 2023[32]Kermani M. M., Azarderakhsh R., Xie J.. Error detection reliable architectures of Camellia block cipher applicable to different variants of its substitution boxes., IEEE Asian Hardware-Oriented Security and Trust (AsianHOST). : 1-6.2016[CrossRef][33]Cintas-Canto A., Kaur J., Kermani M.M., Azarderakhsh R.. ChatGPT vs. lightweight security: First work implementing the NIST cryptographic standard ASCON., arXiv:2306.08178.. 2023[34]Kermani M.M., Savas E., Upadhyaya S.J.. Guest editorial: Introduction to the special issue on emerging security trends for deeply-embedded computing systems., IEEE Trans. Emerg. Top. Comput.. 4(3): 318-320.2016; [CrossRef]Robot Path Planning in a Dynamic Environment Using Deep Q-Learning
Rifaqat Ali1,*,Preeti Chandrakar2Abstract
Robot path planning is a necessary requirement for today’s autonomous industry as robots are becoming a crucial part of the industry. Planning a path in a dynamic environment that changes over time is a difficult challenge for mobile robots. The robot needs to continuously avoid all the obstacles in its path and plan a suitable trajectory from the given source point to the target point within a dynamically changing environment. In this study, we will use Deep Q-Learning (Q-Learning using neural networks) to avoid the obstacles in the environment, which are being dynamically created by the user. The main aim of the robot is to plan a path without any collision with any of the obstacles. The environment is simulated in the form of a grid that initially contains information on the starting and the target location of the robot. Robots need to plan an obstacle-free path for the given points. The user introduces obstacles whenever he/she wishes during the simulation to make the environment dynamic. The accuracy of the path is judged by the path planned by the robot. Various architectures of neural networks are compared in the study that follows. Simulation results are analyzed for the evaluation of an optimized path, and the robot is able to plan a path in the dynamic environment.
INTRODUCTION
Nowadays, with the advancement of technology and a tremendous boom in the field of robotics, robots are taking over most mundane tasks that do not require much cognitive ability and can be performed easily by unskilled laborers. In 2010, Chen et al. [1] showed that robots used to serve and cater to customers in a human-interactive environment in restaurants. Later, Chen et al. [2] also proposed
the vacuum robots used for cleaning. In 2015, multiple robots communicated with each other over a shared network and carried loads from one fixed location to another fixed location, as shown by Das et al. [3]. Autonomous mobile robots have found their way into industries, military research programs, and many scientific research programs. The Schemes [4-6] present additional information on robots used in human-friendly environments like education, entertainment, surveillance and many more. As seen, robots continuously keep evading new human-centric and non-human-centric environments to find vast applications. Robots need to be as autonomous as possible i.e., they should possess the ability to navigate, find paths and perform various activities without the intervention of any kind to accomplish all such tasks. All the activities that are performed by autonomous mobile robots require the design and implementation of a path planning and path optimization algorithm at its core.
Robot path planning, being at the crux, plays a vital role in the design, implementation and manufacturing of autonomous robots. If implemented effectively, path planning significantly improves the following parameters in an autonomous robot:
Robot Accuracy: The algorithm must produce next to zero errors because the robot is expected to work in human-friendly environments where the slightest errors can be catastrophic. Hence, there is a need to test this out and make sure the robot is accurate enough that it stands firm on its capabilities.
Task Repeatability: Once the implementation of the path planning algorithm is complete, including the training phase of the robot, it can perform the same task hundreds of times with high accuracy and effectiveness without any slack.
Product Quality: Based on accuracy and repeatability, we can directly conclude that our robot has been trained well and can assume a result that will depict the high-quality work of our robot.
One can define path planning as the continuous locomotion of a robot from the initial/starting configuration to the final/goal configuration in an unknown environment. The environment in which the robot moves consists of free space and obstacles. The robot needs to ensure that it does not collide with any obstacle during its course. Path optimization deals with finding the path with the least cost and distance and which consumes the least amount of time. Fig. (1a) shows an example environment with obstacles and defined configurations for start and goal states. Fig. (1b) shows an example of a path planned in the shown environment.
Structure of the Paper
This article is organized into 7 sections. Following the introduction, Section 2 presents different approaches and work, which were used by various researchers in the past to solve the problem. Also, the section ends with a description of the approach used in this article. Section 3 of the article describes the methodology used to solve the problem in addition to the nuances of the algorithm. Section 4 discusses the experimental setup and the various technologies used, along with the various parameters of the algorithm used during the experiment. Section 5 analyses the results and the performance of the experiment with the help of some graphs. The article comes to an end by presenting a conclusion for the experiment in Section 6.
Fig. (1)) (a) Environment with obstacles and start and goal configurations, and (b) one out of many possible paths from the start to the goal configuration.RELATED WORKS
In recent decades, many approaches have been devised by researchers to find a solution to the problem of path planning and optimization for autonomous mobile robots. These approaches range from the use of graph-based algorithms to the use of contemporary neural networks to implement deep learning and reinforcement learning algorithms. Some of these approaches and algorithms have been briefly described as follows:
Graph-Based Approach
In this type of approach, the environment is considered as a connected network consisting of nodes and edges similar to a graph data structure. The nodes that constitute the obstacles are considered forbidden since the robot is not allowed to use these nodes while ascertaining a path from the initial to the goal state. All other nodes form the free space of the environment and are traversable as the robot moves. Classical graph traversing algorithms, such as the Breadth-First Search (BFS) and the Depth First Search (DFS), are fruitful in determining solutions to the path planning problem. Single-source shortest path algorithms, such as the Dijkstra algorithm and the Bellman-Ford algorithm, are also capable of determining the path from the source node (initial state) to the destination node (goal node). Terzimehic et al. [7] successfully used the algorithms mentioned above to find solutions to the problem.
The major drawback of the algorithms stated above was (1) the amount of time they consumed as the size of the environment increased and (2) all the nodes in the environment had to be traversed before the most optimal path could be determined. Heuristic approaches overcame such drawbacks to an extent and enhanced the performance of traditional algorithms. A heuristic at a node can be defined as a function or attribute that the algorithm uses to determine which neighboring node is most likely to result in an optimized path to the goal node. The most famous heuristic-based algorithm is the A* [8]. Many algorithms like the Iterative Deepening A* (IDA*) [9], Anytime Repairing A* (ARA*) [10], Jump Point Search (JPS) [11], Theta* [12] etc., which are modified versions of the A* algorithm, fall under the category of heuristic search algorithms. Nature-inspired heuristic algorithms such as the Genetic Algorithm (GA) [13, 14], Artificial Bee Colony (ABC) [15], Cuckoo Search Algorithm [16], and Firefly Algorithm (FA) [17] have been researched and developed over decades and fall under the category of heuristic and meta-heuristic algorithms.
Fuzzy Logic Approach
In 1965, Prof. Zadeh [18] laid the foundation for fuzzy sets. Fuzzy logic governs the implementation of fuzzy sets, which provide a mathematical notation for the representation of fuzzy logic. Traditional logic (also known as binary logic) tries to evaluate problems based on two discrete truth values, namely 'true' and 'false' (0 or 1). The major drawback of traditional logic is that it cannot account for uncertainty in real-world problems such as linguistics. Fuzzy logic overcomes this drawback by defining a membership function that determines the degree of membership of each element in the fuzzy set. The membership values of the elements in the set can be anywhere in the range of 0 and 1. The process of converting a crisp set to a fuzzy set is called fuzzification, and the process of converting a fuzzy set back to a crisp set is called defuzzification. The problem of path planning using fuzzy logic is solved mostly by dividing the problem into simpler and smaller sets of tasks, where actions planned to achieve a defined set of objectives are based on fuzzy rule statements.
Later, in 1986, Vachtsevanos and Hexmoor [19] suggested the idea of using fuzzy logic to solve the problem of autonomous mobile robot path planning. A set of rules described with the help of the if-then structure can be phrased using fuzzy logic, which in turn controls the decision-making process of the robot path planning algorithm in a dynamic environment. Heading into the year 2013, Chang and Taeseok [20] used a fuzzy inference model along with the process of fuzzification, defuzzification, and sensor fusion to search for the goal state in an unknown dynamic environment. Valdez et al. [21], in 2014, used fuzzy logic to adapt specific parameters to optimize the path planning algorithms. Optimization methods mainly cover algorithms such as Particle Swarm Optimization, Ant Colony Optimization, etc., which utilize fuzzy logic to enhance performance and efficiency. Many other fuzzy logic-based solutions are described in other studies [22-24].
Artificial Neural Network-Based Approach
Artificial Neural Networks (referred to as Neural Networks later in the text) have been inspired by the biological neural networks present in the human brain. Neural Networks are complex networks of neurons that are capable of processing data at high speeds and identifying relationships between data that are not easily perceivable. These relationships present among the data help establish patterns, which can be used to generalize many solutions to real world problems. Of late, there has been an increasing application of neural networks in forecasting, financial services, fraud detection, stock market price prediction, etc.
In 1988, Zacksenhouse et al. [25] used Neural Networks to perform cue-based motion planning. This laid the foundation for Neural Networks being used for motion planning applications. In 2010, Nichols et al. [26] used a Spiking Neural Network for robot navigation along a wall. Antonelo et al. [27] showed the use of a learning process using Recurrent Neural Networks (RNN) in the same year to devise goal-oriented robot navigation. In 2011, Chi et al. [28] managed to make a robot traverse through a maze by using Neural Networks to recognize maze patterns and avoid arbitrary obstacles. Motlagh et al. [29], in 2014, presented a technique based on reinforcement learning using Neural Networks to enable a mobile robot to learn and navigate an environment constructed by experts. As seen, Neural Networks have been used time and again to tackle the problem of path planning and optimization and continue to be a leading front for research.
