Material-Integrated Intelligent Systems E-Book

• Herausgeber: Wiley-VCH Verlag GmbH & Co. KGaA
• Kategorie: Fachliteratur
• Sprache: Englisch

Seitenzahl: 1215

Veröffentlichungsjahr: 2017

Beschreibung

Combining different perspectives from materials science, engineering, and computer science, this reference provides a unified view of the various aspects necessary for the successful realization of intelligent systems.
The editors and authors are from academia and research institutions with close ties to industry, and are thus able to offer first-hand information here. They adopt a unique, three-tiered approach such that readers can gain basic, intermediate, and advanced topical knowledge. The technology section of the book is divided into chapters covering the basics of sensor integration in materials, the challenges associated with this approach, data processing, evaluation, and validation, as well as methods for achieving an autonomous energy supply. The applications part then goes on to showcase typical scenarios where material-integrated intelligent systems are already in use, such as for structural health monitoring and smart textiles.

Leseprobe

Contents

Cover

Title Page

Copyright

Foreword

Preface

Part One: Introduction

Chapter 1: On Concepts and Challenges of Realizing Material-Integrated Intelligent Systems

1.1 Introduction

1.2 System Development Methodologies and Tools (Part Two)

1.3 Sensor Technologies and Material Integration (Part Three and Four)

1.4 Signal and Data Processing (Part Five)

1.5 Networking and Communication (Part Six)

1.6 Energy Supply and Management (Part Seven)

1.7 Applications (Part Eight)

References

Part Two: System Development

Chapter 2: Design Methodology for Intelligent Technical Systems

2.1 From Mechatronics to Intelligent Technical Systems

2.2 Self-Optimizing Systems

2.3 Design Methodology for Intelligent Technical Systems

References

Chapter 3: Smart Systems Design Methodologies and Tools

3.1 Introduction

3.2 Smart Electronic Systems and Their Design Challenges

3.3 The Smart Systems Codesign before SMAC

3.4 The SMAC Platform

3.5 Case Study: A Sensor Node for Drift-Free Limb Tracking

3.6 Conclusions

Acknowledgments

References

Part Three: Sensor Technologies

Chapter 4: Microelectromechanical Systems (MEMS)

4.1 Introduction

4.2 Materials

4.3 Microfabrication Technologies

4.4 MEMS Sensor

4.5 Sensor Systems

References

Chapter 5: Fiber-Optic Sensors

5.1 Introduction to Fiber-Optic Sensors

5.2 Trends in Sensor Fabrication and Miniaturization

5.3 Fiber-Optic Sensors for Structural Health Monitoring

5.4 Frequency Modulation Sensors

5.5 Intensity Modulation Sensors

5.6 Some Challenges in SHM of Composite Materials

5.7 Summary

Acknowledgments

References

Chapter 6: Electronics Development for Integration

6.1 Introduction

6.2 Chip Package Miniaturization Technologies

6.3 Elastic Circuits

6.4 2.5D Rigid Thermoplastic Circuits

6.5 Large Area Textile-Based Circuits

6.6 Conclusions and Outlook

References

Part Four: Material Integration Solutions

Chapter 7: Sensor Integration in Fiber-Reinforced Polymers

7.1 Introduction to Fiber-Reinforced Polymers

7.2 Applications of Integrated Systems in Composites

7.3 Fiber-Reinforced Polymer Production and Sensor Integration Processes

7.4 Electronics Integration and Data Processing

7.5 Examples of Sensors Integrated in Fiber-Reinforced Polymer Composites

7.6 Conclusion

Acknowledgments

References

Chapter 8: Integration in Sheet Metal Structures

8.1 Introduction

8.2 Integration Technology

8.3 Forming of Piezometal Compounds

8.4 Characterization of Functionality

8.5 Fields of Application

8.6 Conclusion and Outlook

References

Chapter 9: Sensor and Electronics Integration in Additive Manufacturing

9.1 Introduction to Additive Manufacturing

9.2 Overview of AM Processes

9.3 Links between Sensor Integration and Additive Manufacturing

9.4 AM Sensor Integration Case Studies

9.5 Conclusion and Outlook

Abbreviations

References

Part Five: Signal and Data Processing: The Sensor Node Level

Chapter 10: Analog Sensor Signal Processing and Analog-to-Digital Conversion

10.1 Operational Amplifiers

10.2 Analog-to-Digital Converter Specifications

10.3 Data Converter Architectures

10.4 Low-Power ADC Designs and Power Classification

10.5 Moving Window ADC Approach

References

Chapter 11: Digital Real-Time Data Processing with Embedded Systems

11.1 Levels of Information

11.2 Algorithms and Computational Models

11.3 Scientific Data Mining

11.4 Real-Time and Parallel Processing

References

Chapter 12: The Known World: Model-Based Computing and Inverse Numeric

12.1 Physical Models in Parameter Identification

12.2 Noisy Data Due to Sensor and Modeling Errors

12.3 Coping with Noisy Data: Tikhonov Regularization and Parameter Choice Rules

12.4 Tikhonov Regularization

12.5 Rules for the Choice of the Regularization Parameter

12.6 Explicit Minimizers for Linear Models

12.7 The Soft-Shrinkage Iteration

12.8 Iterative Regularization Schemes

12.9 Gradient Descent Schemes

12.10 Newton-Type Regularization Schemes

12.11 Numerical Examples in Load Reconstruction

References

Chapter 13: The Unknown World: Model-Free Computing and Machine Learning

13.1 Machine Learning – An Overview

13.2 Learning of Data Streams

13.3 Learning with Noise

13.4 Distributed Event-Based Learning

13.5 ε-Interval and Nearest-Neighborhood Decision Tree Learning

13.6 Machine Learning – A Sensorial Material Demonstrator

References

Chapter 14: Robustness and Data Fusion

14.1 Robust System Design on System Level

References

Part Six: Networking and Communication: The Sensor Network Level

Chapter 15: Communication Hardware

15.1 Communication Hardware in Their Applications

15.2 Requirements for Embedded Communication Hardware

15.3 Overview of Physical Communication Classes

15.4 Examples of Wired Communication Hardware

15.5 Examples of Wireless Communication Hardware

15.6 Examples of Optical Communication Hardware

15.7 Summary

References

Chapter 16: Networks and Communication Protocols

16.1 Network Topologies and Network of Networks

16.2 Redundancy in Networks

16.3 Protocols

16.4 Switched Networks versus Message Passing

16.5 Bus Systems

16.6 Message Passing and Message Formats

16.7 Routing

16.8 Failures, Robustness, and Reliability

16.9 Distributed Sensor Networks

16.10 Active Messaging and Agents

References

Chapter 17: Distributed and Cloud Computing: The Big Machine

Reference

Chapter 18: The Mobile Agent and Multiagent Systems

18.1 The Agent Computation and Interaction Model

18.2 Dynamic Activity-Transition Graphs

18.3 The Agent Behavior Class

18.4 Communication and Interaction of Agents

18.5 Agent Programming Models

18.6 Agent Processing Platforms and Technologies

18.7 Agent-Based Learning

18.8 Event and Distributed Agent-Based Learning of Noisy Sensor Data

References

Part Seven: Energy Supply

Chapter 19: Energy Management and Distribution

19.1 Design of Low-Power Smart Sensor Systems

19.2 A Toolbox for Energy Analysis and Simulation

19.3 Dynamic Power Management

19.4 Energy-Aware Communication in Sensor Networks

19.5 Energy Distribution in Sensor Networks

References

Chapter 20: Microenergy Storage

20.1 Introduction

20.2 Energy Harvesting/Scavenging

20.3 Energy Storage

20.4 Summary and Perspectives

References

Chapter 21: Energy Harvesting

21.1 Introduction

21.2 Mechanical Energy Harvesters

21.3 Thermal Energy Harvesters

21.4 Radiation Harvesters

21.5 Summary and Perspectives

References

Part Eight: Application Scenarios

Chapter 22: Structural Health Monitoring (SHM)

22.1 Introduction

22.2 Motivations for SHM System Implementation

22.3 SHM System Classification and Main Components

22.4 SHM Areas and Application and Case Studies

22.5 Implications of Material Integration for SHM Systems

22.6 Conclusion and Outlook

References

Chapter 23: Achievements and Open Issues Toward Embedding Tactile Sensing and Interpretation into Electronic Skin Systems

23.1 Introduction

23.2 The Skin Mechanical Structure

23.3 Tactile Information Processing

23.4 Computational Requirements

23.5 Conclusions

References

Chapter 24: Intelligent Materials in Machine Tool Applications: A Review

24.1 Applications of Shape Memory Alloys (SMA)

24.2 Applications of Piezoelectric Ceramics

24.3 Applications of Magnetostrictive Materials

24.4 Applications of Electro- and Magnetorheological Fluids

24.5 Intelligent Structures and Components

24.6 Summary and Conclusion

References

Chapter 25: New Markets/Opportunities through Availability of Product Life Cycle Data

25.1 Product Life Cycle Management

25.2 Case Studies

25.3 Potential of Sensorial Materials in PLM Application

Acknowledgment

References

Chapter 26: Human–Computer Interaction with Novel and Advanced Materials

26.1 Introduction

26.2 New Forms of Human–Computer Interaction

26.3 Applications and Scenarios

26.4 Opportunities and Challenges

26.5 Conclusions

References

Index

End User License Agreement

List of Tables

Table 5.1

Table 5.2

Table 7.1

Table 7.2

Table 7.3

Table 8.1

Table 9.1

Table 9.2

Table 9.3

Table 9.4

Table 9.5

Table 9.6

Table 9.7

Table 9.8

Table 9.9

Table 10.1

Table 12.1

Table 18.1

Table 18.2

Table 19.1

Table 19.2

Table 21.1

Table 21.2

Table 22.1

Table 22.2

Table 23.1

Table 23.2

Table 23.3

Table 23.4

Table 23.5

Table 23.6

Table 25.1

List of Illustrations

Figure 1.1

Figure 1.2

Figure 1.3

Figure 1.4

Figure 1.5

Figure 1.6

Figure 1.7

Figure 1.8

Figure 1.9

Figure 1.10

Figure 1.11

Figure 1.12

Figure 1.13

Figure 2.1

Figure 2.2

Figure 2.3

Figure 2.4

Figure 2.5

Figure 2.6

Figure 2.7

Figure 2.8

Figure 2.9

Figure 2.10

Figure 3.1

Figure 3.2

Figure 3.3

Figure 3.4

Figure 3.5

Figure 3.6

Figure 3.7

Figure 3.8

Figure 3.9

Figure 4.1

Figure 4.2

Figure 4.3

Figure 4.4

Figure 4.5

Figure 4.6

Figure 4.7

Figure 4.8

Figure 4.9

Figure 4.10

Figure 4.11

Figure 4.12

Figure 4.13

Figure 5.1

Figure 5.2

Figure 5.3

Figure 5.4

Figure 5.5

Figure 5.6

Figure 5.7

Figure 5.8

Figure 5.9

Figure 5.10

Figure 5.11

Figure 5.12

Figure 5.13

Figure 5.14

Figure 5.15

Figure 5.16

Figure 6.1

Figure 6.2

Figure 6.3

Figure 6.4

Figure 6.5

Figure 6.6

Figure 6.7

Figure 6.8

Figure 6.9

Figure 6.10

Figure 6.11

Figure 6.12

Figure 6.13

Figure 6.14

Figure 6.15

Figure 6.16

Figure 6.17

Figure 6.18

Figure 6.19

Figure 6.20

Figure 6.21

Figure 6.22

Figure 6.23

Figure 6.24

Figure 7.1

Figure 7.2

Figure 7.3

Figure 7.4

Figure 7.5

Figure 7.6

Figure 7.7

Figure 7.8

Figure 7.9

Figure 7.10

Figure 7.11

Figure 7.12

Figure 7.13

Figure 7.14

Figure 7.15

Figure 7.16

Figure 7.17

Figure 8.1

Figure 8.2

Figure 8.3

Figure 8.4

Figure 8.5

Figure 8.6

Figure 8.7

Figure 8.8

Figure 8.9

Figure 8.10

Figure 8.11

Figure 8.12

Figure 8.13

Figure 8.14

Figure 8.15

Figure 9.1

Figure 9.2

Figure 9.3

Figure 9.4

Figure 9.5

Figure 9.6

Figure 9.7

Figure 10.1

Figure 10.2

Figure 10.3

Figure 10.4

Figure 10.5

Figure 10.6

Figure 10.7

Figure 10.8

Figure 10.9

Figure 10.10

Figure 10.11

Figure 10.12

Figure 10.13

Figure 10.14

Figure 10.15

Figure 10.16

Figure 10.17

Figure 10.18

Figure 10.19

Figure 10.20

Figure 10.21

Figure 10.22

Figure 10.23

Figure 10.24

Figure 10.25

Figure 11.1

Figure 11.2

Figure 11.3

Figure 11.4

Figure 11.5

Figure 11.6

Figure 11.7

Figure 11.8

Figure 11.9

Figure 12.1

Figure 12.2

Figure 12.3

Figure 12.4

Figure 12.5

Figure 12.6

Figure 13.1

Figure 13.2

Figure 13.3

Figure 13.4

Figure 13.5

Figure 13.6

Figure 14.1

Figure 14.2

Figure 15.1

Figure 15.2

Figure 16.1

Figure 16.2

Figure 16.3

Figure 16.4

Figure 16.5

Figure 16.6

Figure 16.7

Figure 16.8

Figure 16.9

Figure 16.10

Figure 17.1

Figure 18.1

Figure 18.2

Figure 18.3

Figure 18.4

Figure 18.5

Figure 18.6

Figure 18.7

Figure 18.8

Figure 18.9

Figure 18.10

Figure 18.11

Figure 18.12

Figure 18.13

Figure 18.14

Figure 19.1

Figure 19.2

Figure 19.3

Figure 19.4

Figure 19.5

Figure 19.6

Figure 19.7

Figure 19.8

Figure 20.1

Figure 20.2

Figure 20.3

Figure 20.4

Figure 20.5

Figure 20.6

Figure 20.7

Figure 20.8

Figure 20.9

Figure 21.1

Figure 21.2

Figure 21.3

Figure 21.4

Figure 21.5

Figure 21.6

Figure 21.7

Figure 21.8

Figure 21.9

Figure 21.10

Figure 21.11

Figure 22.1

Figure 22.2

Figure 22.3

Figure 22.4

Figure 22.5

Figure 22.6

Figure 22.7

Figure 22.8

Figure 22.9

Figure 22.10

Figure 22.11

Figure 22.12

Figure 22.13

Figure 23.1

Figure 23.2

Figure 23.3

Figure 23.4

Figure 23.5

Figure 24.1

Figure 24.2

Figure 24.3

Figure 24.4

Figure 24.5

Figure 25.1

Figure 25.2

Figure 25.3

Figure 25.4

Guide

Cover

Table of Contents

Begin Reading

Part 1

Chapter 1

Pages

i

ii

iii

iv

xv

xvi

xvii

xviii

xix

xx

xxi

xxii

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

289

290

291

292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332

333

334

335

336

337

338

339

340

341

342

343

344

345

346

347

348

349

350

351

352

353

354

355

356

357

358

359

360

361

362

363

364

365

366

367

368

369

370

371

372

373

374

375

376

377

378

379

380

381

382

383

384

385

386

387

388

389

390

391

392

393

394

395

396

397

398

399

400

401

402

403

404

405

406

407

408

409

410

411

412

413

414

415

416

417

418

419

420

421

422

423

424

425

426

427

428

429

430

431

432

433

434

435

436

437

438

439

440

441

442

443

444

445

446

447

448

449

450

451

452

453

454

455

456

457

458

459

460

461

462

463

464

465

466

467

468

469

470

471

472

473

474

475

476

477

478

479

480

481

482

483

484

485

486

487

488

489

490

491

492

493

494

495

496

497

498

499

500

501

502

503

504

505

506

507

508

509

510

511

512

513

514

515

516

517

518

519

520

521

522

523

524

525

526

527

528

529

530

531

532

533

534

535

536

537

538

539

540

541

542

543

544

545

546

547

548

549

550

551

552

553

554

555

556

557

558

559

560

561

562

563

564

565

566

567

568

569

570

571

572

573

574

575

576

577

578

579

580

581

582

583

584

585

586

587

588

589

590

591

592

593

594

595

596

597

598

599

600

601

602

603

604

605

606

607

608

609

610

611

612

613

614

615

616

617

618

619

620

621

622

623

624

625

626

627

628

629

630

631

632

633

634

635

636

637

638

639

640

641

642

643

644

645

646

647

648

649

650

651

652

653

654

655

656

657

658

659

660

661

662

663

664

665

666

667

668

669

670

671

672

673

674

Material-Integrated Intelligent Systems

Technology and Applications

Edited by Stefan Bosse, Dirk Lehmhus, Walter Lang, and Matthias Busse

All books published by Wiley-VCH are carefully produced. Nevertheless, authors, editors, and publisher do not warrant the information contained in these books, including this book, to be free of errors. Readers are advised to keep in mind that statements, data, illustrations, procedural details or other items may inadvertently be inaccurate.

Library of Congress Card No.: applied for

British Library Cataloguing-in-Publication DataA catalogue record for this book is available from the British Library.

Bibliographic information published by the Deutsche NationalbibliothekThe Deutsche Nationalbibliothek lists this publication in the Deutsche Nationalbibliografie; detailed bibliographic data are available on the Internet at http://dnb.d-nb.de.

© 2018 Wiley-VCH Verlag GmbH & Co. KGaA, Boschstr. 12, 69469 Weinheim, Germany

All rights reserved (including those of translation into other languages). No part of this book may be reproduced in any form – by photoprinting, microfilm, or any other means – nor transmitted or translated into a machine language without written permission from the publishers. Registered names, trademarks, etc. used in this book, even when not specifically marked as such, are not to be considered unprotected by law.

Cover Design Formgeber, Mannheim, Germany

Print ISBN 978-3-527-33606-7

ePDF ISBN 978-3-527-67925-6

ePub ISBN 978-3-527-67926-3

Mobi ISBN 978-3-527-67923-2

oBook ISBN 978-3-527-67924-9

Foreword

The vision of materials with intelligent behavior has been tantalizing material and computer scientists for many decades. The benefits of such materials, which would more resemble living systems than classical engineered structures, would indeed be tremendous: Materials that can sense and change their properties such as shape, appearance, and other physical properties in response to the environment would allow us to create structures, robots, and other autonomous systems that interact with the environment with animal-like agility and with the robustness common to biological, living systems. In the long run, such materials could even self-assemble and self-heal, and fundamentally change the way how things are made. This vision is particularly nagging as Nature vividly demonstrates these possibilities and their feasibility on a daily basis; yet, progress has been slow and tedious. Unlike conventional engineered structures, Nature tightly integrates sensors, muscles, and nerves with structure. Examples range from our own skin that helps us regulate temperature and provides us with tactile sensing at very high dynamic range to the most complex structure in the known universe, our brains, and more exotic functionality such as camouflage of the cuttlefish or the shape-changing abilities of a bird wing.

In computer science, interest into intelligent material goes back to Toffoli's concept of “Programmable Matter” in the 1990s, and was accelerated by the advent of microelectromechanical structures (MEMSs), which has led to the concept of “smart dust” and the field of sensor networks. At the same time, advances in composite manufacturing have led to the field of “multifunctional materials,” and it seems the time has finally come to unite these two fields of which the present book is a first attempt.

Stefan Bosse, Manuel Collet, Dirk Lehmhus, Walter Lang, and Matthias Busse present here one of the first attempts to bridge the currently disparate fields of computer science, robotics, and material engineering. Their diverse backgrounds are reflected in the organization of this book, which follows the same layered approach that has become customary to abstract the inner workings of networked communication from their applications to organize the challenges of material-integrated intelligence in both material science and computing. Establishing this common language and hierarchy is an important first step as it allows the different disciplines to understand where they fit in, the scope of their contribution within the bigger picture, and where the open challenges are.

While this view will be very helpful for the two disparate communities to find common ground, this book does not oversimplify the problem. It remains clear throughout that material-integrated intelligence and structural functionality are indeed at odds. Every additional sensor, communication infrastructure, and computation a computer scientist would wish to integrate into a structure, for example, to perform structural health monitoring, jeopardizes the very structural health of the structure. Similarly, adding the capability for structures to morph, for example, to save fuel during different phases of flight, adds weight to an extent that very likely outweighs the very savings any morphological change could possibly provide. While these constraints seem overly limiting, more pedestrian (in the true sense of the word) applications might not have enough value to justify multifunctional composites.

Yet, natural systems impressively show us that trade-offs in multifunctionality with net benefits are indeed possible and often the only way these systems can survive in a changing environment. It might therefore be worthwhile to put immediate applications aside and indulge in the intellectual challenges of design and distributed computation until emerging applications such as robotics, orthotics, and autonomous systems in general – which will strongly benefit from material-integrated computation – become more mainstream. This book provides the red thread for such a pursuit by providing an overview of recent progress in function scale integration of sensors, power and communication infrastructure, as well as the key computational concepts that such integration could enable, bridging the worlds of the continuous, that is material physics, and the discrete algorithmic world.

Here, one problem becomes very clear: It is not possible to design material-integrated intelligence without understanding both the underlying material physics and the algorithms such intelligence requires. Physics determines the bandwidth, dynamic range, and noise characteristics of sensors and actuators, which define the available inputs and outputs to an algorithm designer. Likewise, certain computational problems require a minimum amount of real estate, energy, and communication bandwidth that the material designer needs to foresee. These challenges are already well understood in robotics, where they are reconciled by a probabilistic view on sensing, actuation, and algorithmic planning. Describing the specific problems that material-integrated intelligence poses will help the community to recognize the similarities between such structures and robotics, and possibly help to leverage insights from probabilistic state estimation, planning, and control that this community has produced in the past decade.

Combining a physical and a computational perspective in a single book will not only help this fledgling field to organize key insights but might also serve as a starting point for a new generation of scientists and engineers who will have their feet comfortably in both the computational and the physical – a prospect that offers tremendous opportunities. For example, it is possible to shift computation into the material and vice versa. The cochlea, which effectively performs a discrete Fourier transform, trades computational with spatial and sensing requirements. Similarly, insect eyes organize their lenses in spatial arrangements that simplify the neural circuitry for rectification of the compound signal, an approach that has become known as “morphological computation.” Finally, combinations of active materials can be used to create simple feedback controllers and oscillators. Innovating in this space will require scientists and engineers that are equally at ease with materials and computational concepts.

Another area that is currently untapped in material sciences and builds up on the foundations laid out here is to leverage the principles of self-organization and swarm intelligence to equip future materials, possibly consisting of thousands of pin-head sized computing devices, with intelligence. Receiving interest from both material and computer science, for example, in their study of self-assembly or pattern formation, also known as “Turing Patterns” (after the computer science pioneer Alan Turing who first studied such systems), both communities have not yet connected on creating materials that self-organize – a concept that allows realizing almost limitless functionality.

Back to the here and now, however, the immediate impact research in material-integrated intelligence might have is to provide a new platform for material and computer scientists alike to apply and exchange their tools. Solving the problems of integrating sensors/actuators, computation, communication, and power into smart composites and mass producing them will allow us to create sensor networks and distributed computers of unprecedented scales. Such systems pose the opportunity to perform model predictive control or machine learning inside the material, providing unprecedented capabilities and challenges. Likewise, applying the full breadth of what is possible computationally will spur the development of novel sensors and actuators with higher bandwidth, smaller footprints, and lower energy requirements, eventually approximating and transcending natural systems. In order to get there, readers of this book will need to set their disciplinary goggles aside and join us in the quest to make materials computers and computers materials.

Nikolaus CorrellDepartment of Computer ScienceMaterial Science EngineeringUniversity of Colorado at BoulderBoulder, CO, USAFebruary 10, 2016

Preface

This book addresses a topic that has, to the editors' knowledge, not been covered as comprehensively as this before: material-integrated intelligent systems.

The topic links up with recent, current, and emerging trends like smart system integration, ambient intelligence, or structural electronics. Its background is the understanding that to obtain truly smart objects, it is simply not sufficient to tag them with a sensor node and some associated electronics for data evaluation – nor is it satisfactory to merely embed sensors in materials. Instead, the ultimate goal is to have materials that actually feel in a manner that can be compared with our own capabilities as human beings. The skin, its sensory equipment, and the further processing of data acquired through it is undoubtedly the most referenced model of such a material: Here we find different types of sensors situated in the most suitable places and at high resolution wherever necessary – thousands of them, actually, on your fingertip or on the palm of your hand, capturing pressure together with its first and second derivatives as well as secondary information like temperature or humidity.

Besides the sensors, you have filtering of signals, sensor fusion, and information preprocessing. You have communication of aggregated information to a hierarchy of higher level control systems – your spinal cord, or ultimately your brain, with the information passed finally reaching your consciousness.

The complexity of this system is such that research on its basic principles and capabilities even in humans is an ongoing effort involving researchers from several disciplines like biology, medicine, or neuroscience, to name but a few.

The aim defines the approaches that lead to its technical realization, and technology does not differ from biology here: The topic is highly interdisciplinary irrespective of the world we look at, be it natural or artificial. It requires contributions, in various fields, of materials science, but also of production engineering, microelectronics, microsystems technology, systems engineering, and computer science. In fact, it needs more than contributions, but rather close cooperation. It thus faces all the challenges transgressing the boundaries of scientific disciplines commonly entails–starting from a quite natural lack of fully grasping the capabilities and limitations of neighboring research fields to the simple problem of scientific languages that just do not match and thus impede creating the necessary mutual understanding.

At the same time, the promise linked to solving these difficulties is just about as large as the challenge. Material-integrated intelligent systems encounter an economic environment that moves more and more toward computational capabilities and communication technologies dispersed and networked throughout our daily environment. The concept of smart dust may be seen as earlier formulation of this issue. Currently, it is moving back into focus as a potential facet of the Internet of Things (IoT), today one of the main stimulators of research in material-integrated intelligent systems.

The associated fundamental technological enablers and their interdependence is what we primarily intend to illustrate in this book.

With this vision in mind, we have conceived this book, to which several authors with a broad scientific background have contributed.

Our ambition with it is to help bridge the gaps between the various disciplines they represent by allowing these eminent scientists to present their own views on their area's part in the embracing context.

So whom do we expect to benefit most from this extensive collation of information?

Naturally, the answer to this question determines the form and content of the fundamental chapters of our work.

As primary readers, we have professionals in product development and engineering design in mind who are tasked with the problem of integrating mechanical and electronic systems in a classic mechatronics approach, but on the new level of material integration, which requires additional, new solutions in materials and production processes or data evaluation.

Thus, the perspective of the assumed reader is that of an expert in one of the technological fields involved who needs to gain insight into the adjacent ones to be able to devise and evaluate integrated solutions involving several areas. The background of such a reader can either be academic or industrial. Among the industrial readership, we particularly hope to gain the interest of potential applicants of material-integrated intelligent systems: Our book should provide the necessary pathways and perspectives to help them understand the possibilities the combination of the current technological state of the art from various disciplines can offer.

Besides, we have graduate and postgraduate students in mind who seek an introduction to the field. The character of the book, and the intention to lead professionals to new realms beyond their usual field of practice, is reflected in the attempt to structure and formulate the individual chapters in a way that will allow people with an engineering or natural sciences background to easily follow the discussion even if it is not their particular area of expertise or application that is covered.

For reasons of simplicity and easy access, the book is organized in parts that reflect major research areas. Prior to this, the topic is outlined in an introductory section (Part One) that explains the term material-integrated intelligent systems in more detail, puts it in perspective with past, present, and future scientific and technological trends, and thus provides the motivation for engaging in research and new technology development.

Part Two, System Development, assumes the product development perspective and describes methodologies for designing smart systems on different levels of abstraction.

Part Three, Sensor Technologies, provides fundamental information about different types of sensors and discusses the need for adaptation they face in view of material integration, as well as technological solutions developed toward this end.

Part Four, Material Integration Solutions, swaps perspectives from the electronics and microsystems technology point of view toward mechanical and materials engineering. In this part, we consider the integration problem based on specific material classes (metals, polymers) and the closely associated manufacturing processes.

Part Five, Signal and Data Processing: The Sensor Node Level, describes the fundamentals of this area of expertise and relates them to specific problems of material-integrated systems. The perspective is that of the individual, smart sensor node.

Part Six, Networking and Communication: The Sensor Network Level, extends the scope toward the combination of several such sensor nodes and thus also covers information exchange between them, as well as data evaluation in sensor networks.

Part Seven, Energy Supply, discusses ways of ensuring the availability of sufficient amounts of energy – and levels of power – for a material-integrated system to operate, touching upon aspects like storage of energy and management of resources as well as generation of energy through harvesting or scavenging approaches.

Part Eight, Application Scenarios, either provides examples of realized material-integrated intelligent systems or explains how different areas of application like Structural Health Monitoring or Human–Machine Interaction and/or cooperation could profit from future availability of them.

Common to all parts is a general concept that provides entry points for readers with diverse backgrounds and thus strongly deviating levels of competence in the areas covered. In this sense, we do not see our work as giving definite answers across the width of its scope, but rather as defining and providing the cross-disciplinary interfaces between the various elements that need to be connected to generate what is the topic and the vision of this book – material-integrated intelligent systems.

Putting together this book has required a considerable amount of time and commitment from all the many people involved. We are thus extremely grateful to those researchers who have volunteered to supply a contribution to this work. Essentially, it is their dedication, their effort, their perseverance, and not the least their patience that have made possible the result you, the reader, can hold in your hands today.

We are indebted to Dr. Martin Preuss of Wiley-VCH, who discussed the topic, content, and organization of the book with us at its very beginning and thus helped create the original framework that has now been realized in the form you, as reader, are holding in your hands. For this realization, in turn, we owe gratitude to Nina Stadthaus and Stefanie Volk (Wiley-VCH) who accompanied us throughout the whole process of gathering and organizing primary input as well as secondary information with immeasurable patience, dedication, and a lot of good advice.

Finally, we acknowledge the financial support of the Federal State of Bremen, which facilitated the formation and the initial research work of the ISIS (Integrated Solutions in Sensorial Structure Engineering) Sensorial Materials Scientific Centre at the University of Bremen, without which the achievement this work represents could not have been accomplished.

Stefan BosseDirk LehmhusWalter LangMatthias Busse

Part OneIntroduction

1On Concepts and Challenges of Realizing Material-Integrated Intelligent Systems

Stefan Bosse1,2 and Dirk Lehmhus2

1University of Bremen, Department of Mathematics and Computer Science, Robert-Hooke-Str. 5, 28359 Bremen, Germany

2University of Bremen, ISIS Sensorial Materials Scientific Centre, Wiener Str. 12, 28359 Bremen, Germany

1.1 Introduction

Material-integrated intelligent systems constitute materials that are able to “feel.” This is the shortest possible definition at hand for the subject of the present book. What it implies will be discussed below, while detailed descriptions of individual aspects and application scenarios will follow in its main parts.

As a concept, material-integrated intelligent systems have implicitly been around for quite some time. To a considerable degree, this is because the concept as such is not so much a human invention, but rather something that is deeply rooted in nature: The human skin and the human nervous system are the typical examples cited pertaining to material-integrated intelligent systems, such as sensorial materials [1–3], robotic materials [4], nervous materials [5], or sensor-array materials [6].

These natural models taken together nicely illustrate the differences between materials with integrated sensor(s) and material-integrated intelligent systems: For one thing, the skin contains a multitude of sensors which do not only capture force or pressure, but also additional aspects like the first and second derivative of pressure or temperature. At the same time, the impression we get when we touch an arbitrary surface is not that of a separate awareness of these factors, but a combined one that is derived from fusion of sensory information.

Besides, we do not base the decisions we make in response to a tactile sensation on quantitative values of pressure, temperature, and so on, and on a deterministic model that links these values to an intended action and its potential outcome. Instead, we rely on experience, that is, on a learned relationship between an action and its outcome in relation to the associated sensory information in one way or another. Translated to technical terms, we thus follow a model-free approach.

Having said this, we can derive a list of characteristics a material would need for us to concede that it can actually “feel.” Such a material must be capable of

capturing sensory data;

aggregating data through some local preprocessing, performing data reduction of individual data points;

further processing this data to derive some higher-level information, gaining knowledge;

using this knowledge for decision-making, putting it to some internal/local use, or communicating it to higher system levels;

coping with damage by being dynamic and reconfigurable; and

achieving a state of awareness of host material and environment, that is, the derivation of a context knowledge.

If the above list represents a functionality-centered perspective, the question that immediately arises is how a technical implementation of this concept could be achieved, and which research domains would need to contribute to it.

On a generic level, material-integrated intelligent systems follow the universal trend in the microelectronics industry, which is typically described as having two orthogonal, primary directions: on the one hand, miniaturization or the “more Moore” development line, and on the other, diversification through the integration of additional, usually analog, functionalities such as sensing, energy supply, and so on – the “more than Moore” approach. In both cases, reference is made to Moore's law, which predicts (from a 1965 point of view) that transistor count in densely packed integrated circuits would double every 2 years, and which has since then approximately been met by actual developments, although with some indications of slowing down since about 2011. Technologically, “more Moore” is usually associated with system on chip (SoC) solutions, whereas “more than Moore” is linked to system in package (SiP) technologies. However, both merge diagonally combining both SoC and SiP approaches to create higher value systems. Clearly, this is the domain into which material-integrated intelligent systems fall. As a consequence, the following research topics need to be addressed in their development:

miniaturization on component and system level to limit “footprint” within host material;

system resilience against effects of processing conditions during integration;

system compliance with host material properties in the embedded state;

energy supply solutions that support autonomy, like cooperative energy harvesting and storage, and (intelligent) management of resources;

reliable and robust low power internally and externally directed communication approaches;

distributed, reliable, and robust low power data evaluation; and

multiscale design methodologies that span the scope from chip design to smart products and environments.

Mark Weiser, in his landmark 1991 article that predicted many evolutions in computer science we have witnessed since, has set the scene by stating that “in the 21st century, the technology revolution will move into the everyday, the small and the invisible” [7]. Weiser thus anticipated a development that is connected to terms such as ambient intelligence and ubiquitous or pervasive computing.

Material-integrated intelligent systems will both profit from and contribute to the realization of this prediction through their potential of endowing many of the passive materials surrounding us today with perceptive capabilities, and ultimately even adaptive behavior. A large part of the novelty of this approach has its foundations in the notion that miniaturization of systems will allow integration on a level that provides the added functionality without compromising suitability for the primary role to be fulfilled by the material in question. A prominent example in this respect is structural health monitoring (SHM). This application scenario is relevant for safety-critical, load-bearing structures. Safety can be enhanced, or safety factors relaxed, if the exact structural state is known at any moment in time. If material-integrated intelligent systems were selected for this task, a necessary prerequisite would be that the systems themselves do not adversely affect mechanical characteristics of the host material. In other words, the materials designed thus should not afford considering any property degradation caused by the material-integrated systems during the layout of the structure for its primary task. In a further evolution of the concept, the materials themselves could thus be envisaged as semifinished materials in the same way as sheet metal: Their capabilities, including their smartness, would be available as an asset not necessarily targeted at a specific application, but providing for several ones. For production of material-integrated intelligent systems, such a scenario could open up economy of scale effects significantly enhancing their economic viability. At the same time, this would afford production techniques able to cope with the associated large production volume.

It has been suggested that the implementation of material-integrated sensing can either follow a top-down or a bottom-up approach [2]. Focusing specifically on the sensing function, Lang et al. [8] propose an even finer distinction, which demarcates a top-down as opposed to a bottom-up approach:

top-down approach:

– hybrid integration

– local additive buildup

bottom-up approach:

– generic (intrinsic) sensing properties of materials

– local growth of sensors using, for example, bioinspired processes

From our current perspective, Lang et al.'s proposal excludes the intelligent side of material-integrated intelligent systems and its prerequisites like energy supply by concentrating on the transducer effect and the hardware to implement it. Specifically, the bottom-up approaches still fail to offer solutions that could provide these system components. This is apparent particularly for the generic sensing properties of materials, which remain ineffectual even as sensor until at least some means of detecting (i.e., sensing) the intrinsic effect is added.

The example shows that at least on the level of full intelligent systems, bottom-up approaches do not yet respond satisfactorily to the questions of realization.

An exception, though a theoretical one, is the notion of programmable matter proposed by Toffoli and Margolus. Their original concept assumes spatially distributed computing elements similar to smart sensor nodes capable of nearest neighbor interaction only. Together, they form a material with the inherent capability of information processing. Practically, this concept is reminiscent of physical realizations of cellular or lattice gas automata [9,10].

Later, alternative or extended definitions of programmable matter stress the ability of such materials to alter their physical characteristics in a controlled fashion – controlled either by a user from the outside or autonomously from within the material. In the latter case, the programmable matter makes use of its data evaluation capabilities to respond, for example, to sensor signals. Under this headline, several materials have been understood to represent forms of programmable matter. Material-integrated intelligent systems would fall into this category, too. Since the wider definitions of programmable matter include spatial reconfiguration building on autonomous objects (cells) as building blocks besides information processing, sensing, actuation, and adaptivity, both sensorial materials [1] and robotic materials [4] can be seen as intermediate-level representatives of this overall class of intelligent materials.

Realization of programmable matter thus depends on the scope of properties and the definition adopted. The full spectrum is usually represented by the material being built up of individual, autonomous units of microscopic scale that form the matter itself by docking to each other in different configurations, an ability that requires some relative locomotion, too. “Utility fog” is another designation for a system of microscale autonomous units having such abilities, with the spatial rearrangement not based on the so-called “foglets” as the smart units, but on the flow of the fluid in which they move. Reaching a certain macroscopic shape thus does not have to depend on deliberately moving to a certain location, but can rely on making or refusing connections once the opportunity is there [11]. To date, to the knowledge of the authors, no physical material is available that combines the full set of characteristics envisaged by Toffoli or Hall [10,11].

Obviously, much nearer to implementation is the top-down approach, which essentially coincides with the intermediate, diagonal path in between the pure “more Moore” and the “more than Moore” trend: What the term top-down implies is a hybrid integration approach in which suitable components are adapted to material integration needs and combined to form the required smart sensor network.

First practical developments leading toward sensor nodes combining subsets of the features required by material-integrated intelligent systems – above all, a minute size, a certain level of energy autonomy, and data evaluation as well as communication capabilities – sailed under the “smart dust” flag from the end of the 1990s to the early twenty-first century [12]. Warneke et al. concentrated on developing, as they termed it, a “cubic millimeter-sized computer” fully endowed with sensing, energy storage, and data evaluation, plus communication that could create an ad hoc network when dispersed, like dust, in a given environment. Clearly, a handful of smart dust sensor nodes embedded in a host material would conform to our own definition of material-integrated intelligent systems and sensorial materials.

Figure 1.1 provides an overview of the main elements of such a system, which mostly form part of the smart dust mote concept, too. The sensorial material as such consists of a material-integrated network of smart sensor nodes that may incorporate features like data evaluation and energy supply on local as well as global level. Figure 1.1 also links the various technological aspects to the respective parts of the present book.

Figure 1.1 The fundamental elements of a material-integrated intelligent system, also called sensorial material, as envisaged by Lehmhus et al. [2] – the aspect of material integration and the resulting interactions between integrated system and host material during production and life cycle are included, as well as the link to the environment in which the system exists: The world may be the source or cause of sensor data, but may also provide communication partners, both as recipients and as suppliers of information, the latter, for example, if the material-integrated system is embedded in a higher-ranking IoT solution. Besides, it may exchange energy with the sensorial material, acting either as source or sink.

1.2 System Development Methodologies and Tools (Part Two)

Basing a product on material-integrated intelligent systems leads to increased complexity in product development. Whereas in more conventional solutions, development of smart system and component can follow parallel paths for much of the design process, material integration affords a tighter coupling: Peters et al. [13] have highlighted this problem in an aerospace SHM context.

This calls for adapted design methodologies and tools that reflect the multidisciplinary, multidomain nature of the topic. In order to do so, such tools must incorporate simulation capabilities that address the various scientific disciplines involved and at least allow transferring results between them, if not even integrating them. As has been pointed out, for example, by Lehmhus et al. [14,15], this requirement does incorporate multiscale and multiphysics aspects, but extends beyond these in some respects by linking the process of gathering data and turning it first into information, and then using these to make decisions on physical aspects of the structure: Examples include adaptive structures that allow property change in response to loads or damage reconstructed from sensor signals, and base their decisions on incremental learning approaches [16]. Assessing the safety of such structures will have to include considerations about physical effects within the material potentially causing damage, the probability of detection of damage both of the structure itself and the sensors employed, and the developing nature of the learned model. Besides, energy issues may have to be considered if, for example, energy management adapts the number of sensors interrogated, the communication activity between sensor nodes, or the algorithms used in load or damage assessment in relation to the energy status of sensor nodes and network. If energy harvesting is used to beef up energy resources, probability of detection and so on may even be influenced by the past, present, and predicted (if a forward-looking energy management algorithm is used) service life of the structure, which determines the amount of energy available for scavenging. For such factors to have an impact, strictly speaking not even adaptivity is needed.

Design methodologies will be discussed on a global level and from the point of view of smart system design in part two of the present work.

1.3 Sensor Technologies and Material Integration (Part Three and Four)

The variety of sensors used in material-integrated sensing echoes the variety of application scenarios. Classification of sensors can, for example, be based on the manufacturing process (printed sensors, MEMS sensors, etc.), the material group (organic versus silicon sensors and electronics), the nature of the measurand (mechanical sensors, temperature sensors, chemical sensors, etc.), and the underlying principle of measurement (optical sensors, piezoresistive sensors, piezoelectric sensors, etc.). All the above classes, and more, have relevance for material-integrated intelligent systems and will be discussed in part three of this book.

For the case of sensors, material integration itself is typically described by means of several different levels. Figure 1.2 provides an overview in this respect, starting with an entirely external observation, in this case represented by a camera (level I). Surface application of sensors is the next step: The sensor is applied, usually via its substrate, to the material to be monitored (II). Surface integration in contrast assumes a tighter coupling between sensor and material or part (III). Examples in this respect include sensors directly printed onto a part or material surface, implying in situ production of the device. In materials featuring a layered buildup, as is the case for continuous fiber reinforced polymers or the so-called fiber metal laminates, surface integration realized on an internal surface can turn into volume integration (IV). Also frequently discussed is the use of intrinsic material properties for material-integrated sensing. The drawback of this approach is that it does not replace the smart sensor node, but at best the transducer element that translates the measurand into an electrical signal. From a material-integrated intelligent system point of view, this is a minor contribution that may be bought at the expense of compromising material properties.

Figure 1.2 Sensor integration as a model for explaining the various levels of material integration, using a tensile test and associated sample as example. (Images courtesy of Fraunhofer IFAM – top and center right – and IMSAS, University of Bremen – bottom right.)

In terms of the challenges of integration, a distinction between life cycle phases is helpful. The beginning-of-life (BoL) phase and especially the production processes typically stress the material beyond the limits it can be expected to see in the middle-of-life (MoL) or application phase. However, unless production process monitoring is among its tasks, the system is only expected to survive in this phase, and not to deliver accurate and reliable information, which simplifies the task to some degree.

The hardships of integration themselves very much depend on the nature of the underlying manufacturing process. Casting or molding processes are typically characterized by higher processing temperature, but generally lower mechanical loads. Forming processes usually involve higher mechanical loads. Processing of polymers naturally occurs at lower temperatures than that of metals. However, in some cases, like the integration of sensors in metal casting, it is not only the absolute temperature that is of interest but also the cooling rate after mold filling: Despite the much higher mechanical loads, it is easier to integrate a sensor in high-pressure die casting than in sand casting because the former reaches cooling rates orders of magnitude higher than the latter. Figure 1.3 illustrates these differences in a qualitative manner. As a consequence, in high-pressure die casting, a thermal protection solution for the sensor system only needs to withstand the elevated temperatures for seconds or minutes at most [17–22].

Figure 1.3 Qualitative comparison of production processes (here metal casting processes) in terms of thermal loads exerted on embedded sensors and sensor system components, showing temperature level versus cooling rates reached following mold filling.

Coming to terms with thermal loads can be discussed based on structural state consideration and thus oriented at the melting point of the various materials found in a sensor system for functionality reason. However, in many cases, the maximum sustainable temperature is not defined by this criterion, but by lower boundaries that mark the loss of core functional capabilities. Examples in this respect are semiconductor devices that depend on doping, which may be irreversibly lost if activation energies for dopant diffusion are reached and sufficient time (here the process-dependent cooling rate comes in once again) at elevated temperature is available. Since diffusion paths are short due to the high resolution of current semiconductor device technology, even limited time intervals may already harm the system. Similarly, as ceramics, piezoelectric materials like lead zirconate titanate or PZT can, in principle, withstand high temperatures, but lose their polarization once the Curie temperature (roughly between 230 and 500 °C for PZT, depending on exact composition) is passed. Naturally, polarization of an already integrated PZT sensor is difficult if the encasement is of metallic nature. Both examples underline that material integration may have to rely on specific materials with properties adapted to the integration process. Figure 1.4 enumerates solutions discussed in the field of high-temperature electronics (HTE) and contrasts their application temperatures with typical casting temperatures, illustrating the fact that not only the active components must be considered but also passives and supporting materials like solders.

Figure 1.4 Exemplary overview of high temperature electronics material choices for different types of components (active and passive components, solders) contrasted to thermal conditions in metal casting [23–28].

If thermal stability cannot be guaranteed via an adjusted choice of materials, thermal protection is a second option. A drawback of this solution is that in case of a sensor, it means detaching it from the structure to be monitored, which complicates the interpretation of signals gathered. In case of an electronic component, a reversal of the heat flux direction can be observed if usage of the component generates waste heat: In this case, the protective insulation designed against the requirements of the BoL phase will counteract heat dissipation during the MoL phase, that is, the product's service life (see Figure 1.5 for an schematic illustration of the problem).

Figure 1.5 Heat flux reversal from beginning-of-life (BoL) to middle-of-life (MoL): Can being too protective do harm?

Thus, once the production process is over, service life emerges as a challenge in its own right. Already in the later phases of thermal production processes, compliance of the typical host and sensor system – functional and packaging – materials become an issue. The main aspects to consider are thermal and mechanical compliance. Differences in the coefficient of thermal expansion (CTE) on the one hand and the Young's modulus on the other affect internal stress distribution in host material and sensor system. If applied deliberately and in a controlled manner, these effects can actually be employed to improve system performance. An elegant example of such a strategy has been presented by Heber et al., who have integrated piezoceramic elements at elevated temperatures in polymers with different CTE values. As a consequence, after cooling, the higher CTE of the enclosing polymers results in compressive residual stresses in the piezoceramic and tensile ones in the polymer. The main benefit is a certain alleviation of the brittle fracture behavior of the piezoceramic material [29]. In a somewhat similar approach, Choi et al. have deposited a low-CTE conductive material on a high-CTE substrate at an adjusted temperature to create compressively prestressed interconnects able to better sustain tensile loads and even allow some amount of stretching. A comparable, but mechanical rather than thermal effect has been reported by the same authors relying on deposition of the conductive material on a mechanically prestressed substrate that is released afterward [30].

In contrast to the above examples, deviations in the Young's modulus typically come into effect as soon as mechanical loads are applied. In a fiber-reinforced composite material, the high stiffness fibers rather than the low stiffness matrix see the highest stress levels. The same will happen in a complex material-integrated intelligent system. On a larger length scale, the effect is observable between host material and embedded device. Dumstorff et al. [31] have demonstrated this via FEM simulations of an assumed silicon-based device in a “virtual” matrix with varied elastic properties. Similar studies have been performed by Lecavelliers des Etangs-Lavellois et al. [32], who looked on a much smaller length scale at the stress distribution caused by external loads like bending within the various materials and subcomponents that together constitute a silicon-based device.