Memory and Action Selection in Human-Machine Interaction E-Book

Munéo Kitajima

• Herausgeber: John Wiley & Sons
• Kategorie: Wissenschaft und neue Technologien
• Sprache: Englisch

Seitenzahl: 196

Veröffentlichungsjahr: 2016

Beschreibung

The first goal of this book is to extend Two Minds originating from behavioral economics to the domain of interaction, where the time dimension has to be dealt with rigorously; in human–machine interaction, it is of crucial importance how synchronization between conscious processes and unconscious processes is established for a sense of smoothness, and how memory processes and action selection processes are coordinated. The first half this book describes the theory in detail. The book begins by outlining the whole view of the theory consisting of action selection processes and memorization processes, and their interactions. Then, a detailed description for action selection processes theorized as a nonlinear dynamic human behavior model with real-time constraints is provided, followed by a description for memorization processes. Also, implications of the theory to human–machine interactions are discussed.

The second goal of this book is to provide a methodology to study how Two Minds works in practice when people use interactive systems. The latter half of this book describes theory practices in detail. A new methodology called Cognitive Chrono-Ethnography (CCE) is introduced, which adds the time dimension to Hutchins’ Cognitive Ethnography, in order to practice "know the users" systematically by designing user studies based on a simulation of users’ mental operations controlled by Two Minds. The author then shows how CCE has been applied to understanding the ways in which people navigate in real physical environments by walking and by car, respectively, and explores the possibility of applying CCE to predict people’s future needs. This is not for understanding how people use interfaces at present but to predict how people want to use the interfaces in the future given they are currently using them in a certain way

Finally, the book concludes by describing implications of human–machine interactions that are carried out while using modern artefacts for people's cognitive development from birth, on the basis of the theories of action selection and memorization.

Leseprobe

Table of Contents

Cover

Title

Copyright

Introduction

PART 1: Theoretical Foundation for Dealing with Action Selection and Memorization

1 A Unified Theory of Action Selection and Memory

1.1. Organic self-consistent field theory

1.2. Development of brain architecture model under the NDHBmodel/RT

2 NDHB-Model/RT: Nonlinear Dynamic Human Behavior Model with Realtime Constraints

2.1. Maximum satisfaction architecture

2.2. Brain information hydrodynamics

2.3. Structured meme theory

2.4. NDHB-model/RT

2.5. MHP/RT: Model human processor with real-time constraints

2.6. Two Minds and emotions

3 Layered-structure of Memory and its Development

3.1. MHP/RT modules and their associated memories

3.2. Hierarchical structure of human action selection

3.3. Emotion initiation via memory processes

4 Implication for Human–Machine Interaction: Autonomous System Interaction Design (ASID) based on NDHB-Model/RT

4.1. Users modeled by MHP/RT with MD memory frames

4.2. Autonomous systems versus linear systems

4.3. Needs that a society of information systems must meet

4.4. Outline of ASI

4.5. Conclusions

PART 2: Theoretically Motivated Methodology for Understanding Users

5 Cognitive Chrono-ethnography

5.1. Understanding people’s behavior in real life

5.2. Cognitive chrono-ethnography

6 A CCE Study: Slow Self-paced Navigation

6.1. Introduction: navigation in a train station by following signs

6.2. Steps 1 and 2 of CCE

6.3. Step 3 of CCE: monitor recruiting

6.4. Steps 4 and 5 of CCE: monitor behavior observation and individual model construction

6.5. Step 6 of CCE: socioecological model construction

6.6. Discussion

6.7. Conclusions

7 Fast Externally-paced Navigation

7.1. Introduction

7.2. Steps 1 and 2 of CCE

7.3. Step 3 of CCE: monitor recruiting

7.4. Steps 4 and 5 of CCE: monitor behavior observation and individual model construction

7.5. Conclusions

8 Designing for Future Needs

8.1. Introduction

8.2. Making inaccessible future needs accessible: t-translation invariant principle

8.3. A case study of CCE: why do fans repeat visits to the ballpark?

8.4. Discussion

8.5. Conclusions

Conclusion: Technique versus Skill Viewed from MHP/RT’s Four-Processes

Bibliography

Index

End User License Agreement

List of Tables

2 NDHB-Model/RT: Nonlinear Dynamic Human Behavior Model with Realtime Constraints

Table 2.1. Happiness goals and their relation to social layers. + denotes the degree of relevance of each goal to each layer, i.e. Individual, Community, and Social system, respectively. +++: most relevant, ++: moderately relevant, and +: weakly relevant

Table 2.2. Biological Activity: Complex Systems and Dissipative Structure

Table 2.3. Four operation modes of MHP/RT and their relationships to decision-making and action selection

Table 2.4. Four Processing Modes [KIT 11a]

Table 2.5. Relationships between Two Minds and emotions (adapted from our article [KIT 15b])

3 Layered-structure of Memory and its Development

Table 3.1. Relationships between the hierarchical structure of cognitive mechanism and that of neural networks (adapted from our article [KIT 14a])

6 A CCE Study: Slow Self-paced Navigation

Table 6.1. Study items for cognitive functions

Table 6.2. Results of the cognitive aging survey

Table 6.3. Brief description of the features of the selected train stations and the assigned tasks at each station

8 Designing for Future Needs

Table 8.1. The events that happened in respective years that characterize the fan level of events

Conclusion

Table 1. Characteristics of technique and skill

List of Illustrations

Introduction

Figure I.1. Process and Content in Two Cognitive Systems (adapted from [KAH 03])

Figure I.2. Screenshot from a car navigation system

1 A Unified Theory of Action Selection and Memory

Figure 1.1. Three fundamental constructs of O-SCFT

Figure 1.2. The guideline we adopted for selecting our architecture

Figure 1.3. Development of the sensory nervous system and the somatic nervous system, and interneurons connecting them with the action selection process (adapted from [KIT 15a])

Figure 1.4. Continuous cyclic loop of perception and movement (adapted from [KIT 14a])

2 NDHB-Model/RT: Nonlinear Dynamic Human Behavior Model with Realtime Constraints

Figure 2.1. Maximum satisfaction architecture (MSA)

Figure 2.2. Conditions to make people feel satisfaction

Figure 2.3. Interaction between brain and environment based on feed-forward control

Figure 2.4. Formation of cerebrum

Figure 2.5. Information flows in the brain

Figure 2.6. The structure of meme

Figure 2.7. Propagation of meme

Figure 2.8. Evolution of meme

Figure 2.9. Outline of MHP/RT (adapted from our article [KIT 15b], Figure 2). Solid lines indicates information for System 1 based processing and dotted lines indicates information for System 2 based processing. These two flows are synchronized before carrying out some behavior

Figure 2.10. MHP/RT (adapted from our article [KIT 12a])

Figure 2.11. Newell’s time scale of human action [NEW 90] and behavioral characteristics of each band

Figure 2.12. How the four processing modes work (adapted from our article [KIT 13])

Figure 2.13. Onset of consciousness and emergence of emotion (adapted from our article [KIT 15b])

Figure 2.14. Determination of next behavior (adapted from our article [KIT 15b])

3 Layered-structure of Memory and its Development

Figure 3.1. Continuous cyclic loop of perception and movement (repeated from Introduction)

Figure 3.2. Multidimensional memory frame (adapted from our article [KIT 13])

Figure 3.3. Relationships between the autonomous processing modules in MHP/RT and multidimensional memory frames in the distributed memory system (adapted from our article [KIT 14c])

Figure 3.4. A close-up view of the distributed memory system

Figure 3.5. Functional flow structure, layered structure and evolving cyclic network structure (adapted from our article [KIT 14c])

Figure 3.6. Memory reaction under real-time constraints (adapted from [KIT 12b])

Figure 3.7. MD-frames and emotion (an updated version of Figure 3.4)

4 Implication for Human–Machine Interaction: Autonomous System Interaction Design (ASID) based on NDHB-Model/RT

Figure 4.1. Users modeled by MHP/RT with MD memory frames

Figure 4.2. Society of linear systems and society of autonomous systems

Figure 4.3. An example of society composed of autonomous systems interaction (ASI)

5 Cognitive Chrono-ethnography

Figure 5.1. The CCE procedure

6 A CCE Study: Slow Self-paced Navigation

Figure 6.1. Signboard at the Tokyo station

Figure 6.2. Left: participant performing a task at the Sugamo station; center: the equipment; right: interview after task

7 Fast Externally-paced Navigation

Figure 7.1. Experimental setup (adapted from [KIT 09])

Figure 7.2. An example of route sketched by a participant

Figure 7.3. Episode 1: information that specified the point of action by using an easy-to-understand reference for the driver (adapted from [KIT 09])

Figure 7.4. Episode 2: information that caused the driver to pay attention to events for safe driving (adapted from [KIT 09])

Figure 7.5. Episode 3: information for safe and smooth driving. Note that cars drive on the left lanes in Japan (adapted from [KIT 09])

8 Designing for Future Needs

Figure 8.1. t-Translation invariant principle

Figure 8.2. Fan structure

Figure 8.3. Illustration of the field observation: a) three elite monitors in their seats watching a game, b) ear-mounted CCD camera, c) the view of the ear-mount camera and d) an electrocardiograph and an accelerometer

Figure 8.4. A screen shot from the interview session

Figure 8.5. A participant’s fan history during the period from 2004 to 2008

Figure 8.6. The evolution trajectory of each elite monitor. Left: the paths for those who had not known baseball when they were at the pre-fan stage. Right: the paths for those who had not been fan of this specific team when they were at the pre-fan stage

Guide

Cover

Table of Contents

Begin Reading

Pages

C1

iii

iv

v

ix

x

xi

xii

xiii

xiv

xv

1

3

4

5

6

7

8

9

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

58

59

60

61

62

63

64

65

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

133

134

135

136

137

138

139

141

142

143

144

145

Memory and Action Selection in Human–Machine Interaction

Volume 1

Munéo Kitajima

Human–Machine Interaction Set

coordinated byJérôme Dinet