Human–computer interaction Books

Book SynopsisThe long-standing cultural imperative of augmenting human intellect continues to move ever closer to its full manifestation, described by Marshall McLuhan as an extension of the human nervous system. The escalating blending of immersive technologies with advanced computation has created an emerging domain which increasingly allows socio-technical system makers to produce not only human-computer interactions, but advanced, multi-minded human+computer (H+C) systems. The critical shift toward user immersion within systems of digital information and simulation makes the scale of immersive media's potential impact on human life, culture and well-being unlike that of any previous medium. In Designing XR, Peter (Zak) Zakrzewski presents H+C immersion as a multi-dimensional design problem - a Research Through Design (RTD) zone which addresses the question of: How can transformative design-thinking-based knowledge system complement the existing human-computer interaction (HCI) invention model to contribute to the creation of more participatory, socially viable, and humane immersive media environments? The book lays out a proposal for ushering the creation of ecologically sound augmented mind based on two essential tasks. The first involves a framework for the design, implementation, and iteration of purposeful, multi-minded, participatory immersive H+C systems. The second focuses on the extended reality experience (XRX) design practice that rhetorically invites users to actively engage with immersive systems while fully exercising their autonomy and agency based on informed choice.Table of ContentsChapter 1. What is Mind? Chapter 2. Probing the Frame: Immersion is not Interaction Chapter 3. Designing the Artificial: Balancing the Ego-Logical and Ecological Thinking Chapter 4. The Ecology of the Augmented Mind: Designing Immersive Human+Computer Systems Chapter 5. Extended Reality Experience (XRX) Design: The Multimodal Rhetorical Framework for Creating Persuasive Immersion

Read more less

Book SynopsisInformation technology is becoming ingrained in our everyday life. The consequence of this is that the line between humans and technology is more and more blurred, and tends to transform the human being into a cyber-organism. This transformation, accompanied by the emergence of Industry 4.0, brings us to define a new term: Human 4.0. This new generation of individuals has to deal with smart interconnected pervasive environments supported by the internet of things. Nevertheless, this merge between humans and technology is not straight-forward and requires an additional effort to reduce the gap between the human being and the machine. Such research implies a multidisciplinary approach to the interaction between biological organisms and artificial artefacts. This book intends to provide the reader with an insight into the new relationship with the technology brought about by Industry 4.0, and how it can make the human-machine interaction more efficient.

Read more less

Book SynopsisThis book is a study of the causes of spam, the behaviors associated to the generation of and the exposure to spam, as well as the protection strategies. The new behaviors associated to electronic communications are identified and commented. Have you ever felt overwhelmed by the number of e-mail and textual messages in your inbox, be it on your laptop, your Smartphone or your PC? This book should help you in finding a wealth of answers, tools and tactics to better surf the ICT wave in the professional environment, and develop proper protection strategies to mitigate your exposure to spam in any form.Table of ContentsAcknowledgements ix Preface xi Introduction xv Chapter 1. Electronic Mail 1 1.1. Electronic mail, what is it exactly? 1 1.2. The most used communication tool in the professional world 2 1.2.1. E-mail or telephone? 2 1.2.2. A growth that is not slowing down 3 1.2.3. A perfectly adapted tool for a business in touch 4 1.3. Characteristics and beginning of misuse 4 1.3.1. A remote and asynchronous means of communication 5 1.3.2. Almost instantaneous and interactive 6 1.3.3. Textual 7 1.3.4. Ubiquitous and mobile 8 1.3.5. Which allows numerous messages to be sent 8 1.3.6. On to the storing and archiving of messages 9 1.4. E-mail versus other communication tools 10 1.5. The structure of e-mail and its susceptibility to misuse 12 1.5.1. Structure 12 1.5.2. Envelope and body of the message: two possible targets 14 1.6. Other forms of electronic communication, other flaws 15 1.6.1. Instant messaging 15 1.6.2. Micro-blogging 16 1.6.3. Social networks 17 1.7. Conclusion 17 Chapter 2. From Role to Identity 19 2.1. Roles, boundaries and transitions 19 2.1.1. Spatial and temporal boundaries 20 2.2. Roles 21 2.2.1. Definition 21 2.2.2. Role boundaries 23 2.2.3. Transitions between roles 26 2.3. Identities 28 2.4. Conclusion 30 Chapter 3. Roles and the Digital World 33 3.1. When electronic communications disrupt space-time 33 3.1.1. The transformation of space 34 3.1.2. The transformation of time 34 3.1.3. The transformation of distance 35 3.1.4. Mobility and ubiquity 37 3.2. Role transformation 38 3.2.1. Role boundaries 38 3.2.2. Flexibility 38 3.2.3. Permeability 41 3.2.4. Role separation 41 3.2.5. Transitions between roles 42 3.3. Conclusion 43 Chapter 4. Challenges in Communication 45 4.1. Interpersonal communication: a subtle tool 45 4.2. Misunderstanding in communication 46 4.2.1. Sources of misunderstanding 47 4.2.2. The absence of an operating communication channel 47 4.2.3. The absence of a common vocabulary 48 4.2.4. Exclusive information context 48 4.2.5. Situations involving incomprehension 49 4.2.6. Distance communication 49 4.2.7. Asynchronous communication 50 4.2.8. Heterogeneous competence domains or levels 50 4.2.9. Man–machine communication 50 4.2.10. E-mail: the accumulation of obstacles to comprehension 50 4.3. From misunderstanding to a lack of respect 51 4.4. A challenge for digital managers: communicating with the absent other 53 4.4.1. A lower volume of communication 53 4.4.2. A drop in communication quality 54 4.5. Conclusion 55 Chapter 5. Defining Spam 57 5.1. What is spam? 57 5.2. Preface: the influence of role on users’ perceptions of messages 57 5.3. Classifying e-mails according to role management theory 61 5.3.1. Roles and direct and indirect idiosyncratic connections 61 5.3.2. Roles played, transitions and perception of e-mail 65 5.4. Message classification model 68 5.4.1. E-mails received from unknown sources 68 5.4.2. Commercial spam 69 5.4.3. Fraudulent spam 70 5.4.4. E-mail received from known (trusted) sources 70 5.5. Conclusion 73 Chapter 6. A Lack of Ethics that Disrupts E-mail Communication 75 6.1. There is a new behavior behind every technical asset 75 6.2. Ethics and Information and Communication Technologies 76 6.3. Glossary of misuses and some of their consequences 79 6.4. Conclusion 104 Chapter 7. The Deadly Sins of Electronic Mail 105 7.1. Carefree exuberance 105 7.2. Confused identity 107 7.3. Cold indifference 108 7.4. Impassioned anger 109 7.5. Lost truth 111 7.6. The door of secrets 112 7.6.1. The ethical approach 112 7.6.2. The managerial approach 113 7.7. Fraudulent temptation 114 7.8. What answers should be given to these questions? 115 Chapter 8. The Venial Sins of Electronic Mail 117 8.1. Information overload 117 8.2. Anonymous disrespect 118 8.3. Communication poverty 118 8.4. Misunderstanding 119 8.4.1. Poorly written messages 119 8.4.2. Misread messages 119 8.4.3. When faced with misunderstanding, is empathy a solution? 120 8.5. Culpable ambiguity 120 8.6. Humor, love, rumors, and all the rest 120 Chapter 9. Exposure to Spam and Protection Strategies 123 9.1. Risk behaviors 123 9.1.1. Dynamic factors of spam exposure 124 9.1.2. Static factors of spam exposure 131 9.1.3. Other risks of spam exposure 133 9.2. Protection strategies 134 9.2.1. Keeping separate e-mail accounts 134 9.2.2. Using complex addresses 136 9.2.3. Treating received spam appropriately 136 9.2.4. Checking our e-proximity and network 138 9.2.5. Filters 139 9.2.6. Modify our sensitivity to spam 142 9.3. Conclusion 142 Concluding Recommendations 145 Bibliography 151 Index 157

Read more less

Book SynopsisNowadays approximately 6 billion people use a mobile phone and they now take a central position within our daily lives. The 1990s saw a tremendous increase in the use of wireless systems and the democratization of this means of communication. To allow the communication of millions of phones, computers and, more recently, tablets to be connected, millions of access points and base station antennas have been extensively deployed. Small cells and the Internet of Things with the billions of connected objects will reinforce this trend. This growing use of wireless communications has been accompanied by a perception of risk to the public from exposure to radio frequency (RF) electromagnetic field (EMF). To address this concern, biomedical research has been conducted. It has also been important to develop and improve dosimetry methods and protocols that could be used to evaluate EMF exposure and check compliance with health limits. To achieve this, much effort has was made in the 1990s and 2000s. Experimental and numerical methods, including statistical methods, have been developed. This book provides an overview and description of the basic and advanced methods that have been developed for human RF exposure assessment. It covers experimental, numerical, deterministic and stochastic methods.Table of ContentsPreface vii Chapter 1. Human RF Exposure and Communication Systems 1 1.1 Introduction 1 1.2 Metric and limits relative to human exposure 3 1.3 European standards and regulation framework 36 1.4 Conclusion 39 Chapter 2. Computational Electromagnetics Applied to Human Exposure Assessment 41 2.1 Introduction 41 2.2 Finite difference in time domain to solve the Maxwell equations 42 2.3 FDTD and human exposure assessment 71 2.4 RF exposure assessment 103 2.5 Conclusion 117 Chapter 3. Stochastic Dosimetry 119 3.1 Motivations 119 3.2 The challenge of variability for numerical dosimetry 120 3.3 Stochastic dosimetry and polynomial chaos expansion 122 3.4 PC and numerical dosimetry 125 3.5 Calculation of the PC coefficients 131 3.6 Design of experiments 135 3.7 Predictive model validation 140 3.8 Surrogate modeling for dosimetry 142 3.9 SA and signature of the PC 150 3.10 Parsimonious quintile estimation 155 3.11 Conclusion 155 Conclusion 157 Bibliography 159 Index 179

Read more less

Book SynopsisThere is a great transformation of the production of knowledge and intelligibility. The "digital fold of the world" (with the convergence of NBIC) affects the collective assemblages of “thought”, of research. The aims of these assemblages are also controversial issues. From a general standpoint, these debates concern “performative science and performative society”. But one emerges and strengthens that has several names: transhumanism, post-humanism, speculative post-humanism. It appears as a great narration, a large story about the future of our existence, facing our entry into the Anthropocene. It is also presented as a concrete utopia with an anthropological and technical change. In this book, we proposed to show how collective intelligences stand in the middle of the coupling of ontological horizons and of the “process of bio-technical maturation”.Table of ContentsIntroduction ix Chapter 1. Elements of the General Configuration and Adaptive Landscape of Collective Intelligences 1 1.1. The intertwined narratives of tangible utopias and brilliant futures 1 1.2. Intelligence is “always already collective and machined” 5 1.3. Collective intelligences in the weaving of data 9 1.4. Semiotics and statistics 13 1.5. Data cities and human becomings: the new milieus of intelligence 17 1.5.1. Open Data (OD): a heterogeneous movement, the contribution to novel forms of knowledge in question 22 1.6. Coupling OD/big data/data mining 32 1.7. The semantic web as intellectual technology 34 1.8. Toward understanding onto-ethologies 42 1.9. Marketing intelligences: data and graphs in the heat of passions 50 1.10. Personal data: private property as an open and unstable process 59 1.11. The figures of the network 64 1.12. Machinic interfaces: social subjection and enslavement 67 1.13. Collective intelligences and anthropological concerns 70 1.14. Toward a new encyclopedic state: first overview 74 1.15. Controversies and boundaries 78 1.16. The milieus of intelligence and knowledge 84 1.17. Which criteria for writings? 86 1.18. Collective intelligences of usage and doxic collective intelligences: the status of short forms 90 1.19. Collective intelligences, self-organization, “swarm” intelligences 92 1.20. Short forms, relinkage, relaunching 99 1.21. Insomniac commentary as a catastrophic correction of short forms 100 1.22. Twitter as a Markovian Territory: a few remarks 103 Chapter 2. Post- and Transhumanist Horizons 107 2.1. Some bioanthropotechnical transformations 107 2.2. What to do with our brain? 113 2.3. About transhumanism and speculative posthumanism 122 2.4. Epigenetic and epiphylogenetic plasticity 125 2.5. Speculative uncertainties 127 2.6. Trans- and posthumanism as they present themselves 152 Chapter 3. Fragmented Encyclopedism 169 3.1. Collective intelligences and the encyclopedic problem 169 3.2. The political utopia in store 170 3.3. Encyclopedism and digital publishing modes 174 3.4. A new documentary process 176 3.5. Fragmented encyclopedism: education/interfaces 190 3.6. Encyclopedism and correlations 192 3.6.1. “Correlation is enough”: the Anderson controversy, and the J. Gray paradigm and their limits 192 3.7. “Perplication” in knowledge 198 3.7.1. Doxic tension in fragmented encyclopedism and format accordingly 198 3.8. Networks of the digital environment 199 3.8.1. Variations of speed and slowness at the center of encyclopedic pragmatics 200 3.9. Knowledge and thought in fragmented encyclopedism 201 3.10. What criteriology for encyclopedic writings? 202 3.11. Borders in fragmented encyclopedism: autoimmune disorders and disagreement 205 3.12. Fragmented encyclopedism: a habitat for controversies? 207 3.13. Encyclopedism according to the semantic and sociosemantic web (ontologies and web): mapping(s) and semantic levels 209 3.14. From ontologies to “onto-ethologies” and assemblages 212 3.15. Fragmented encyclopedism in the digital age: metalanguage and combinatorial 214 3.15.1. Encyclopedism and doxic immanence field: the proliferation of short forms 216 3.16. From fragmented encyclopedism to gaseous encyclopedism 217 Bibliography 219 Index 233Conclusion

Read more less

Book SynopsisOver the last few years, multi-touch mobile devices have become increasingly common. However, very few applications in the context of 3D geometry learning can be found in app stores. Manipulating a 3D scene with a 2D device is the main difficulty of such applications. Throughout this book, the author focuses on allowing young students to manipulate, observe and modify 3D scenes using new technologies brought about by digital tablets. Through a user-centered approach, the author proposes a grammar of interactions adapted to young learners, and then evaluates acceptability, ease of use and ease of learning of the interactions proposed. Finally, the author studies in situ the pedagogic benefits of the use of tablets with an app based on the suggested grammar. The results show that students are able to manipulate, observe and modify 3D scenes using an adapted set of interactions. Moreover, in the context of 3D geometry learning, a significant contribution has been observed in two classes when students use such an application. The approach here focuses on interactions with digital tablets to increase learning rather than on technology. First, defining which interactions allow pupils to realize tasks needed in the learning process, then, evaluating the impact of these interactions on the learning process. This is the first time that both interactions and the learning process have been taken into account at the same time.Table of ContentsPreface ix Introduction xi Chapter 1. Construction of Spatial Representation and Perspective in Students 1 1.1. Spatial representation in children according to Piaget 3 1.1.1. From perception to representation 3 1.1.2. Projective space 8 1.1.3. Euclidean space 13 1.1.4. Summary 14 1.2. The representation of geometric objects: the status of drawings 15 1.2.1. Status of drawings in mathematics: drawings versus figures 15 1.2.2. Use of geometrical representations 18 1.2.3. The three main functions of drawings in geometry 25 1.3. From the physical shape to its planar representation 25 1.3.1. The institutional perspective 25 1.3.2. Teaching 3D geometry 27 1.3.3. Different representations of 3D objects 29 1.3.4. The conflict between the SEEN and the KNOWN in children 34 1.4. Benefits of new technologies and dynamic 3D geometry 37 1.4.1. Advantages of 3D geometry programs 38 1.4.2. Limits of 3D geometry programs and consequences 40 1.4.3. Partial conclusions and initial hypotheses 46 Chapter 2. Mobile Devices and 3D Interactions 49 2.1. Why mobile devices? 50 2.1.1. A long-standing tradition in mathematics 51 2.1.2. Interest from the educational community 54 2.1.3. A field reality 56 2.2. Mobile devices 57 2.2.1. Different types of mobile devices 58 2.2.2. Entry systems of mobile terminals 61 2.3. Interactions on mobile devices and physiology 70 2.3.1. Specificities of mobile devices 70 2.3.2. Limitations due to physiologic characteristics 71 2.4. 3D interaction techniques 74 2.4.1. Mathematical reminders 74 2.4.2. 3D selection/manipulation and navigation interactions 77 2.5. “Language” of interactions and classifications 88 2.5.1. Language and grammar of gestures 89 2.5.2. Classifications 92 Chapter 3. Elaboration and Classification of Interactions 95 3.1. Human-centered design 95 3.1.1. A definition 96 3.1.2. Principles of the user-based approach 97 3.2. Study of the needs and behaviors of users 98 3.2.1. Study of pre-existing 3D geometry software 98 3.2.2. Study of users’ behaviors and needs 103 3.3. Our grammar and interaction language 109 3.3.1. Classification of tactile movement interactions 109 3.3.2. Definition of the grammar 111 3.3.3. The prototype: FINGERS (Find INteractions for GEometry leaneRS) 112 3.3.4. Our gestural language of interactions 114 3.4. Evaluation of the acceptance of interactions (selection, translation and rotation) 133 3.4.1. Experimental challenges and constraints 133 3.4.2. Preliminary evaluation of the acceptance of rotation and point of view change interactions 134 3.4.3. Comparison between gyroscope, face-tracking and multi-touch 140 3.4.4. Student learning of prototype interactions 147 3.5. Conclusion and perspectives 152 Chapter 4. Evaluation of the Educational Benefits for 3D Geometry 155 4.1. Partnerships 156 4.1.1. The schools in the field 156 4.1.2. The ESPÉ 157 4.1.3. Mathematics teachers’ associations 157 4.2. Limits 157 4.2.1. Ethical: the equality of chances for students 157 4.2.2. Practical: progression of the concepts throughout the year . 158 4.3. Evaluation of problem solving aids 158 4.3.1. In the field 159 4.3.2. Laboratory (EEG) 166 4.4. Evaluation of the benefits in learning 3D geometry 174 4.4.1. Participants 174 4.4.2. Material and experimental conditions 174 4.4.3. Experimental plan 176 4.4.4. Results and discussion 178 4.5. Partial conclusions 185 Conclusion 187 Bibliography 191 Index 203

Read more less

Book SynopsisThe first goal of this book is to extend Two Minds originating from behavioral economics to the domain of interaction, where the time dimension has to be dealt with rigorously; in human–machine interaction, it is of crucial importance how synchronization between conscious processes and unconscious processes is established for a sense of smoothness, and how memory processes and action selection processes are coordinated. The first half this book describes the theory in detail. The book begins by outlining the whole view of the theory consisting of action selection processes and memorization processes, and their interactions. Then, a detailed description for action selection processes theorized as a nonlinear dynamic human behavior model with real-time constraints is provided, followed by a description for memorization processes. Also, implications of the theory to human–machine interactions are discussed. The second goal of this book is to provide a methodology to study how Two Minds works in practice when people use interactive systems. The latter half of this book describes theory practices in detail. A new methodology called Cognitive Chrono-Ethnography (CCE) is introduced, which adds the time dimension to Hutchins’ Cognitive Ethnography, in order to practice "know the users" systematically by designing user studies based on a simulation of users’ mental operations controlled by Two Minds. The author then shows how CCE has been applied to understanding the ways in which people navigate in real physical environments by walking and by car, respectively, and explores the possibility of applying CCE to predict people’s future needs. This is not for understanding how people use interfaces at present but to predict how people want to use the interfaces in the future given they are currently using them in a certain way Finally, the book concludes by describing implications of human–machine interactions that are carried out while using modern artefacts for people's cognitive development from birth, on the basis of the theories of action selection and memorization.Table of ContentsIntroduction ix Part 1. Theoretical Foundation for Dealing with Action Selection and Memorization 1 Chapter 1. A Unified Theory of Action Selection and Memory 3 1.1. Organic self-consistent field theory 3 1.1.1. Self-consistent field theory in physics 3 1.1.2. “Organic” SCFT 4 1.1.3. Human beings considered in O-SCFT 4 1.1.4. Scale mix 5 1.2. Development of brain architecture model under the NDHBmodel/RT 6 1.2.1. O-PDP 6 1.2.2. The guideline for architecture selection 6 1.2.3. Development of cross-networks of neurons in the brain 7 Chapter 2. NDHB-Model/RT: Nonlinear Dynamic Human Behavior Model with Realtime Constraints 11 2.1. Maximum satisfaction architecture 11 2.1.1. Happiness goals 11 2.1.2. Society layers 12 2.1.3. Brain layers 12 2.1.4. Conditions to make people feel satisfaction 15 2.2. Brain information hydrodynamics 16 2.2.1. The time axis is central to information flow 17 2.2.2. Cerebrum formation process 17 2.2.3. Information flows in the brain 19 2.2.4. Emergence of emotion in BIH 20 2.2.5. Biorhythm of information flow 21 2.2.6. Role of language 21 2.2.7. Multiple personality disorder 21 2.3. Structured meme theory 22 2.3.1. Meme 22 2.3.2. Memes propagate by means of resonance 23 2.3.3. Characteristics of meme propagation 24 2.4. NDHB-model/RT 25 2.5. MHP/RT: Model human processor with real-time constraints 27 2.5.1. MHP/RT’s basic flow 28 2.5.2. Basic MHP/RT behaviors 30 2.6. Two Minds and emotions 36 2.6.1. Dynamics of consciousness–emotion interaction: an explanation by MHP/RT 37 2.6.2. Taxonomy of emotions: behavioral perspective 40 Chapter 3. Layered-structure of Memory and its Development 43 3.1. MHP/RT modules and their associated memories 43 3.1.1. Memory formation process 45 3.1.2. MD memory frames 46 3.1.3. Memory functions via resonance 49 3.1.4. Memory operates in pipelining 49 3.2. Hierarchical structure of human action selection 51 3.2.1. Three-layered structure of interneurons system 51 3.2.2. Formation process 51 3.3. Emotion initiation via memory processes 54 Chapter 4. Implication for Human–Machine Interaction: Autonomous System Interaction Design (ASID) based on NDHB-Model/RT 57 4.1. Users modeled by MHP/RT with MD memory frames 57 4.2. Autonomous systems versus linear systems 58 4.2.1. Linear systems 58 4.2.2. Autonomous systems 60 4.3. Needs that a society of information systems must meet 60 4.4. Outline of ASI 61 4.5. Conclusions 62 Part 2. Theoretically Motivated Methodology for Understanding Users 65 Chapter 5. Cognitive Chrono-ethnography 67 5.1. Understanding people’s behavior in real life 67 5.2. Cognitive chrono-ethnography 69 5.2.1. Requirements for the methodology (CCE) to study human beings’ behavior in real life 69 5.2.2. CCE procedure 70 5.2.3. Behavior selection shaping factors 72 Chapter 6. A CCE Study: Slow Self-paced Navigation 75 6.1. Introduction: navigation in a train station by following signs 75 6.2. Steps 1 and 2 of CCE 76 6.2.1. Attention, planning and working memory 77 6.2.2. An MHP/RT simulation of navigation behavior 78 6.3. Step 3 of CCE: monitor recruiting 82 6.3.1. Investigation of cognitive aging characteristics 82 6.4. Steps 4 and 5 of CCE: monitor behavior observation and individual model construction 83 6.4.1. Train stations, tasks and participants 84 6.4.2. Method 85 6.5. Step 6 of CCE: socioecological model construction 86 6.6. Discussion 87 6.6.1. Two modes of navigation 87 6.6.2. Web navigation 88 6.6.3. Nature of complicated navigation processes 90 6.7. Conclusions 90 Chapter 7. Fast Externally-paced Navigation 93 7.1. Introduction 93 7.2. Steps 1 and 2 of CCE 95 7.2.1. Designing a CCE study 96 7.3. Step 3 of CCE: monitor recruiting 98 7.3.1. Screening 99 7.3.2. Interview for the final selection 100 7.4. Steps 4 and 5 of CCE: monitor behavior observation and individual model construction 100 7.4.1. Data analysis 100 7.4.2. Information necessary for safe and enjoyable driving 102 7.4.3. Examples 103 7.5. Conclusions 105 Chapter 8. Designing for Future Needs 109 8.1. Introduction 109 8.2. Making inaccessible future needs accessible: t-translation invariant principle 110 8.3. A case study of CCE: why do fans repeat visits to the ballpark? 112 8.3.1. Steps 1 and 2 of CCE 112 8.3.2. Step 3 of CCE: monitor recruiting 115 8.3.3. Step 4 of CCE: field observation 115 8.3.4. Step 5 of CCE: conduct retrospective interviews 116 8.3.5. Step 6 of CCE: socioecological model construction 117 8.3.6. Results: developing from a pre-fan to a repeater 120 8.4. Discussion 122 8.4.1. Selection of elite monitors 122 8.4.2. CCE interview 122 8.4.3. Applicability of CCE 123 8.5. Conclusions 124 Conclusion 127 Bibliography 133 Index 137

Read more less

Book SynopsisBrain–computer interfaces (BCI) are devices which measure brain activity and translate it into messages or commands, thereby opening up many possibilities for investigation and application. This book provides keys for understanding and designing these multi-disciplinary interfaces, which require many fields of expertise such as neuroscience, statistics, informatics and psychology. This second volume, Technology and Applications, is focused on the field of BCI from the perspective of its end users, such as those with disabilities to practitioners. Covering clinical applications and the field of video games, the book then goes on to explore user needs which drive the design and development of BCI. The software used for their design, primarily OpenViBE, is explained step by step, before a discussion on the use of BCI from ethical, philosophical and social perspectives. The basic notions developed in this reference book are intended to be accessible to all readers interested in BCI, whatever their background. More advanced material is also offered, for readers who want to expand their knowledge in disciplinary fields underlying BCI.Table of ContentsForeword xvJosé DEL R. MILLÁN Introduction xviiMaureen CLERC, Laurent BOUGRAIN and Fabien LOTTE Part 1. Fields of Application 1 Chapter 1. Brain–Computer Interfaces in Disorders of Consciousness 3Jérémie MATTOUT, Jacques LUAUTÉ, Julien JUNG and Dominique MORLET 1.1. Introduction 3 1.2. Altered states of consciousness: etiologies and clinical features 4 1.3. Functional assessment of patients with altered states of consciousness (passive paradigms) 6 1.4. Advanced approaches to assessing consciousness (active paradigms) 12 1.5. Toward the real-time use of functional markers 15 1.6. Conclusion and future outlook 19 1.7. Bibliography 21 Chapter 2. Medical Applications: Neuroprostheses and Neurorehabilitation 29Laurent BOUGRAIN 2.1. Motor deficiencies 30 2.2. Compensating for motor deficiency 32 2.3. Conclusions 39 2.4. Bibliography 39 Chapter 3. Medical Applications of BCIs for Patient Communication 43François CABESTAING and Louis MAYAUD 3.1. Introduction 43 3.2. Reactive interfaces for communication 49 3.3. Active interfaces for communication 53 3.4. Conclusions 59 3.5. Bibliography 60 Chapter 4. BrainTV: Revealing the Neural Bases of Human Cognition in Real Time 65Jean-Philippe LACHAUX 4.1. Introduction and motivation 65 4.2. Toward first person data accounting 66 4.3. Bringing subjective and objective data into the same space: conscious experience of the subject 69 4.4. Technical aspects: the contribution of brain–computer interfaces 70 4.5. The BrainTV system and its applications 75 4.6. BrainTV limitations 81 4.7. Extension to other types of recordings 82 4.8. Conclusions 82 4.9. Bibliography 83 Chapter 5. BCIs and Video Games: State of the Art with the OpenViBE2 Project 85Anatole LÉCUYER 5.1. Introduction 85 5.2. Video game prototypes controlled by BCI 88 5.3. Industrial prototypes: the potential for very different kinds of games 93 5.4. Discussion 96 5.5. Conclusion 98 5.6. Bibliography 98 Part 2. Practical Aspects of BCI Implementation 101 Chapter 6. Analysis of Patient Need for Brain–Computer Interfaces 103Louis MAYAUD, Salvador CABANILLES and Eric AZABOU 6.1. Introduction 103 6.2. Types of users 108 6.3. Interpretation of needs in BCI usage contexts 113 6.4. Conclusions 117 6.5. Bibliography 119 Chapter 7. Sensors: Theory and Innovation 123Jean-Michel BADIER, Thomas LONJARET and Pierre LELEUX 7.1. EEG electrodes 125 7.2. Invasive recording 128 7.3. Latest generation sensors 130 7.4. Magnetoencephalography 137 7.5. Conclusions 139 7.6. Bibliography 140 Chapter 8. Technical Requirements for High-quality EEG Acquisition 143Emmanuel MABY 8.1. Electrodes 144 8.2. Montages . 145 8.3. Amplifiers 147 8.4. Analog filters 152 8.5. Analog-to-digital conversion 152 8.6. Event synchronization with the EEG 155 8.7. Conclusions 159 8.8. Bibliography 160 Chapter 9. Practical Guide to Performing an EEG Experiment 163Emmanuel MABY 9.1. Study planning 163 9.2. Equipment 166 9.3. Experiment procedure 170 9.4. Bibliography 177 Part 3 . Step by Step Guide to BCI Design with OpenViBE 179 Chapter 10. OpenViBE and Other BCI Software Platforms 181Jussi LINDGREN and Anatole LECUYER 10.1. Introduction 181 10.2. Using BCI for control 183 10.3. BCI processing stages 184 10.4. Exploring BCI 187 10.5. Comparison of platforms 189 10.6. Choosing a platform 195 10.7. Conclusion 196 10.8. Bibliography 197 Chapter 11. Illustration of Electrophysiological Phenomena with OpenViBE 199Fabien LOTTE and Alison CELLARD 11.1. Visualization of raw EEG signals and artifacts 200 11.2. Visualization of alpha oscillations 201 11.3. Visualization of the beta rebound 203 11.4. Visualization of the SSVEP 206 11.5. Conclusions 208 11.6. Bibliography 209 Chapter 12. Classification of Brain Signals with OpenViBE 211Laurent BOUGRAIN and Guillaume SERRIÈRE 12.1. Introduction 211 12.2. Classification 212 12.3. Evaluation 216 12.4. Conclusions 224 12.5. Bibliography 224 Chapter 13. OpenViBE Illustration of a P300 Virtual Keyboard 227Nathanaël FOY, Théodore PAPADOPOULO and Maureen CLERC 13.1. Target/non-target classification 228 13.2. Illustration of a P300 virtual keyboard 235 13.3. Bibliography 240 Chapter 14. Recreational Applications of OpenViBE: Brain Invaders and Use-the-Force 241Anton ANDREEV, Alexandre BARACHANT, Fabien LOTTE and Marco CONGEDO 14.1. Brain Invaders 241 14.2. Implementation 248 14.3. Use-The-Force! 251 14.4. Conclusions 256 14.5. Bibliography 257 Part 4. Societal Challenges and Perspectives 259 Chapter 15. Ethical Reflections on Brain–Computer Interfaces 261Florent BOCQUELET, Gaëlle PIRET, Nicolas AUMONIER and Blaise YVERT 15.1. Introduction 262 15.2. The animal 264 15.3. Human beings 267 15.4. The human species 274 15.5. Conclusions 279 15.6. Bibliography 281 Chapter 16. Acceptance of Brain–machine Hybrids: How is Their Brain Perceived In Vivo? 289Bernard ANDRIEU 16.1. Ethical problem 289 16.2. The method 291 16.3. Ethics of experimentation: Matthew Nagle, the first patient 293 16.4. Body language in performance 296 16.5. Ethics of autonomous (re)socialization 297 16.6. Conclusions . 303 16.7. Bibliography 304 16.8. Appendix (verbatim video retranscriptions) 304 Chapter 17. Conclusion and Perspectives 311Maureen CLERC, Laurent BOUGRAIN and Fabien LOTTE 17.1. Introduction 311 17.2. Reinforcing the scientific basis of BCIs 314 17.3. Using BCI in practice 316 17.4. Opening up BCI technologies to new applications and fields 318 17.5. Concern about ethical issues 321 17.6. Conclusions 321 17.7. Bibliography 322 List of Authors 325 Index 329 Contents of Volume 1 333

Read more less

Book Synopsis'Artificial intelligence is going to have a massive impact on everyone’s lives... an accessible and sensible read that helps demystify AI' Deborah Meaden, entrepreneur and star of Dragon's Den'Nigel Toon is a visionary leader in the field of artificial intelligence... a must-read' Marc Tremblay, Distinguished Engineer, MicrosoftThose who understand how AI thinks are about to win big.We are used to thinking of computers as being a step up from calculators - very good at storing information, and maybe even at playing a logical game like chess. But up to now they haven't been able to think in ways that are intuitive, or respond to questions as a human might. All that has changed, dramatically, in the past few years.Our search engines are becoming answer engines. Artificial intelligence is already revolutionising sectors from education to healthcare to the creative arts. But how does an AI understand sentiment or context? How does it play and win games that have an almost infinite number of moves? And how can we work with AI to produce insights and innovations that are beyond human capacity, from writing code in an instant to unfolding the elaborate 3D puzzles of proteins?We stand at the brink of a historic change that will disrupt society and at the same time create enormous opportunities for those who understand how AI thinks. Nigel Toon shows how we train AI to train itself, so that it can paint images that have never existed before or converse in any language. In doing so he reveals the strange and fascinating ways that humans think, too, as we learn how to live in a world shared by machine intelligences of our own creation.Trade ReviewFew books are more timely than How AI Thinks, an accessible guide that walks the reader through the technology’s developmental history right back to the days before the computer... This is a fascinating read. -- Simon Hunt * Evening Standard *I believe that AI is going to have a massive impact on everyone’s lives; it’s such a hugely important topic that we can’t just leave it to technologists and governments to think about. Business people, teachers, students and parents - everyone needs to learn more about it. In How AI Thinks, Nigel Toon provides us with an accessible and sensible read that helps demystify AI and lets us all understand more about this incredibly powerful tool. -- Deborah Meaden, entrepreneur and star of Dragon's DenNigel Toon is not only a visionary leader in the field of artificial intelligence, but also a captivating storyteller who takes us on a journey through his own fascinating history and the evolution of our young industry. He has a gift for explaining complex concepts in simple terms, making this book accessible and engaging for anyone interested in AI. He also offers a prescriptive and optimistic view of the future of AI, showing how it can transform our lives and society for the better. This book is a must-read for anyone who wants to understand the past, present and future of artificial intelligence. -- Marc Tremblay PhD, Distinguished Engineer, MicrosoftAn insightful, informative, inspiring book which takes the reader on a journey of discovery, it ultimately paints a hopeful and reasoned vision of how humanity can move on from a position of fear and trepidation, and embrace AI, deriving profound benefit from all it makes possible. Nigel has a skill in taking highly technical content and making AI not just comprehensible, but also engaging. -- Professor Evelyn Welch, Vice-Chancellor and President, University of BristolAs a business leader, it was great to have all the strands that have created AI pulled together. Nigel Toon synthesizes everything so clearly, simply and in such an inspiring way. How AI Thinks delivers the perspective that leaders and politicians need so that they can regulate AI well. -- Sir Andrew MacKenzie, Chairman of Shell

Read more less

Book Synopsis

Read more less

Book Synopsis

Read more less

Book Synopsis

Read more less

Book Synopsis

Read more less

Book SynopsisThe field of multimedia is unique in offering a rich and dynamic forum for researchers from “traditional” fields to collaborate and develop new solutions and knowledge that transcend the boundaries of individual disciplines. Despite the prolific research activities and outcomes, however, few efforts have been made to develop books that serve as an introduction to the rich spectrum of topics covered by this broad field. A few books are available that either focus on specific subfields or basic background in multimedia. Tutorial-style materials covering the active topics being pursued by the leading researchers at frontiers of the field are currently lacking.In 2015, ACM SIGMM, the special interest group on multimedia, launched a new initiative to address this void by selecting and inviting 12 rising-star speakers from different subfields of multimedia research to deliver plenary tutorial-style talks at the ACM Multimedia conference for 2015. Each speaker discussed the challenges and state-of-the-art developments of their prospective research areas in a general manner to the broad community. The covered topics were comprehensive, including multimedia content understanding, multimodal human-human and human-computer interaction, multimedia social media, and multimedia system architecture and deployment.Following the very positive responses to these talks, the speakers were invited to expand the content covered in their talks into chapters that can be used as reference material for researchers, students, and practitioners. Each chapter discusses the problems, technical challenges, state-of-the-art approaches and performances, open issues, and promising direction for future work. Collectively, the chapters provide an excellent sampling of major topics addressed by the community as a whole. This book, capturing some of the outcomes of such efforts, is well positioned to fill the aforementioned needs in providing tutorial-style reference materials for frontier topics in multimedia.At the same time, the speed and sophistication required of data processing have grown. In addition to simple queries, complex algorithms like machine learning and graph analysis are becoming common. And in addition to batch processing, streaming analysis of real-time data is required to let organizations take timely action. Future computing platforms will need to not only scale out traditional workloads, but support these new applications too.This book, a revised version of the 2014 ACM Dissertation Award winning dissertation, proposes an architecture for cluster computing systems that can tackle emerging data processing workloads at scale. Whereas early cluster computing systems, like MapReduce, handled batch processing, our architecture also enables streaming and interactive queries, while keeping MapReduce's scalability and fault tolerance. And whereas most deployed systems only support simple one-pass computations (e.g., SQL queries), ours also extends to the multi-pass algorithms required for complex analytics like machine learning. Finally, unlike the specialized systems proposed for some of these workloads, our architecture allows these computations to be combined, enabling rich new applications that intermix, for example, streaming and batch processing.We achieve these results through a simple extension to MapReduce that adds primitives for data sharing, called Resilient Distributed Datasets (RDDs). We show that this is enough to capture a wide range of workloads. We implement RDDs in the open source Spark system, which we evaluate using synthetic and real workloads. Spark matches or exceeds the performance of specialized systems in many domains, while offering stronger fault tolerance properties and allowing these workloads to be combined. Finally, we examine the generality of RDDs from both a theoretical modeling perspective and a systems perspective.This version of the dissertation makes corrections throughout the text and adds a new section on the evolution of Apache Spark in industry since 2014. In addition, editing, formatting, and links for the references have been added.Table of Contents Preface PART I: MULTIMEDIA CONTENT ANALYSIS 1. Deep Learning for Video Classification and Captioning 2. Audition for Multimedia Computing 3. Multimodal Analysis of Free-standing Conversational Groups 4. Encrypted Domain Multimedia Content Analysis 5. Efficient Similarity Search PART II: HUMAN-CENTERED MULTIMEDIA COMPUTING 6. Social-Sensed Multimedia Computing 7. Situation Recognition Using Multimodal Data 8. Hawkes Processes for Events in Social Media 9. Utilizing Implicit User Cues for Multimedia Analytics PART III: MULTIMEDIA COMMUNICATION AND SYSTEMS 10. Multimedia Fog Computing: Minions in the Cloud and Crowd 11. Cloud Gaming Bibliography Index Editor Biography

Read more less

Book SynopsisThe field of multimedia is unique in offering a rich and dynamic forum for researchers from “traditional” fields to collaborate and develop new solutions and knowledge that transcend the boundaries of individual disciplines. Despite the prolific research activities and outcomes, however, few efforts have been made to develop books that serve as an introduction to the rich spectrum of topics covered by this broad field. A few books are available that either focus on specific subfields or basic background in multimedia. Tutorial-style materials covering the active topics being pursued by the leading researchers at frontiers of the field are currently lacking.In 2015, ACM SIGMM, the special interest group on multimedia, launched a new initiative to address this void by selecting and inviting 12 rising-star speakers from different subfields of multimedia research to deliver plenary tutorial-style talks at the ACM Multimedia conference for 2015. Each speaker discussed the challenges and state-of-the-art developments of their prospective research areas in a general manner to the broad community. The covered topics were comprehensive, including multimedia content understanding, multimodal human-human and human-computer interaction, multimedia social media, and multimedia system architecture and deployment.Following the very positive responses to these talks, the speakers were invited to expand the content covered in their talks into chapters that can be used as reference material for researchers, students, and practitioners. Each chapter discusses the problems, technical challenges, state-of-the-art approaches and performances, open issues, and promising direction for future work. Collectively, the chapters provide an excellent sampling of major topics addressed by the community as a whole. This book, capturing some of the outcomes of such efforts, is well positioned to fill the aforementioned needs in providing tutorial-style reference materials for frontier topics in multimedia.At the same time, the speed and sophistication required of data processing have grown. In addition to simple queries, complex algorithms like machine learning and graph analysis are becoming common. And in addition to batch processing, streaming analysis of real-time data is required to let organizations take timely action. Future computing platforms will need to not only scale out traditional workloads, but support these new applications too.This book, a revised version of the 2014 ACM Dissertation Award winning dissertation, proposes an architecture for cluster computing systems that can tackle emerging data processing workloads at scale. Whereas early cluster computing systems, like MapReduce, handled batch processing, our architecture also enables streaming and interactive queries, while keeping MapReduce's scalability and fault tolerance. And whereas most deployed systems only support simple one-pass computations (e.g., SQL queries), ours also extends to the multi-pass algorithms required for complex analytics like machine learning. Finally, unlike the specialized systems proposed for some of these workloads, our architecture allows these computations to be combined, enabling rich new applications that intermix, for example, streaming and batch processing.We achieve these results through a simple extension to MapReduce that adds primitives for data sharing, called Resilient Distributed Datasets (RDDs). We show that this is enough to capture a wide range of workloads. We implement RDDs in the open source Spark system, which we evaluate using synthetic and real workloads. Spark matches or exceeds the performance of specialized systems in many domains, while offering stronger fault tolerance properties and allowing these workloads to be combined. Finally, we examine the generality of RDDs from both a theoretical modeling perspective and a systems perspective.This version of the dissertation makes corrections throughout the text and adds a new section on the evolution of Apache Spark in industry since 2014. In addition, editing, formatting, and links for the references have been added.Table of Contents Preface PART I: MULTIMEDIA CONTENT ANALYSIS 1. Deep Learning for Video Classification and Captioning 2. Audition for Multimedia Computing 3. Multimodal Analysis of Free-standing Conversational Groups 4. Encrypted Domain Multimedia Content Analysis 5. Efficient Similarity Search PART II: HUMAN-CENTERED MULTIMEDIA COMPUTING 6. Social-Sensed Multimedia Computing 7. Situation Recognition Using Multimodal Data 8. Hawkes Processes for Events in Social Media 9. Utilizing Implicit User Cues for Multimedia Analytics PART III: MULTIMEDIA COMMUNICATION AND SYSTEMS 10. Multimedia Fog Computing: Minions in the Cloud and Crowd 11. Cloud Gaming Bibliography Index Editor Biography

Read more less

Book SynopsisVirtual reality (VR) can provide our minds with direct access to digital media in a way that seemingly has no limits. However, creating compelling VR experiences is an incredibly complex challenge. When VR is done well, the results are brilliant and pleasurable experiences that go beyond what we can do in the real world. When VR is done badly, not only is the system frustrating to use, but it can result in sickness. There are many causes of bad VR; some failures come from the limitations of technology, but many come from a lack of understanding perception, interaction, design principles, and real users. This book discusses these issues by emphasizing the human element of VR. The fact is, if we do not get the human element correct, then no amount of technology will make VR anything more than an interesting tool confined to research laboratories. Even when VR principles are fully understood, the first implementation is rarely novel and almost never ideal due to the complex nature of VR and the countless possibilities that can be created. The VR principles discussed in this book will enable readers to intelligently experiment with the rules and iteratively design towards innovative experiences.Table of Contents Introduction Perception Cybersickness Interaction Content Creation Iterative Design Conclusions and the Future

Read more less

Book SynopsisThe Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces— user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations—for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.Table of Contents Introduction Theory and Neuroscience Foundations Theoretical Foundations of Multimodal Interfaces and Systems The Impact of Multimodal-Multisensory Learning on Human Performance and Brain Activation Patterns Approaches to Design and User Modeling Multisensory Haptic Interactions: Understanding the Sense and Designing for It A Background Perspective on Touch as a Multimodal Understanding and Supporting Modality Choices Using Cognitive Models to Understand Multimodal Processes: The Case for Speech and Gesture Production Multimodal Feedback in HCI: Haptics, Non-Speech Audio, and Their Applications Multimodal Technologies for Seniors: Challenges and Opportunities Common Modality Combinations Gaze Informed Multimodal Interaction Multimodal Speech and Pen Interfaces Multimodal Gesture Recognition Audio and Visual Modality Combination in Speech Processing Applications Multidisciplinary Challenge Topic: Perspectives on Learning with Multimodal Technology Contributors’ Brief Biographies: Editors, Authors and Challenge Discussants Index

Read more less

Book SynopsisThe Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces— user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations—for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.Table of Contents Introduction Theory and Neuroscience Foundations Theoretical Foundations of Multimodal Interfaces and Systems The Impact of Multimodal-Multisensory Learning on Human Performance and Brain Activation Patterns Approaches to Design and User Modeling Multisensory Haptic Interactions: Understanding the Sense and Designing for It A Background Perspective on Touch as a Multimodal Understanding and Supporting Modality Choices Using Cognitive Models to Understand Multimodal Processes: The Case for Speech and Gesture Production Multimodal Feedback in HCI: Haptics, Non-Speech Audio, and Their Applications Multimodal Technologies for Seniors: Challenges and Opportunities Common Modality Combinations Gaze Informed Multimodal Interaction Multimodal Speech and Pen Interfaces Multimodal Gesture Recognition Audio and Visual Modality Combination in Speech Processing Applications Multidisciplinary Challenge Topic: Perspectives on Learning with Multimodal Technology Contributors’ Brief Biographies: Editors, Authors and Challenge Discussants Index

Read more less

Book SynopsisThe Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces: user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces that often include biosignals. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This second volume of the handbook begins with multimodal signal processing, architectures, and machine learning. It includes recent deep learning approaches for processing multisensorial and multimodal user data and interaction, as well as context-sensitivity. A further highlight is processing of information about users' states and traits, an exciting emerging capability in next-generation user interfaces. These chapters discuss real-time multimodal analysis of emotion and social signals from various modalities, and perception of affective expression by users. Further chapters discuss multimodal processing of cognitive state using behavioral and physiological signals to detect cognitive load, domain expertise, deception, and depression. This collection of chapters provides walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this rapidly expanding field. In the final section of this volume, experts exchange views on the timely and controversial challenge topic of multimodal deep learning. The discussion focuses on how multimodal-multisensor interfaces are most likely to advance human performance during the next decade.Table of Contents 1. Multimodal Machine Learning 2. Classifying Multimodal Data 3. Learning for Multimodal and Context-sensitive Interfaces 4. Deep Learning for Multisensorial and Multimodal Interaction 5. Multimodal User State and Trait Recognition 6. Multimodal-Multisensor Affect Detection 7. Multimodal Analysis of Social Signals 8. Real-time Sensing of Affect and Social Signals in a Multimodal Framwork 9. How do Users Perceive Multimodal Expressions of Affects? 10. Multimodal Behavior and Physiological Signals as Indicators of Cognitive Load 11. Multimodal Learning Analytics 12. Multimodal Assessment of Depression and Related Disorders Based on Behavioral Signals 13. Multimodal Deception Detection 14. Perspectives on Strategic Fusion 15. Perspectives on Predictive Power of Multimodal Deep Learning

Read more less

Book SynopsisThe Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces: user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces that often include biosignals. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This second volume of the handbook begins with multimodal signal processing, architectures, and machine learning. It includes recent deep learning approaches for processing multisensorial and multimodal user data and interaction, as well as context-sensitivity. A further highlight is processing of information about users' states and traits, an exciting emerging capability in next-generation user interfaces. These chapters discuss real-time multimodal analysis of emotion and social signals from various modalities, and perception of affective expression by users. Further chapters discuss multimodal processing of cognitive state using behavioral and physiological signals to detect cognitive load, domain expertise, deception, and depression. This collection of chapters provides walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this rapidly expanding field. In the final section of this volume, experts exchange views on the timely and controversial challenge topic of multimodal deep learning. The discussion focuses on how multimodal-multisensor interfaces are most likely to advance human performance during the next decade.Table of Contents 1. Multimodal Machine Learning 2. Classifying Multimodal Data 3. Learning for Multimodal and Context-sensitive Interfaces 4. Deep Learning for Multisensorial and Multimodal Interaction 5. Multimodal User State and Trait Recognition 6. Multimodal-Multisensor Affect Detection 7. Multimodal Analysis of Social Signals 8. Real-time Sensing of Affect and Social Signals in a Multimodal Framwork 9. How do Users Perceive Multimodal Expressions of Affects? 10. Multimodal Behavior and Physiological Signals as Indicators of Cognitive Load 11. Multimodal Learning Analytics 12. Multimodal Assessment of Depression and Related Disorders Based on Behavioral Signals 13. Multimodal Deception Detection 14. Perspectives on Strategic Fusion 15. Perspectives on Predictive Power of Multimodal Deep Learning

Read more less

Book SynopsisThe Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces.This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas.This third volume focuses on state-of-the-art multimodal language and dialogue processing, including semantic integration of modalities. The development of increasingly expressive embodied agents and robots has become an active test bed for coordinating multimodal dialogue input and output, including processing of language and nonverbal communication. In addition, major application areas are featured for commercializing multimodal-multisensor systems, including automotive, robotic, manufacturing, machine translation, banking, communications, and others. These systems rely heavily on software tools, data resources, and international standards to facilitate their development. For insights into the future, emerging multimodal-multisensor technology trends are highlighted in medicine, robotics, interaction with smart spaces, and similar areas. Finally, this volume discusses the societal impact of more widespread adoption of these systems, such as privacy risks and how to mitigate them. The handbook chapters provide a number of walk-through examples of system design and processing, information on practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces need to be equipped to most effectively advance human performance during the next decade.Table of Contents Preface Figure Credits Introduction: Toward the Design, Construction, and Deployment of Multimodal-Multisensor Interfaces MULTIMODAL LANGUAGE AND DIALOGUE PROCESSING Multimodal Integration for Interactive Conversational Systems Multimodal Conversational Interaction with Robots Situated Interaction Software Platforms and Toolkits for Building Multimodal Systems and Applications Challenge Discussion: Advancing Multimodal Dialogue Nonverbal Behavior in Multimodal Performances MULTIMODAL BEHAVIOR Ergonomics for the Design of Multimodal Interfaces Early Integration for Movement Modeling in Latent Spaces Standardized Representations and Markup Languages for Multimodal Interaction Multimodal Databases EMERGING TRENDS AND APPLICATIONS Medical and Health Systems Automotive Multimodal Human-Machine Interface Embedded Multimodal Interfaces in Robotics: Applications, Future Trends, and Societal Implications Multimodal Dialogue Processing for Machine Translation Commercialization of Multimodal Systems Privacy Concerns of Multimodal Sensor Systems Index Biographies Volume 3 Glossary

Read more less

Book SynopsisThe Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces.This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas.This third volume focuses on state-of-the-art multimodal language and dialogue processing, including semantic integration of modalities. The development of increasingly expressive embodied agents and robots has become an active test bed for coordinating multimodal dialogue input and output, including processing of language and nonverbal communication. In addition, major application areas are featured for commercializing multimodal-multisensor systems, including automotive, robotic, manufacturing, machine translation, banking, communications, and others. These systems rely heavily on software tools, data resources, and international standards to facilitate their development. For insights into the future, emerging multimodal-multisensor technology trends are highlighted in medicine, robotics, interaction with smart spaces, and similar areas. Finally, this volume discusses the societal impact of more widespread adoption of these systems, such as privacy risks and how to mitigate them. The handbook chapters provide a number of walk-through examples of system design and processing, information on practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces need to be equipped to most effectively advance human performance during the next decade.Table of Contents Preface Figure Credits Introduction: Toward the Design, Construction, and Deployment of Multimodal-Multisensor Interfaces MULTIMODAL LANGUAGE AND DIALOGUE PROCESSING Multimodal Integration for Interactive Conversational Systems Multimodal Conversational Interaction with Robots Situated Interaction Software Platforms and Toolkits for Building Multimodal Systems and Applications Challenge Discussion: Advancing Multimodal Dialogue Nonverbal Behavior in Multimodal Performances MULTIMODAL BEHAVIOR Ergonomics for the Design of Multimodal Interfaces Early Integration for Movement Modeling in Latent Spaces Standardized Representations and Markup Languages for Multimodal Interaction Multimodal Databases EMERGING TRENDS AND APPLICATIONS Medical and Health Systems Automotive Multimodal Human-Machine Interface Embedded Multimodal Interfaces in Robotics: Applications, Future Trends, and Societal Implications Multimodal Dialogue Processing for Machine Translation Commercialization of Multimodal Systems Privacy Concerns of Multimodal Sensor Systems Index Biographies Volume 3 Glossary

Read more less

Book SynopsisSimulating Good and Evil shows that the moral panic surrounding violent videogames is deeply misguided, and often politically motivated, but that games are nevertheless morally important. Simulated actions are morally defensible because they take place outside the real world and do not inflict real harms. Decades of research purporting to show that videogames are immoral has failed to produce convincing evidence of this. However, games are morally important because they simulate decisions that would have moral weight if they were set in the real world. Videogames should be seen as spaces in which players may experiment with moral reasoning strategies without taking any actions that would themselves be subject to moral evaluation. Some videogame content may be upsetting or offensive, but mere offense does not necessarily indicate a moral problem. Upsetting content is best understood by applying existing theories for evaluating political ideologies and offensive speech. Trade Review"A thoughtful and challenging read. Schulzke leaves no stone unturned as he asks us to consider what values we bring to games with as players, consumers, and enthusiasts." -- Aaron Trammell * Editor-in-Chief of Analog Game Studies *"A thoughtful and challenging read. Schulzke leaves no stone unturned as he asks us to consider what values we bring to games with as players, consumers, and enthusiasts." -- Aaron Trammell * Editor-in-Chief of Analog Game Studies *Table of ContentsContents Introduction 1 The Conceptual Terrain of Simulation 2 The Moral Panic Surrounding Videogames 3 Imaginary Transgressions 4 Digital Morality 5 The Many Faces of Moral Reflection 6 Persuasive Games and Ideological Manipulation 7 Speaking Through Games Conclusion Acknowledgements Bibliography Index

Read more less

Book SynopsisSimulating Good and Evil shows that the moral panic surrounding violent videogames is deeply misguided, and often politically motivated, but that games are nevertheless morally important. Simulated actions are morally defensible because they take place outside the real world and do not inflict real harms. Decades of research purporting to show that videogames are immoral has failed to produce convincing evidence of this. However, games are morally important because they simulate decisions that would have moral weight if they were set in the real world. Videogames should be seen as spaces in which players may experiment with moral reasoning strategies without taking any actions that would themselves be subject to moral evaluation. Some videogame content may be upsetting or offensive, but mere offense does not necessarily indicate a moral problem. Upsetting content is best understood by applying existing theories for evaluating political ideologies and offensive speech. Trade Review"A thoughtful and challenging read. Schulzke leaves no stone unturned as he asks us to consider what values we bring to games with as players, consumers, and enthusiasts." -- Aaron Trammell * Editor-in-Chief of Analog Game Studies *"A thoughtful and challenging read. Schulzke leaves no stone unturned as he asks us to consider what values we bring to games with as players, consumers, and enthusiasts." -- Aaron Trammell * Editor-in-Chief of Analog Game Studies *Table of ContentsContents Introduction 1 The Conceptual Terrain of Simulation 2 The Moral Panic Surrounding Videogames 3 Imaginary Transgressions 4 Digital Morality 5 The Many Faces of Moral Reflection 6 Persuasive Games and Ideological Manipulation 7 Speaking Through Games Conclusion Acknowledgements Bibliography Index

Read more less