Publications

abstract
In this paper we outline the distribution of processes of needing and wanting in academic lectures across different disciplines, different phases in courses and individual lectures and different levels of education. In so doing, we consider who or what is needing and wanting and who or what is needed and wanted. This study forms part of a wider research program that uses multi-modal markers of importance to automatically extract key information from lectures as a step towards being able to identify and track contextually relevant importance in spoken language in real time for automatic summarization. We base our contextual analysis on the contextual models of Butt and Moore, which we further adapt for our purposes following Wegener (2011, 2015) and Cassens and Wegener (forthcoming) though they are not the focus of this paper.

abstract
Meaning making is most often multi-modal and it is this feature that we make use of in outlining a model for an automatic and context dependent note-taking system for academic lectures. Drawing on semiotic models of gesture and behaviour, linguistic models of text structure and sound, and a rich model of context, we argue that the combination of information from all of these through data triangulation provides a better basis for information extraction and summarization than each alone. Further, we suggest that by using a rich model of context that maps the unfolding of the text in real time with features of the context, we can produce query driven summarization. While this outlines research on academic lectures, future work will focus on optimizing this for different domains such as tele-medicine, minuting for meetings and services for the Deaf.

abstract
This talk will give an overview over three related research prototypes for ambient interactive systems. We start by introducing NEMO, the Network Environment for Multimedia Objects. NEMO is a smart media environment for semantically rich, personalised, and device-specific access to and interaction with multimedia objects. Next, a shared electronic whiteboard called ShareBoard is decribed. The goal of ShareBoard is to deliver a natural user interface to working with electronic whiteboards. Integrated within ShareBoard are input devices to recognise the movement of users in the surrounding space and for sensing 3D-gesture. ShareBoard can make use of media objects in NEMO. Last, we introduce the Modular Awareness Construction Kit. MACK is a framework for developing context aware, ambient intelligent systems that blend seamlessly with the users' everyday route, enabling unobtrusive in-situ interaction and facilitating enhanced cooperation and communication. In the future, MACK is to deliver contextual information to both NEMO and ShareBoard.

abstract
This contribution proposes a definition and taxonomy of the often used term cross-device interaction. Despite of technical progress, systems and interfaces that integrate into the environment are still the subject of intensive research. We still live in a world where devices reside in the foreground and present themselves and their interaction capabilities to the user. At the same time, computing devices become an integral part of our environment, be it in the form of public displays or mobile computers. Furthermore, the number of devices a user owns or has access to is increasing. Humans interacting consciously with multiple devices can be seen as an intermediate stage towards ambient environments or ubiquitous computing. The term cross-device interaction (XDI) is often used to refer to the underlying interaction paradigm in such environments. Unfortunately, the term still lacks consistent and concise definitions. This can be a problem as different authors use the term XDI with divergent meanings within a wide variety of application contexts. To mitigate this problem, we propose a taxonomy and give a user-, space- and interaction-centric definition for XDI. Additionally, we make use of this taxonomy to classify XDI-scenarios found in the literature and the concepts of XDI they exhibit.

abstract
In this contribution, we introduce the augmented reality presentation system PapAR. PapAR extends the use of printed paper documents in such a way that it is possible to integrate tokens for multimedia elements such as pictures, video or audio. These tokens can then be used in conjunction with a presentation system to interact with the multimedia elements on a large display, e.g. in a lecture situation. To this end, a PDF document that has been produced with any application is annotated with multimedia elements in the PapAR editor component. The multimedia elements, together with some metadata, are stored in the Network Environment for Multimedia Objects (NEMO) or on a physical device. Additionally, a new PDF document is generated containing tokens for the multimedia elements and for interaction with them. The new PDF can be printed and taken to the PapAR presentation system where the printout is placed under a camera. On the presentation screen, the tokens are overlaid with the respective multimedia or interactive elements.

abstract
In this contribution, we describe a system for Location-Aware CrossDevice Integration (LADI). LADI enhances interoperability between mobile and stationary computers by enabling the user to control the playback of multimedia objects on a desktop or presentation computer through an Android phone. The multimedia objects themselves can be stored in the Network Environment for Multimedia Objects (NEMO), on other cloud-based content delivery systems, or locally on a PC. In contrast to most existing network-centric solutions for playback control, LADI takes a location-centric view. It is possible to access presentation computers independent of whether they are available on the same IP-subnet. The different devices communicate via XMPP. Access to a presentation system can be gained through scanning attached QR-codes or through automatic localization based on WLAN fingerprints. In addition, the system facilitates the integration of additional context aware services in general and location aware services in particular. This paper describes the concept behind LADI and provides some details on its prototypical implementation.

abstract
In this paper, we introduce the distributed Context Awareness and Knowledge Environment CAKE. The design objectives for CAKE were to develop a system that is flexible enough to be used in different application domains, that supports re-use of components with the help of a well-defined plugin-system and application programming interface and that caters for privacy concerns by giving users access to personal context aware environments that share information selectively with other users' context aware environments. We describe related work on context middleware and the niche CAKE is targeting. We also argue for taking privacy concerns into account and outline how our framework addresses such issues. The concepts behind CAKE are introduced, and we describe how reasoning engines based on different paradigms can be put to work together in our framework. A first take on end-user programming is outlined and a prototypical implementation of the system presented.

abstract
Context is only one of several strata of meaning and we can not predict realisation at the lexical or grammatical level from context alone. Yet, there is a tendency to confuse contextual patterning with semantic patterning and allocate patterning to the contextual level that might better be dealt with on other levels. While much work has been done on theorising lexis and grammar and, more recently, on seeing these in context, much remains to be done on theorising semantics as a separate level mediating between context and lexis and grammar. This paper examines the problem of modelling behaviour and the challenge of understanding behaviour in context as well as on a semantical level. By understanding the descriptive responsibilities allocated to each level of language, we are better able to see what remains to be covered by context within a model.

abstract
PKM-Vision ist eine browserbasierte und plattformunabhängige Anwendung zur ganzheitlichen Verwaltung des persönlichen Informationsraums und zum visuellen Erarbeiten persönlicher Wissensstrukturen. Dies erfolgt durch Sichtung digitaler Informationsobjekte aus dem eigenen Informationsraum sowie deren Verknüpfung mit und Ergänzung um weitere Informationsobjekte bzw. Annotationen. Durch digitale Bereitstellung bekannter physischer Werkzeuge wie Whiteboards und Post-its werden Medienbrüche vermieden und dem damit einhergehendem Informationsverlust vorgebeugt. Zusätzlich zur Integration beliebiger Dateien können Verknüpfungen, Notizen und Zeichnungen direkt im System erstellt werden.

abstract
Kommunikation und Interaktion zwischen Menschen sowie zwischen Menschen und Computersystemen erfolgen zunehmend in hybrider Form mit hochkomplexen informationsverarbeitenden Systemen, sowohl in postgeografischen Räumen wie auch mittels neuartiger "be-greifbarer" Schnittstellen, die den klassischen Desktop-Computer verdrängen und ergänzen, im physischen Raum. Medien, die schon immer als Teil unseres Leibes, also der Einheit von Körper und Geist im Sinne von Merleau-Ponty diesen erweitern, werden in einem rasanten Tempo derart weiterentwickelt, dass diese nicht nur unser Verhältnis zu Raum und Zeit, vielmehr auch das, was Subjektivität und Intelligenz für uns heute bedeuten, in radikaler Art und Weise verändern. Durch die neuartigen, so noch nie dagewesenen, technisch-medial vermittelten Verarbeitungsmodi von Wirklichkeit ergeben sich auch neuartige Modi der Konstruktion von Wissen. Es zeichnen sich neue mögliche Formen von Lernprozessen ab.

abstract
In this paper, we present CASi (Context Awareness Simulator), a software system for the simulation of context-aware computer systems and environments. CASi provides an abstract framework of components for simulating smart world applications like a smart office or house with ambient sensors and actuators. Agents moving through these application worlds are tracked by sensors and their actions are influenced by actuators, both of which can be programmed to resemble the actual peripherals of the tested system. CASi allows testing ambient, context aware computer systems even in early stages of development without the need for expensive prototyping or real world deployment.

abstract
While guests in the office or a phone call can be pleasant surprises, in the wrong moment they may be disrupting a time of focused work and concentration. A lack of coordination between colleagues at the work place can lead to unwanted interruptions and result in an inef- ficient and unpleasant workplace. MATe (Mate for Awareness in Teams) is a pervasive, ambient intelligent computing framework charged with the task of preventing unwanted interruptions and improving social interaction at the workplace of knowledge workers. We present a survey of employees at a university in order to identify the attitudes of knowledge workers towards interruptions as well as their opinions on a pervasive system surveying and analyzing their behavior. Based on the results of this survey a prototype has been developed using an ontology written in OWL as a knowledge representation and logic-based reasoning to infer the users' status and interruptibility.

abstract
This paper outlines our current research program in the fields of ambient intelligence and context-aware computing and the tools we are building to accomplish this research program. From a discussion of our conception of mental models in the domain of ambient context-aware computer systems we derive hypotheses which we intend to test empirically. A modular framework for implementing and assessing situation awareness in humans and computers is introduced. We describe the framework's architecture and illustrate its suitability for its intended purpose. Finally, we present an outline of our next steps towards real world application systems for our research.

abstract
When designing and implementing real world ambient intelligent systems we are in need of applicable information systems engineering methods. The tools we find in the intelligent systems area focus on the knowledge engineering parts, whereas traditional software engineering techniques are usually not designed with the peculiarities of intelligent systems design in mind. This holds in particular for explanation-aware intelligent systems. This work looks at problem frames for explanations and investigates how problem frames can be used to elicit, analyse, and specify these specific requirements. The point of departure is an existing ambient intelligent information system for the hospital ward domain. The work presented here analyses how such a system can be redesigned with a focus on explanation-awareness.

abstract
When designing and implementing real world ambient intelligent systems, we are in need of applicable information systems engineering methods. These should supplement the knowledge engineering tools we can find in the intelligent systems area. The work presented here focuses on explanation-aware ambient intelligent systems. The ability to explain it's reasoning and actions has been identified as one core capability of any intelligent entity. The question of what is considered a good explanation is context dependent, leading to the necessity to design the explanatory capabilities of an ambient intelligent system together with the contextual modelling. We target the requirements elicitation, analysis, and specification processes by making use of a pattern-based approach in form of Jackson's problem frames. His set of basic problem frames can be extended to be better able to model domain specific aspects. We have previously suggested additional problem frames for explanatory capabilities.

abstract
The use of multiple computer systems by a single user makes data transfer a necessity. Cloud storage solutions provide synchronisation features and file accessibility across systems but the exact location and type of storage varies between services. Many systems rely on a client-server architecture where the data is held at the data centers of the service provider. This leads to several difficulties for the end user, for example with regard to privacy or data security. This is countered by the convenience of highly available servers. If the user wants to minimise exposure to the challenges of Cloud-based services, then he is required to either host a server infrastructure himself or to rely on inconvenient on-demand synchronisation by means of file transport protocols or even physical storage devices. The approach presented here tries to harvest the positive aspects of using Cloud-based services while keeping the user in control of his data. To this end, we focus on a hybrid system of a client-server and a peer-to-peer architecture which expands the Cloud to the user's system giving him full control over which data he selects to be stored on a server in the Cloud and which data he prefers to keep private on personal computing devices while ensuring unified access to both types of storage over the network.

abstract
In teams working closely together, interruptions of coworkers are normal and necessary. One of the goals of the ambient intelligent computing framework MATe (Mate for Awareness in Teams) is to prevent unwanted interruptions and at the same time improve social interaction. By creating awareness of each other's situation, users are able to judge how interruptible colleagues are. We describe the concept of MATe and its components and present related work on interruption handling and ontology-based reasoning as well as outline our current and future research in the area of context-aware systems.

abstract
In this article, we present the basic architecture of the Network Environment for Multimedia Objects (NEMO). NEMO is a smart media environment for contextualized, personalized, and device-specific interaction with multimedia objects. It provides its users access to interactive multimedia objects across a variety of computing platforms and devices, such as mobile phones, multi-touch tables, desktop computers and interactive whiteboards. NEMO Multimedia Objects are containers for metadata and media objects. Such media objects can be, for example, images, texts, animations, videos, audio files. Dedicated NEMO clients do not only offer means for presentation of media objects but also a runtime environment for applications on such objects. The system is suitable for application domains ranging from work environments to educational use and recreational activities

abstract
In this paper, we describe our current research concerning users' mental models of what can be called "disappearing computer systems". This notion comprises computer systems, applications, and appliances related to ubiquitous, pervasive, or ambient computing which blend more or less seamlessly into the users' natural environment. Mental models enable users to formulate expectations about which interactions with the system are possible and how the system will react to certain interactions. Disappearing computers lack certain cues regarding the inner workings of the system. We thus hypothesize that the mental models users build of such a system will show defects and inaccuracies that are directly related to the distributed character of interface and interaction. Our current research aims at identifying the nature of these defects, understanding their effects on human computer interaction, and developing means of avoiding them through appropriate design of both user interface and underlying system. For this purpose, we are developing an ambient, context aware computing framework with which we generate and test hypotheses in an action research paradigm. One of its components will be described along with possible future additions. The theoretical foundation of our work lies in such diverse fields as systemic functional theory of language, activity theory, and cognitive science approaches to mental models.

abstract
Technological progress has made it possible to interact with computer systems and applications anywhere and any time. It is crucial that these applications are able to adapt to the user, as a person, and to its current situation, whatever that is. Contextual information and a mechanism to reason about it have demonstrated an important potential to provide solutions in this respect. This paper aims at providing an integrated CBR architecture to be used in context-aware systems. It is the result of our work to develop ePH, a system for building dynamic user communities that share public interest information and knowledge that is accessible through always-on, context-aware services.

abstract
The increased use of social-network services for sharing personal information has made it easier to gain awareness of each other. It has also increased the interest in privacy issues, especially since it is not always clear to the provider of information who gains access to personal data and to what end this data is being used. Many interesting ideas and proposals have appeared to address the issue of privacy vs. information sharing. One of the most interesting is perhaps the notion of minimising asymmetry of information flow. It is not obvious how this idea can be applied in the area of ambient assisted living since raising awareness of the situation of the information provider is a core feature for reaching the goal of enabling elderly and disabled people to stay in their own housing. The work described here argues how the asymmetry of information flow can be minimised without compromising on the quality of monitoring and with the added benefit of giving next-of-kin better access to expert evaluation of the situation of their family members. This paper also reports on some initiatives on location-aware systems and ambient assisted living and shows how the combined experiences gained from these projects have led to the development of the proposed model for minimising asymmetry by proxies in an ambient assisted living environment.

abstract
Truly smart systems need to interface with the behaviour of human and non human actors in their surroundings. Systems with such interfaces could prove beneficial in supporting those with non standard communication practices, the elderly living alone, people with disabilities, and many others. While the benefits are clear, the means of achieving true behavioural interfaces are yet unclear. In this paper we outline how semiotics helps us to understand behaviour. We show how such an approach may be put to use in modelling the intention to walk through a door. We begin by outlining the semiotic approach and then discuss the behaviours which need to be described to model intention. We also discuss how this varies according to context and suggest the potential for a more general model of behaviour.

abstract
Explanations play an important part in the interaction with any intelligent system. This is particular important in context-aware and social awareness systems that regularly assume responsibility for a user and act proactively. Explanations are often generated using all available information. However, privacy issues in context-aware systems might dictate a limited distribution of information. The work presented here demonstrates how personal awareness-systems can fulfil different goals a user can have towards explanations, yet maintain a sensible level of privacy.

abstract
In this paper we look at awareness systems that use mobile and ambient devices for collecting or presenting awareness information and operate within an Ambient Intelligence Environment. Our focus is on Pervasive Awareness Systems (PAS) that mediate awareness with the aim to improve the feeling of being connected. In particular, we concentrate on the challenges that are connected to participation in multiple communities, requiring a continuous balancing between the need to "keep in touch" and to reduce interruptions. In the paper, we discuss software agents as a possible solution and identify the different roles that agents can play in reducing interruptions.

abstract
One of the challenges for ambient intelligence is to embed technical artefacts into human work processes in such a way that they support the sense making processes of human actors instead of placing new burdens upon them. This successful integration requires an operational model of context. Such a model of context is particularly important for disambiguating abstract concepts that have no clear grounding in the material setting of the work process. This paper examines some of the strengths and current limitations in a systemic functional model of context and concludes by suggesting that the notions of instantiation and stratification can be usefully employed.

abstract
An operational model of context is particularly important for the successful integration of new technical artefacts into complex processes. One of the challenges for ambient intelligence is to embed technical artefacts into human work processes in such a way that they support the sense making processes of human actors instead of placing new burdens upon them. This paper examines some of the strengths and current limitations of a systemic functional model of context. We propose that the dimensions that are relevant to modeling are those that have the most consequences for meaning. This is explored in a hypothetical hospital scenario.

abstract
The ability to give explanations for its reasoning and behaviour is a core capability of an intelligent system. There are a number of different goals a user can have towards such explanations. This paper presents how the knowledge intensive case-based reasoning framework CREEK can support some of these different goals in an ambient intelligence setting.

abstract
Interacting with intelligent systems in general and ambient intelligent systems in particular, requires that these systems have the ability to build a trust relationship with the users. The ability to explain its own behaviour is one of the most important abilities that such a system can exhibit to gain trust. We argue that explanations are not just an addition to an ambient intelligent system rather it is an approach to the design and implementation of such a system. Explanations are useful both for the reasoning process itself and as a means of communicating with the users. In this paper, we present a knowledge intensive approach for identifying different contexts and generating a course of action depending on the context found. We explore the use of explanations both as a means of reasoning and as a means of communication with the user.

abstract
Systems in general, and intelligent systems in particular, need to be able to explain their behaviour to their users or partners. Previously, a number of different user goals that explanations can support have been identified. Likewise, different kinds of explanations have been proposed. The problem remains how these abstract concepts can be made fruitful for the design of intelligent systems - they must be connected to software engineering methodologies. The work presented here builds on the concept of patterns and suggests using problem frames as a tool for requirements engineering. We further on propose to connect these problem frames with other design patterns as a tool supporting the implementation process.

abstract
Ambient intelligent systems are context aware by perceiving and reasoning about their environment, they perceive the needs of their users and proactively respond to these needs by being context sensitive. Users do not interact with these systems by traditional means only, but also through behavioural interfaces. This combination of mixed initiative systems and unconventional interfaces puts strong requirements on the explanatory capabilities of any system. The work presented here focuses on explaining the behaviour of an ambient intelligent systems to its users. It demonstrates how explanations can be combined with context to deal with the different types of explanations that are required for a meaningful interaction of a system and its users.

abstract
In this paper, we describe an approach to modelling context-aware systems starting on the knowledge level. We make use of ideas from Activity Theory to structure the general context model and to assess empirical data. We further on describe how the data-driven and the model-driven aspects of our approach are combined into a single knowledge model. We outline the design of an empirical study conducted to gather information about a concrete workplace environment. This information is then used to populate our context model. We describe also how the collected data can be used to validate our approach.

abstract
One of the cornerstones of any intelligent entity is the ability to understand how occurrences in the surrounding world influence its own behaviour. Different states, or situations, in its environment should be taken into account when reasoning or acting. When dealing with different situations, context is the key element used to infer possible actions and information needs. The activities of the perceiving agent and other entities are arguably one of the most important features of a situation; this is equally true whether the agent is artificial or not. This work proposes the use of Activity Theory to first model context and further on populate the model for assessing situations in a pervasive computing environment. Through the socio-technical perspective given by Activity Theory, the knowledge intensive context model, utilised in our ambient intelligent system, is designed.

abstract
Research on explanation in Case-Based Reasoning (CBR) is a topic that gains momentum. In this context, fundamental issues on what are and to which end do we use explanations have to be reconsidered. This article presents a prelimenary outline of the combination of two recently proposed classifications of explanations based on the type of the explanation itself and user goals which should be fulfilled.

abstract
A lot of research has been done in the area of context-aware computing. Even though, the term context seems often not to be well defined. We attribute this problem partly to the fact that research often focuses on syntactical and technical issues of contextuality and does not take a knowledge level perspective on context. When including the knowledge level, some sort of analysis is required on what aspects need to be modelled. In this paper, we propose the use of an Activity Theory (AT) based approach on modelling components, and outline how it can be combined with the AmbieSense context modelling framework we have proposed earlier.

abstract
Research on explanation in Case-Based Reasoning (CBR) is a topic that gains momentum. In this context, fundamental issues on what are and to which end do we use explanations have to be reconsidered. This article presents a prelimenary outline of the combination of two recently proposed classifications of explanations based on the type of the explanation itself and user goals which should be fulfilled. Further on, the contribution of the different knowledge containers for modeling the necessary knowledge is examined.

abstract
This paper addresses the problem of embedding explanation-aware intelligent systems into a workplace environment. We outline an approach with three different perspectives, focusing on the work process as a whole as well as user interaction from an interface and a system view. The theoretical background consists of Actor Network Theory, Semiotics, and Activity Theory. We further propose to integrate this workplace analysis into a design process for knowledge-intensive and explanationaware Case-Based Reasoning systems.

abstract
We present an overview of different theories of explanation from the philosophy and cognitive science communities. Based on these theories, as well as models of explanation from the knowledge-based systems area, we present a framework for explanation in case-based reasoning (CBR) based on explanation goals. We propose ways that the goals of the user and system designer should be taken into account when deciding what is a good explanation for a given CBR system. Some general types of goals relevant to many CBR systems are identified, and used to survey existing methods of explanation in CBR. Finally, we identify some future challenges.

abstract
In this paper, we present a short overview of different theories of explanation. We argue that the goals of the user should be taken into account when deciding what is a good explanation for a given CBR system. Some general types relevant to many Case-Based Reasoning (CBR) systems are identified and we use these goals to identify some limitations in using the case as an explanation in CBR systems.

abstract
We have argued elsewhere that user goals should be taken into account when deciding what kind of explanation of its results a CBR system should give. In this paper, we propose the use of an Activity Theory based methodology for identifying different user goals and expectations towards explanations given by a system supporting a work process.

abstract
The goal of the presentation is to give an overview about how to build a commodity PC based GNU/Linux cluster for High Performance Computing (HPC) in a research environment. Due to the extreme flexibility of the GNU/Linux operating system and the large variety of hardware components, building a cluster for High Performance Computing (HPC) is still a challenge in many cases. At the Division of Intelligent Systems at the Norwegian University of Science and Technology (NTNU), we have build a 40 node HPC cluster for research purposes using the source-based GNU/Linux distribution Source Mage. We describe a methodology for designing and installing a highly customized GNU/Linux cluster. Different types of Linux distributions will be mentioned, binary-based and source-based, with their advantages and disadvantages. The presentation will focus on using SourceMage for HPC, specifying the "magical" ideas behind it: the ease of upgrading to the latest available version of the source code, a packaging system for keeping track of dependencies, optimized compiles for the hardware architecture used, easy integration of new packages, amongst others.