HCI Bibliography Home | HCI Conferences | IUI Archive | Detailed Records | RefWorks | EndNote | Hide Abstracts
IUI Tables of Contents: 04050607080910111213-113-214-114-215-115-216-116-2

Proceedings of the 2013 International Conference on Intelligent User Interfaces

Fullname:Proceedings of the companion publication of the 2013 international conference on Intelligent user interfaces companion
Editors:Jihie Kim; Jeffrey Nichols; Pedro Szekely
Location:Santa Monica, California
Dates:2013-Mar-19 to 2013-Mar-22
Standard No:ISBN: 978-1-4503-1966-9; ACM DL: Table of Contents; hcibib: IUI13-2
Links:Conference Website
  1. IUI 2013-03-19 Volume 2
    1. Student consortium
    2. Demonstrations
    3. Posters
    4. Workshops

IUI 2013-03-19 Volume 2

Student consortium

Designing context-aware display ecosystems BIBAFull-Text 1-4
  Jakub Dostal
Display ecosystems encapsulate a number of independent and/or interconnected displays and their users. We are seeing the emergence of more complex display ecosystems, whether it is due to the number of collaborators, the number of devices or displays, the complexity of the user interface or increased information flow or a combination of all of all these factors. I hypothesise that interactions within display ecologies would benefit from awareness of the computational, physiological and environmental context. This paper presents a brief overview of related work as well as the research goals, relevant methodology and current research status.
Measuring situation awareness of micro-neurosurgeons BIBAFull-Text 5-8
  Shahram Eivazi
Micro-neurosurgery is performed with high power microscope. The microscope provides a precise perception of operative neurosurgical anatomy. The surgery is conducted using miniaturized instruments through a small hole in the skull and spin channel. Although there are predefined routine procedures in the micro-neurosurgery, still surgeons have to maintain a high level of situation awareness (SA) to operate safely. In this paper I discuss about my PhD research that focuses on relationship between eye movement pattern and level of SA.
Multi-modal context-awareness for ambient intelligence environments BIBAFull-Text 9-12
  Georgios Galatas; Fillia Makedon
Context-awareness constitutes a fundamental attribute of a smart environment. Our research aims at advancing the context-awareness capabilities of ambient intelligence environments by combining multi-modal information from both stationary and moving sensors. The collected data enables us to perform person identification and 3-D localization and recognize activities. In addition, we explore closed-loop feedback by integrating autonomous robots interacting with the users.
Real-time classification of dynamic hand gestures from marker-based position data BIBAFull-Text 13-16
  Andrew Gardner; Christian A. Duncan; Rastko Selmic; Jinko Kanno
In this paper we describe plans for a dynamic hand gesture recognition system based on motion capture cameras with unlabeled markers. The intended classifier is an extension of previous work on static hand gesture recognition in the same environment. The static gestures are to form the basis of a vocabulary that will allow precise descriptions of various expressive hand gestures when combined with inferred motion and temporal data. Hidden Markov Models and dynamic time warping are expected to be useful tools in achieving this goal.
Leveraging the crowd for creating wireframe-based exploration of mobile design pattern gallery BIBAFull-Text 17-20
  Yi-Ching Huang; Chun-I Wang; Jane Hsu
The use of mobile device is becoming more popular than before. There are many designers entering the area of mobile app design and development. However, due to the limitation of the screen size and context of use, it becomes extremely difficult for non-experienced designers or developers to make a good mobile application design. This paper introduces a wireframe-based matching technique to help people seek relevant mobile UI design examples for inspirations. We leveraged the wisdom of the crowd for creating coherent mappings between wireframes and design examples. Furthermore, we constructed a mobile UI design gallery for designers to explore inspiring examples in the wireframing stage.
Adaptive game for reducing aggressive behavior BIBAFull-Text 21-24
  Juan F. Mancilla-Caceres; Eyal Amir; Dorothy Espelage
Peer influence in social networks has long been recognized as one of the key factors in many of the social health issues that affect young people. In order to study peer networks, scientists have relied on the use of self-report surveys that impose limitations on the types of issues than can be studied. On the other hand, the ever increasing use of computers for communication has given rise to new ways of studying group dynamics and, even more importantly, it has enabled a new way to affect those dynamics as they are detected. Our work is focused on designing and analyzing computer social games that can be used as data collection tools for social interactions, and that can also react and change accordingly in order to promote prosocial, rather than aggressive, behavior.
User interface adaptation based on user feedback and machine learning BIBAFull-Text 25-28
  Nesrine Mezhoudi
With the growing need for intelligent software, exploring the potential of Machine Learning (ML) algorithms for User Interface (UI) adaptation becomes an ultimate requirement. The work reported in this paper aims at enhancing the UI interaction by using a Rule Management Engine (RME) in order to handle a training phase for personalization. This phase is intended to teach to the system novel adaptation strategies based on the end-user feedback concerning his interaction (history, preferences...). The goal is also to ensure an adaptation learning by capitalizing on the user feedbacks via a promoting/demoting technique, and then to employ it later in different levels of the UI development.
Towards adaptive dialogue systems for assistive living environments BIBAFull-Text 29-32
  Alexandros Papangelis; Vangelis Karkaletsis; Heng Huang
Adaptive Dialogue Systems can be seen as smart interfaces that typically use natural language (spoken or written) as a means of communication. They are being used in many applications, such as customer service, in-car interfaces, even in rehabilitation, and therefore it is essential that these systems are robust, scalable and quickly adaptable in order to cope with changing user or system needs or environmental conditions. Making Dialogue Systems adaptive means overcoming several challenges, such as scalability or lack of training data. Achieving adaptation online has thus been an even greater challenge. We propose to build such a system, that will operate in an Assistive Living Environment and provide its services as a coach to patients that need to perform rehabilitative exercises. We are currently in the process of developing it, using Robot Operating System on a robotic platform.
From small screens to big displays: understanding interaction in multi-display environments BIBAFull-Text 33-36
  Teddy Seyed; Chris Burns; Mario Costa Sousa; Frank Maurer
Devices such as tablets, mobile phones, tabletops and wall displays all incorporate different sizes of screens, and are now commonplace in a variety of situations and environments. Environments that incorporate these devices, multi-display environments (MDEs) are highly interactive and innovative, but the interaction in these environments is not well understood. The research presented here investigates and explores interaction and users in MDEs. This exploration tries to understand the conceptual models of MDEs for users and then examine and validate interaction approaches that can be done to make them more usable. In addition to a brief literature review, the methodology, research goals and current research status are presented.
Computational approaches to visual attention for interaction inference BIBAFull-Text 37-40
  Hana Vrzakova
Many aspects of interaction are hard to directly observe and measure. My research focuses on particular aspects of UX such as cognitive workload, problem solving or engagement, and establishes computational links between them and visual attention. Using machine learning and pattern recognition techniques, I aim to achieve automatic inferences for HCI and employ them as enhancements in gaze-aware interfaces.


Deploying speech interfaces to the masses BIBAFull-Text 41-42
  Aasish Pappu; Alexander Rudnicky
Speech systems are typically deployed either over phones, e.g. IVR agents, or on embodied agents, e.g. domestic robots. Most of these systems are limited to a particular platform i.e., only accessible by phone or in situated interactions. This limits scalability and potential domain of operation. Our goal is to make speech interfaces more widely available, and we are proposing a new approach for deploying such interfaces on the internet along with traditional platforms. In this work, we describe a lightweight speech interface architecture built on top of Freeswitch, an open source softswitch platform. A softswitch enables us to provide users with access over several types of channels (phone, VOIP, etc.) as well as support multiple users at the same time. We demonstrate two dialog applications developed using this approach: 1) Virtual Chauffeur: a voice based virtual driving experience and 2) Talkie: a speech-based chat bot.
Real-time direct manipulation of screen-based videos BIBAFull-Text 43-44
  Laurent Denoue; Scott Carter; Matthew Cooper; John Adcock
We describe direct video manipulation interactions applied to screen-based tutorials. In addition to using the video timeline, users of our system can quickly navigate into the video by mouse-wheel, double click over a rectangular region to zoom in and out, or drag a box over the video canvas to select text and scrub the video until the end of a text line even if not shown in the current frame. We describe the video processing techniques developed to implement these direct video manipulation techniques, and show how they are implemented to run in most modern web browsers using HTML5's CANVAS and Javascript.
PersonalityViz: a visualization tool to analyze people's personality with social media BIBAFull-Text 45-46
  Liang Gou; Jalal Mahmud; Eben Haber; Michelle Zhou
This paper presents an interactive visualization tool, PersonalityViz, to help people understand their personality traits derived from social media. The system uses the Linguistic Inquiry and Word Count (LIWC) text analysis tool and LIWC/Big Five personality correlations to compute a person's Big Five personality from one's tweets. It provides an interactive visual interface that allows a user to explore her personality traits over time, and examine the visual evidence to understand how the personality traits are derived from the relevant tweets.
E3-player: emotional excitement enhancing video player using skin conductance response BIBAFull-Text 47-48
  Takumi Shirokura; Nagisa Munekata; Tetsuo Ono
We developed E3-player, a novel video player with three operation modes which enhances video experiences by using a user's physiological inputs. This system's purpose is to enhance the emotional excitement of the users by reinforcing their response to the videos they are watching. Users who use the E3-player need only to attach a physiological sensor to their own hand and wearing noise-cancelling headphones. Through our experiments, we ensure that the E3-player can indeed enhance video experience and provide new video experiences for viewers.
MoFIS: a mobile user interface for semi-automatic extraction of food product ingredient lists BIBAFull-Text 49-50
  Tobias Leidinger; Lübomira Spassova; Andreas Arens; Norbert Rösch
The availability of food ingredient information in digital form is a major factor in modern information systems related to diet management and health issues. Although ingredient information is printed on food product labels, corresponding digital data is rarely available for the public. In this demo, we present the Mobile Food Information Scanner (MoFIS), a mobile user interface designed to enable users to semi-automatically extract ingredient lists from food product packaging.
Keeping wiki content current via news sources BIBAFull-Text 51-52
  Rachel Adams; Alex Kuntz; Morgan Marks; William Martin; David Musicant
Online resources known as wikis are commonly used for collection and distribution of information. We present a software implementation that assists wiki contributors with the task of keeping a wiki current. Our demonstration, built using English Wikipedia, enables wiki contributors to subscribe to sources of news, based on which it makes intelligent recommendations for pages within Wikipedia where the new content should be added. This tool is also potentially useful for helping new Wikipedia editors find material to contribute.
Interactive design of planar curves based on spatial augmented reality BIBAFull-Text 53-54
  Ahyun Lee; Jeong Dae Suh; Joo-Haeng Lee
In this paper, we introduce an interactive application for planar curve design in a real world based on spatial augmented reality (SAR). The key component is a projector-camera unit that recognizes physical control objects (i.e., key points of an intended curve) using a camera and displays a design result (i.e., a B-spline curve) directly on the real world surface using a projector. Usually, geometric design is performed with the aid of CAD software and traditional user interfaces of a computer system. The main contribution of this paper is application of spatial augmented reality techniques in the domain of computer-aided geometric design (CAGD) for more tangible and intuitive interaction in a real world. We describe the feature of the prototype system and demonstrate the working application with examples.
Namelette: a tasteful supporter for creative naming BIBAFull-Text 55-56
  Güzde Özbal; Carlo Strapparava
In this paper, we introduce a system that supports the naming process by exploiting natural language processing and linguistic creativity techniques in a completely unsupervised fashion. The system generates two types of neologisms based on the category of the service to be named and the properties to be underlined. While the first type consists of homophonic puns and metaphors, the second consists of neologisms that are produced by adding Latin suffixes to English words or homophonic puns. During this process, both semantic appropriateness and sound pleasantness of the generated names are taken into account.
A system for facial expression-based affective speech translation BIBAFull-Text 57-58
  Zeeshan Ahmed; Ingmar Steiner; Éva Székely; Julie Carson-Berndsen
In the emerging field of speech-to-speech translation, emphasis is currently placed on the linguistic content, while the significance of paralinguistic information conveyed by facial expression or tone of voice is typically neglected. We present a prototype system for multimodal speech-to-speech translation that is able to automatically recognize and translate spoken utterances from one language into another, with the output rendered by a speech synthesis system. The novelty of our system lies in the technique of generating the synthetic speech output in one of several expressive styles that is automatically determined using a camera to analyze the user's facial expression during speech.
SKIMMR: machine-aided skim-reading BIBAFull-Text 59-60
  Vít Novácek; Gully Burns
Unlike full reading, 'skim-reading' involves the process of looking quickly over information in an attempt to cover more material whilst still being able to retain a superficial view of the underlying content. Within this work, we specifically emulate this natural human activity by providing a dynamic graph-based view of entities automatically extracted from text using superficial text parsing / processing techniques. We provide a preliminary web-based tool (called 'SKIMMR') that generates a network of inter-related concepts from a set of documents. In SKIMMR, a user may browse the network to investigate the lexically-driven information space extracted from the documents. When a particular area of that space looks interesting to a user, the tool can then display the documents that are most relevant to the displayed concepts. We present this as a simple, viable methodology for browsing a document collection (such as a collection scientific research articles) in an attempt to limit the information overload of examining that document collection. This paper presents a motivation and overview of the approach, outlines technical details of the preliminary SKIMMR implementation, describes the tool from the user's perspective and summarises the related work.
SciNet: a system for browsing scientific literature through keyword manipulation BIBAFull-Text 61-62
  Dorota Glowacka; Tuukka Ruotsalo; Ksenia Konyushkova; Kumaripaba Athukorala; Samuel Kaski; Giulio Jacucci
Techniques for both exploratory and known item search tend to direct only to more specific subtopics or individual documents, as opposed to allowing directing the exploration of the information space. We present SciNet, an interactive information retrieval system that combines Reinforcement Learning techniques along with a novel user interface design to allow active engagement of users in directing the search. Users can directly manipulate document features (keywords) to indicate their interests and Reinforcement Learning is used to model the user by allowing the system to trade off between exploration and exploitation. This gives users the opportunity to more effectively direct their search.
A multimodal dialogue interface for mobile local search BIBAFull-Text 63-64
  Patrick Ehlen; Michael Johnston
Speak4itSM uses a multimodal interface to perform mobile search for local businesses. Users combine simultaneous speech and touch to input queries or commands, for example, by saying, "gas stations", while tracing a route on a touchscreen. This demonstration will exhibit an extension of our multimodal semantic processing architecture from a one-shot query system to a multimodal dialogue system that tracks dialogue state over multiple turns and resolves prior context using unification-based context resolution. We illustrate the capabilities and limitations of this approach to multimodal interpretation, describing the challenges of supporting true multimodal interaction in a deployed mobile service, while offering an interactive demonstration on tablets and smartphones.
Teaching agents with human feedback: a demonstration of the TAMER framework BIBAFull-Text 65-66
  W. Bradley Knox; Peter Stone; Cynthia Breazeal
Incorporating human interaction into agent learning yields two crucial benefits. First, human knowledge can greatly improve the speed and final result of learning compared to pure trial-and-error approaches like reinforcement learning. And second, human users are empowered to designate "correct" behavior. In this abstract, we present research on a system for learning from human interaction -- the TAMER framework -- then point to extensions to TAMER, and finally describe a demonstration of these systems.
An intelligent web-based interface for programming content detection in q&a forums BIBAFull-Text 67-68
  Mahdy Khayyamian; Jihie Kim
In this demonstration, we introduce a novel web-based intelligent interface which automatically detects and highlights programming content (programming code and messages) in Q&A programming forums. We expect our interface helps enhancing visual presentation of such forum content and enhance effective participation.
   We solve this problem using several alternative approaches: a dictionary-based baseline method, a non-sequential Naïve Bayes classification algorithm, and Conditional Random Fields (CRF) which is a sequential labeling framework. The best results are produced by CRF method with an F1-Score of 86.9%.
   We also experimentally validate how robust our classifier is by testing the constructed CRF model built on a C++ forum against a Python and a Java dataset. The results indicate the classifier works quite well across different domains.
   To demonstrate detection results, a web-based graphical user interface is developed that accepts a user input programming forum message and processes it using trained CRF model and then displays the programming content snippets in a different font to the user.


Improving rich internet application development using patterns BIBAFull-Text 69-70
  Jalal Mahmud
With changes of customer requirements, web development, especially developing Rich Internet Applications (RIA) with complex widgets and data-driven behavior can be a time-consuming task. In our previous work [3], we have presented a test-driven web development approach using ClearScript test cases as requirements to automatically generate widgets, and thus reduce the barrier of web development and testing. We extend on this work, and develop a machine learning based algorithm to identify RIA patterns [1] from requirements specified as test cases, and automatically instantiate them using simple rules. We also present performance of our algorithm and a user study which demonstrates the viability of our approach.
Adaptable probabilistic flick keyboard based on HMMs BIBAFull-Text 71-72
  Toshiyuki Hagiya; Tsuneo Kato
To provide an accurate and user-adaptable software keyboard for touchscreens, we propose a probabilistic flick keyboard based on HMMs. This keyboard can reduce the input error by taking the time series of the actual touch position into consideration and by user adaptation. We evaluated performance of the HMM-based flick keyboard and MLLR adaptation. Experimental results showed that a user-dependent model reduced the error rate by 28.2%. In a practical setting, MLLR user adaptation with only 10 words reduced the error rate by 16.5% and increased typing speed by 10.5%.
VibroTactor: low-cost placement-aware technique using vibration echoes on mobile devices BIBAFull-Text 73-74
  Sungjae Hwang; Kwangyun Wohn
In this paper, we present a low-cost placement-aware technique, called VibroTactor, which allows mobile devices to determine where they are placed (e.g., in a pocket, on a phone holder, on the bed, or on the desk). This is achieved by filtering and analyzing the acoustic signal generated when the mobile device vibrates. The advantage of this technique is that it is inexpensive and easy to deploy because it uses a microphone, which already embedded in standard mobile devices. To verify this idea, we implemented a prototype and conducted a preliminary test. The results show that this system achieves an average success rate of 91% in 12 different real-world placement sets.
Magnetic marionette: magnetically driven elastic controller on mobile device BIBAFull-Text 75-76
  Sungjae Hwang; Myungwook Ahn; Kwangyun Wohn
In this paper, we present the Magnetic Marionette, a magnetically driven elastic controller that enables tangible interaction on mobile devices. This technique can determine eight different gestures in excess of 99% accuracy by sensing and tracking the magnets embedded on the controller. The advantage of this technique is that it is lightweight, battery-free, and inexpensive because it uses a magnetometer, which is already embedded in smart phones today. This simple and noble technique allows users to achieve richer tactile feedback, expand their interaction area, and enhance expressiveness without the need for hardware modification.
Extracting document relationships by analyzing user's activity history BIBAFull-Text 77-78
  Akira Karasudani; Satoshi Iwata; Tatsuro Matsumoto; Hirokazu Aritake
In order to reduce people's workload of looking for valuable information from a large amount of available information, recommendation systems, task management systems, and so on are attracting considerable attention. Such systems are expected to allow easy access to information under the current work context. In the development of these systems, how to handle a user's current work context to know what information he wants to use is a key point. We have developed a novel method to extract relationships among documents as the work context by analyzing the user's activity history according to several viewpoints of a human being who memorizes and seeks information. We report the details of the proposed method, the evaluation result, and an application example.
Eye corner detector robust to shape and illumination changes BIBAFull-Text 79-80
  Sébastien Picard; Shanshan Yu; Satoshi Nakashima
We introduce a robust and accurate eye corner detector. The purpose of this technology is to improve the robustness of natural user interfaces' inputs, such as eye movements, in real-life environments for various users. Our technology relies on the pupil centers and particularly the inter-pupil direction, to define simple features capturing the structural characteristics of the eye corners independently of the shape and appearance of their neighborhoods. Our method proved to be robust to different lighting environments, eye shapes and different patterns of reflection on glasses. We report an error below 2% of the inter-pupil distance for 98% of the images, and maintain processing time below 3ms for computation on both eyes.
WhoAmi: profiling attendees before meetings BIBAFull-Text 81-82
  Jianqiang Shen; Oliver Brdiczka; Juan Liu; Masafumi Suzuki
Mobile phones have been widely used to access, retrieve and organize information. In this paper, we present the meshin system, an intelligent personal assistant that organizes messages, notifications and appointments for mobile phone users. To help users prepare for meetings, meshin automatically creates a profile for each meeting attendee. The meshin system searches the Internet with the attendee's name and the domain of the email address, then retrieves and aggregates information for this attendee. To get a better understanding of the attendee, it further estimates the personality profile based on the emails he/she wrote. Our experimental results show that our system can predict personality with reasonable accuracies (95%).
Accelerometer-based hand gesture recognition using feature weighted naïve Bayesian classifiers and dynamic time warping BIBAFull-Text 83-84
  David Mace; Wei Gao; Ayse Coskun
Accelerometer-based gesture recognition is a major area of interest in human-computer interaction. In this paper, we compare two approaches: naïve Bayesian classification with feature separability weighting [1] and dynamic time warping [2]. Algorithms based on these two approaches are introduced and the results are compared. We evaluate both algorithms with four gesture types and five samples from five different people. The gesture identification accuracy for Bayesian classification and dynamic time warping are 97% and 95%, respectively.
Ghost-hunting: a cursor-based pointing technique with picture guide indication of the shortest path BIBAFull-Text 85-86
  Chihiro Kuwabara; Keiko Yamamoto; Itaru Kuramoto; Yoshihiro Tsujino; Mitsuru Minakuchi
Ghost-Hunting (GH) is a new technique that improves pointing performance in a graphical user interface (GUI) by expanding targets to facilitate easier access. In GH, the effect of decreasing the movement distance of a cursor by expanding the size of onscreen targets is utilized to improve the GUI. GH shows the guides of the end point of the shortest movement path, called ghosts, inside expanded target areas. Users can optimize their cursor movements by only moving their cursor towards the ghosts in GH, unlike other techniques that use the invisible outline of an expanded target such as with Bubble Cursor. We conduct an experimental evaluation to clarify the effectiveness of GH in menu-item selection tasks. The result shows that GH's selection time was significantly faster than that of the ordinal cursor or Bubble Cursor. In particular, GH is faster than Bubble Cursor in environments with a high density of targets.
Android-based speech processing for eldercare robotics BIBAFull-Text 87-88
  Tatiana Alexenko; Megan Biondo; Deya Banisakher; Marjorie Skubic
A growing elderly population has created a need for innovative eldercare technologies. The use of a home robot to assist with daily tasks is one such example. In this paper we describe an interface for human-robot interaction, which uses built-in speech recognition in Android phones to control a mobile robot. We discuss benefits of using a smartphone for speech-based robot control and present speech recognition accuracy results for younger and older adults obtained with an Android smartphone.
Finding the local angle in national news BIBAFull-Text 89-90
  Shawn O'Banion; Larry Birnbaum; Scott Bradley
Journalists often localize news stories that are not explicitly about the community they serve by investigating and describing how those stories affect that community. This is, in essence, a form of personalization based not on a reader's personal interests, but rather on their ties to a geographic location. In this paper we present The Local Angle, an approach for automating the process of finding national and international news stories that are locally relevant. The Local Angle associates the people, companies, and organizations mentioned in news stories with geographic locations using semantic analysis tools and online knowledge bases. We describe the design and implementation of our prototype system that helps content curators and consumers discover articles that are of local interest even if they do not originate locally.
Computerized adaptive testing and learning using Bayesian network BIBAFull-Text 91-92
  Kyung Soo Kim; Yong Suk Choi
In this paper, we propose a novel CAT (Computerized Adaptive Testing) system based on Bayesian network. Our novel system makes good use of topology and probabilistic inference algorithm of Bayesian network to efficiently estimate proficiency of learner and also give an adaptive learning guide when needed. From several experiments, we identified that our system could considerably improve proficiency-estimation performance when compared with conventional CAT methods.
A visual monitoring and management tool for smart environments BIBAFull-Text 93-94
  Gerrit Kahl
Smart spaces are equipped with a large number of sensors and actuators. Data measured by the sensors is sent to respective services, which can react on them and control actuators correspondingly. In order to improve the services and make them smarter, they can communicate with each other and exchange data. The more interferences between the services exist, the more complex is the monitoring and extension of such smart spaces. In this paper, we propose a monitoring tool for these environments, which consists of a real and a virtual component. The real component is the physical smart space itself and the virtual one consists of a three-dimensional model of the space. Sensor information is transmitted from the real to the virtual component and represented there, via an appropriate visualization. Additionally, the tool offers a communication channel from the virtual component to the real counterpart to control the physical actuators.
Semantic search for smart mobile devices BIBAFull-Text 95-96
  Sangjin Shin; Jihoon Ko; Dong-Hoon Shin; Jooik Jung; Kyong-Ho Lee
To enhance the incorrectness of keyword based search, we propose an efficient semantic search method based on a lightweight mobile ontology designed for smart mobile devices. In addition, we implement a prototype of semantic search engine working on Android smartphones and our prototype engine provides better user experience compared with keyword based search.
Multimodal interaction strategies in a multi-device environment around natural speech BIBAFull-Text 97-98
  Christian Schulz; Daniel Sonntag; Markus Weber; Takumi Toyama
In this paper we present an intelligent user interface which combines a speech-based interface with several other input modalities. The integration of multiple devices into a working environment should provide greater flexibility to the daily routine of medical experts for example. To this end, we will introduce a medical cyber-physical system that demonstrates the use of a bidirectional connection between a speech-based interface and a head-mounted see-through display. We will show examples of how we can exploit multiple input modalities and thus increase the usability of a speech-based interaction system.
Ranking in information streams BIBAFull-Text 99-100
  Steven Bourke; Michael O'Mahony; Rachael Rafter; Barry Smyth
Information streams allow social network users to receive and interact with the latest messages from friends and followers. But as our social graphs grow and mature it becomes increasingly difficult to deal with the information overload that these realtime streams introduce. Some social networks, like Facebook, use proprietary interestingness metrics to rank messages in an effort to improve stream relevance and drive engagement. In this paper we evaluate learning to rank approaches to rank content based on a variety of features taken from live-user data.
HAPPIcom: haptic pad for impressive text communication BIBAFull-Text 101-102
  Ayano Tamura; Shogo Okada; Katsumi Nitta; Tetsuya Harada; Makoto Sato
We propose a system called Haptic Pad for Impressive Text Communication for creating text messages with haptic stimuli using the SPIDAR-tablet haptic interface. This system helps users indicate emotion in text messages and actions of characters in storytelling by attaching physical feedback to words in text. We evaluated the effectiveness of the system experimentally in two scenarios: storytelling and text messaging. We found that effective use of haptic stimuli depends on each situation and participant.
PhotoAct: act on photo taking BIBAFull-Text 103-104
  Shuguang Wu; Jun Xiao; Ken Reily
In many commercial environments understanding the user's intention can lead to more engaging and intelligent user interactions. We looked at theme park photo kiosks where many people use their camera phones to capture their ride photos on preview displays. We believe that by identifying people with photo-taking intention and engaging them through intelligent UI can help reduce the instances of people opting for low quality but free screen capture. We built a prototype system called PhotoAct, using depth camera to recognize human postures and in real time infer people's photo-taking intentions. In this paper, we describe the system components, the detection algorithm, and present preliminary lab study results.
An affective evaluation tool using brain signals BIBAFull-Text 105-106
  Manolis Perakakis; Alexandros Potamianos
We propose a new interface evaluation tool that incorporates affective metrics which are provided from the ElectroEncephaloGraphy (EEG) signals of the Emotiv EPOC neuro-headset device. The evaluation tool captures and analyzes information in real time from a multitude of sources such as EEG, affective metrics such as frustration, engagement and excitement and facial expression. The proposed tool has been used to gain detailed affective information of users interacting with a mobile multimodal (touch and speech) iPhone application, for which we investigated the effect of speech recognition errors and modality usage patterns.
A privacy-aware shopping scenario BIBAFull-Text 107-108
  Gerrit Kahl; Denise Paradowski
Providing private data is a highly controversial and widely debated topic. Not only the information about individuals but also about companies should be kept private. In order to satisfy the needs of both individuals and companies, corresponding privacy protection mechanisms have to be implemented. For example, systems which assist customers during their shopping process in a physical retail store require customer related information, such as the shopping list, allergy or bank account information as well as data from the retailer, like the product range and prices. In this paper, we introduce a concept for decoupling both information sources implemented in a shopping scenario, which amongst others allows Mobile Payment without the transmission of private data. The implemented prototype has been presented at a large fair to potential users in order to receive valuable feedback.
An initial analysis of semantic wikis BIBAFull-Text 109-110
  Yolanda Gil; Angela Knight; Kevin Zhang; Larry Zhang; Ricky Sethi
Semantic wikis augment wikis with semantic properties that can be used to aggregate and query data through reasoning. Semantic wikis are used by many communities, for widely varying purposes such as organizing genomic knowledge, coding software, and tracking environmental data. Although wikis have been analyzed extensively, there has been no published analysis of the use of semantic wikis. We carried out an initial analysis of twenty semantic wikis selected for their diverse characteristics and content. Based on the number of property edits per contributor, we identified several patterns to characterize community behaviors that are common to groups of wikis.
An affordable real-time assessment system for surgical skill training BIBAFull-Text 111-112
  Gazi Islam; Baoxin Li; Kanav Kahol
This research proposes a novel computer-vision-based approach for skill assessment by observing a surgeon's hand and surgical tool movements in minimally invasive surgical training, which can be extended to the evaluation in real surgeries. Videos capturing the surgical field are analyzed using a system composed of a series of computer vision algorithms. The system automatically detects major skill measuring features from surgical task videos and provides real-time performance feedback on objective and quantitative measurement of surgical skills.


SmartObjects: second workshop on interacting with smart objects BIBAFull-Text 113-114
  Dirk Schnelle-Walka; Jochen Huber; Roman Lissermann; Oliver Brdiczka; Kris Luyten; Max Mühlhäuser
Smart objects are everyday objects that have computing capabilities and give rise to new ways of interaction with our environment. The increasing number of smart objects in our life shapes how we interact beyond the desktop. In this workshop we explore various aspects of the design, development and deployment of smart objects including how one can interact with smart objects.
IUI 2013 3rd workshop on location awareness for mixed and dual reality: (LAMDa'13) BIBAFull-Text 115-118
  Tim Schwartz; Gerrit Kahl; Sally A. Applin; Eyal Dim
This workshop explores the interactions between location awareness and Dual/Mixed/PolySocial Reality in smart (instrumented) environments and their impact on culture and society. The main scope of this workshop is to explore how a Dual/Mixed/PolySocial Reality paradigm can be used to improve applications in smart environments and, by extension, which new possibilities can be opened up by these paradigms.
   These may include positioning methods and location-based services using the DR paradigm, such as navigation services and group interaction services (location-based social signal processing) as well as agent based intermediaries to offset errant voluminous multiplexed communication messaging. The workshop is also open to discuss sensor and actuator technologies that are being developed to foster the growth of interaction possibilities in smart environments.
3rd International workshop on intelligent user interfaces for developing regions: IUI4DR BIBAFull-Text 119-120
  Sheetal Agarwal; Nitendra Rajput; Neesha Kodagoda; B. L. William Wong; Sharon Oviatt
Information Technology (IT) has had significant impact on the society and has touched all aspects of our lives. Up and until now computers and expensive devices have fueled this growth. It has resulted in several benefits to the society. The challenge now is to take this success to its next level where IT services can be accessed by users in developing regions.
   The first IUI4DR workshop was held at IUI 2008. This workshop focused on low cost interfaces, interfaces for illiterate people and on exploring different input mechanisms. The second workshop held at IUI 2011 focused on multimodal applications and collaborative interfaces in particular to aid effective navigation of content and access to services.
   So far we have concentrated on mobile devices as the primary method for people to access content and services. In particular we focused on low-end feature phones that are widely used. However the smart phone market is booming even in developing countries with touch phones available for as little as 50 USD. We want to explore how devices such as smart TVs, smart phones, and old desktop machines, radios, etc. can be used to provide novel interaction methods and interfaces for the low literate populations. We would also like to continue our focus on interaction modalities other than speech such as gestures, haptic inputs and touch interfaces.
IUI workshop on interactive machine learning BIBAFull-Text 121-124
  Saleema Amershi; Maya Cakmak; W. Bradley Knox; Todd Kulesza; Tessa Lau
Many applications of Machine Learning (ML) involve interactions with humans. Humans may provide input to a learning algorithm (in the form of labels, demonstrations, corrections, rankings or evaluations) while observing its outputs (in the form of feedback, predictions or executions). Although humans are an integral part of the learning process, traditional ML systems used in these applications are agnostic to the fact that inputs/outputs are from/for humans.
   However, a growing community of researchers at the intersection of ML and human-computer interaction are making interaction with humans a central part of developing ML systems. These efforts include applying interaction design principles to ML systems, using human-subject testing to evaluate ML systems and inspire new methods, and changing the input and output channels of ML systems to better leverage human capabilities. With this Interactive Machine Learning (IML) workshop at IUI 2013 we aim to bring this community together to share ideas, get up-to-date on recent advances, progress towards a common framework and terminology for the field, and discuss the open questions and challenges of IML.