[1]
HoloDesk: direct 3d interactions with a situated see-through display
Morphing & tracking & stacking: 3D interaction
/
Hilliges, Otmar
/
Kim, David
/
Izadi, Shahram
/
Weiss, Malte
/
Wilson, Andrew
Proceedings of ACM CHI 2012 Conference on Human Factors in Computing Systems
2012-05-05
v.1
p.2421-2430
© Copyright 2012 ACM
Summary: HoloDesk is an interactive system combining an optical see through display
and Kinect camera to create the illusion that users are directly interacting
with 3D graphics. A virtual image of a 3D scene is rendered through a half
silvered mirror and spatially aligned with the real-world for the viewer. Users
easily reach into an interaction volume displaying the virtual image. This
allows the user to literally get their hands into the virtual display and to
directly interact with an spatially aligned 3D virtual world, without the need
for any specialized head-worn hardware or input device. We introduce a new
technique for interpreting raw Kinect data to approximate and track rigid
(e.g., books, cups) and non-rigid (e.g., hands, paper) physical objects and
support a variety of physics-inspired interactions between virtual and real. In
particular the algorithm models natural human grasping of virtual objects with
more fidelity than previously demonstrated. A qualitative study highlights rich
emergent 3D interactions, using hands and real-world objects. The
implementation of HoloDesk is described in full, and example application
scenarios explored. Finally, HoloDesk is quantitatively evaluated in a 3D
target acquisition task, comparing the system with indirect and glasses-based
variants.
[2]
Dynamic portals: a lightweight metaphor for fast object transfer on
interactive surfaces
Interacting with data and virtual objects
/
Voelker, Simon
/
Weiss, Malte
/
Wacharamanotham, Chat
/
Borchers, Jan
Proceedings of the 2011 ACM International Conference on Interactive
Tabletops and Surfaces
2011-11-13
p.158-161
© Copyright 2011 ACM
Summary: We introduce Dynamic Portals, a lightweight interaction technique to
transfer virtual objects across tabletops. They maintain the spatial coherence
of objects and inherently align them to the recipients' workspace. Furthermore,
they allow the exchange of digital documents among multiple users. A remote
view enables users to align their objects at the target location. This paper
explores the interaction technique and shows how our concept can also be
applied as zoomable viewport and shared workspace.
[3]
FingerFlux: near-surface haptic feedback on tabletops
Pointing
/
Weiss, Malte
/
Wacharamanotham, Chat
/
Voelker, Simon
/
Borchers, Jan
Proceedings of the 201 ACM Symposium on User Interface Software and
Technology1
2011-10-16
v.1
p.615-620
© Copyright 2011 ACM
Summary: We introduce FingerFlux, an output technique to generate near-surface haptic
feedback on interactive tabletops. Our system combines electromagnetic
actuation with permanent magnets attached to the user's hand. FingerFlux lets
users feel the interface before touching, and can create both attracting and
repelling forces. This enables applications such as reducing drifting, adding
physical constraints to virtual controls, and guiding the user without visual
output. We show that users can feel vibration patterns up to 35 mm above our
table, and that FingerFlux can significantly reduce drifting when operating
on-screen buttons without looking.
[4]
Gathering in Digital Spaces: Exploring Topical Communities on Twitter
/
Huston, Cate
/
Weiss, Michael
Proceedings of the 2011 International Conference on Social Informatics
2011-10-06
p.320-323
Keywords: social networking; communities; visualization; twitter
© Copyright 2011 Springer
Summary: On Twitter, hashtags allow users to gather around a topic in a digital
space, something that has been common since early IRC and internet chat rooms.
However there are three important differences when gathering on Twitter:
persistence, invitation, and device independence. In this paper, we search for
patterns in these digital spaces through the use of visualization to explore
the temporal rhythms that emerge.
[5]
Second workshop on engineering patterns for multi-touch interfaces
Workshops
/
Luyten, Kris
/
Vanacken, Davy
/
Weiss, Malte
/
Borchers, Jan
/
Nacenta, Miguel
ACM SIGCHI 2011 Symposium on Engineering Interactive Computing Systems
2011-06-13
p.335-336
© Copyright 2011 ACM
Summary: Multi-touch gained a lot of interest in the last couple of years and the
increased availability of multi-touch enabled hardware boosted its development.
However, the current diversity of hardware, toolkits, and tools for creating
multi-touch interfaces has its downsides: there is only little reusable
material and no generally accepted body of knowledge when it comes to the
development of multi-touch interfaces. This workshop is the second workshop on
this topic and the workshop goal remains unchanged: to seek a consensus on
methods, approaches, toolkits, and tools that aid in the engineering of
multi-touch interfaces and transcend the differences in available platforms.
The patterns mentioned in the title indicate that we are aiming to create a
reusable body of knowledge.
[6]
Rendering physical effects in tabletop controls
Tangibles
/
Weiss, Malte
/
Remy, Christian
/
Borchers, Jan
Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems
2011-05-07
v.1
p.3009-3012
© Copyright 2011 ACM
Summary: We introduce dynamic physical properties as an additional degree of freedom
for passive tabletop controls. Using electromagnetic actuation, we manipulate
attributes of tangibles on the fly, such as perceived weight, spring
resistance, friction, and latching. We describe our actuation concepts,
prototypes, and measurements showing that magnetic fields can change physical
effects in a linear way. Controlled experiments reveal that participants can
tactually distinguish four rendered resistance levels of a button prototype and
easily detect dynamic detents in a continuous slider. Finally, we describe how
adjustable physical properties in tangibles can enhance tabletop interaction.
[7]
Increasing energy awareness through web-enabled power outlets
/
Weiss, Markus
/
Guinard, Dominique
Proceedings of the 2010 International Conference on Mobile and Ubiquitous
Multimedia
2010-12-01
p.20
© Copyright 2010 ACM
Summary: Rising global energy demand, increasing electricity prices, and the
limitation of natural resources has led to increased thoughts on residential
energy consumption. A necessary step towards energy conservation is to provide
timely and fine-grained consumption information. This allows for users to
identify energy saving opportunities and possibly adjust their behavior to
conserve energy. In this paper, we present a device-level energy monitoring
system that is based on off-the-shelf components and enables users to monitor,
control, and compare the electricity consumption of their appliances. By
providing a RESTful API, we seamlessly integrate the smart power outlets into
the web and facilitate the development of extensions and novel features. We
demonstrate this through the implementation of a web user interface and a
mobile phone interface. We further confirm the suitability of our approach with
the help of a 12 months pilot deployment. The results of a questionnaire
provide insights into additional user features and the interviews conducted
with developers who used our open sourced system illustrate the usefulness of
the RESTful approach for the smart energy domain.
[8]
BendDesk: dragging across the curve
Displays
/
Weiss, Malte
/
Voelker, Simon
/
Sutter, Christine
/
Borchers, Jan
Proceedings of the 2010 ACM International Conference on Interactive
Tabletops and Surfaces
2010-11-07
p.1-10
© Copyright 2010 ACM
Summary: We present BendDesk, a hybrid interactive desk system that combines a
horizontal and a vertical interactive surface via a curve. The system provides
seamless touch input across its entire area. We explain scalable algorithms
that provide graphical output and multi-touch input on a curved surface. In
three tasks we investigate the performance of dragging gestures across the
curve, as well as the virtual aiming at targets. Our main findings are: 1)
Dragging across a curve is significantly slower than on flat surfaces. 2) The
smaller the entrance angle when dragging across the curve, the longer the
average trajectory and the higher the variance of trajectories across users. 3)
The curved shape of the system impairs virtual aiming at targets.
[9]
The BendDesk demo: multi-touch on a curved display
Demos
/
Weiss, Malte
/
Voelker, Simon
/
Borchers, Jan
Proceedings of the 2010 ACM International Conference on Interactive
Tabletops and Surfaces
2010-11-07
p.317
© Copyright 2010 ACM
Summary: BendDesk is a curved interactive display that merges a vertical and a
horizontal multi-touch surface with a curve. Users sitting at the table can
perform multi-touch input on the entire surface. This demo shows the
capabilities and potential applications of such a setup. We also present Bend
Invaders, one of the first arcade games on a curved interactive surface. Our
demo intends to encourage the discussion about the future of multi-touch in
desk environments.
[10]
Madgets: actuating widgets on interactive tabletops
Surface
/
Weiss, Malte
/
Schwarz, Florian
/
Jakubowski, Simon
/
Borchers, Jan
Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
2010-10-03
p.293-302
Keywords: actuation, multi-touch, tabletop interaction, tangible user interfaces,
widgets
© Copyright 2010 ACM
Summary: We present a system for the actuation of tangible magnetic widgets (Madgets)
on interactive tabletops. Our system combines electromagnetic actuation with
fiber optic tracking to move and operate physical controls. The presented
mechanism supports actuating complex tangibles that consist of multiple parts.
A grid of optical fibers transmits marker positions past our actuation hardware
to cameras below the table. We introduce a visual tracking algorithm that is
able to detect objects and touches from the strongly sub-sampled video input of
that grid. Six sample Madgets illustrate the capabilities of our approach,
ranging from tangential movement and height actuation to inductive power
transfer. Madgets combine the benefits of passive, untethered, and translucent
tangibles with the ability to actuate them with multiple degrees of freedom.
[11]
Bringing everyday applications to interactive surfaces
Doctoral consortium
/
Weiss, Malte
Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
2010-10-03
p.375-378
Keywords: actuation, applications, curved surface, haptic feedback, interactive
tabletops, tangible user interfaces
© Copyright 2010 ACM
Summary: This paper presents ongoing work that intends to simplify the introduction
of everyday applications to interactive tabletops. SLAP Widgets bring tangible
general-purpose widgets to tabletops while providing the flexibility of
on-screen controls. Madgets maintain consistency between physical controls and
their digital state. BendDesk represents our vision of a multi-touch enabled
office environment. Our pattern language captures knowledge for the design of
interactive tabletops. For each project, we describe its technical background,
present the current state of research, and discuss future work.
[12]
Engineering patterns for multi-touch interfaces
Workshops
/
Luyten, Kris
/
Vanacken, Davy
/
Weiss, Malte
/
Borchers, Jan
/
Izadi, Shahram
/
Wigdor, Daniel
ACM SIGCHI 2010 Symposium on Engineering Interactive Computing Systems
2010-06-19
p.365-366
Keywords: eics workshop, engineering patterns, multi-touch interfaces
© Copyright 2010 ACM
Summary: Multi-touch gained a lot of interest in the last couple of years and the
increased availability of multi-touch enabled hardware boosted its development.
However, the current diversity of hardware, toolkits, and tools for creating
multi-touch interfaces has its downsides: there is only little reusable
material and no generally accepted body of knowledge when it comes to the
development of multi-touch interfaces. This workshop seeks a consensus on
methods, approaches, toolkits, and tools that aid in the engineering of
multi-touch interfaces and transcend the differences in available platforms.
The patterns mentioned in the title indicate that we are aiming to create a
reusable body of knowledge.
[13]
EDITED BOOK
Tabletops -- Horizontal Interactive Displays
Human-Computer Interaction Series
/
Müller-Tomfelde, Christian
2010
n.18
p.456
Springer London
DOI: 10.1007/978-1-84996-113-4
== Under Tabletops ==
Building Interactive Multi-touch Surfaces (27-49)
+ Schöning, Johannes
+ Hook, Jonathan
+ Bartindale, Tom
+ Schmidt, Dominik
+ Oliver, Patrick
+ et al
From Table-System to Tabletop: Integrating Technology into Interactive Surfaces (51-69)
+ Kunz, Andreas
+ Fjeld, Morten
High-Resolution Interactive Displays (71-100)
+ Ashdown, Mark
+ Tuddenham, Philip
+ Robinson, Peter
Optical Design of Tabletop Displays and Interactive Applications (101-129)
+ Kakehi, Yasuaki
+ Naemura, Takeshi
Hand and Object Recognition on Liquid Crystal Displays (131-146)
+ Koike, Hideki
+ Sato, Toshiki
+ Nishikawa, Wataru
+ Fukuchi, Kentaro
== On and Above Tabletops ==
Augmenting Interactive Tabletops with Translucent Tangible Controls (149-170)
+ Weiss, Malte
+ Hollan, James D.
+ Borchers, Jan
Active Tangible Interactions (171-187)
+ Inami, Masahiko
+ Sugimoto, Maki
+ Thomas, Bruce H.
+ Richter, Jan
Interaction on the Tabletop: Bringing the Physical to the Digital (189-221)
+ Hilliges, Otmar
+ Butz, Andreas
+ Izadi, Shahram
+ Wilson, Andrew D.
Supporting Atomic User Actions on the Table (223-247)
+ Aliakseyeu, Dzmitry
+ Subramanian, Sriram
+ Alexander, Jason
Imprecision, Inaccuracy, and Frustration: The Tale of Touch Input (249-275)
+ Benko, Hrvoje
+ Wigdor, Daniel
On, Above, and Beyond: Taking Tabletops to the Third Dimension (277-299)
+ Grossman, Tovi
+ Wigdor, Daniel
== Around and Beyond Tabletops ==
Individual and Group Support in Tabletop Interaction Techniques (303-333)
+ Nacenta, Miguel A.
+ Pinelle, David
+ Gutwin, Carl
+ Mandryk, Regan
File System Access for Tabletop Interaction (335-355)
+ Collins, Anthony
+ Kay, Judy
Theory of Tabletop Territoriality (357-385)
+ Scott, Stacey D.
+ Carpendale, Sheelagh
Digital Tables for Collaborative Information Exploration (387-405)
+ Isenberg, Petra
+ Hinrichs, Uta
+ Hancock, Mark
+ Carpendale, Sheelagh
Coordination and Awareness in Remote Tabletop Collaboration (407-434)
+ Tuddenham, Philip
+ Robinson, Peter
Horizontal Interactive Surfaces in Distributed Assemblies (435-456)
+ Müller-Tomfelde, Christian
+ O'Hara, Kenton
[14]
Handy feedback: connecting smart meters with mobile phones
/
Weiss, Markus
/
Mattern, Friedemann
/
Graml, Tobias
/
Staake, Thorsten
/
Fleisch, Elgar
Proceedings of the 2009 International Conference on Mobile and Ubiquitous
Multimedia
2009-11-22
p.15
© Copyright 2009 ACM
Summary: Reducing their energy consumption has become an important objective for many
people. Consumption transparency and timely feedback are essential to support
those who want to adjust their behavior in order to conserve energy. In this
work, we propose an interactive system that provides instantaneous feedback
concerning the energy usage on household and device level. For that, we used
and extended the capabilities of a smart electricity meter, built a web-based
API to enable interoperability with other applications, and developed a mobile
phone interface that allows users to monitor, control, and measure the
consumption of single appliances. Our system illustrates a way how usage
barriers can be lowered and how high user involvement can be created. By
providing users the electricity feedback needed -- in real-time and on device
level -- the system allows for identifying the biggest energy guzzlers and
helps users decrease their energy consumption.
[15]
SLAP widgets: bridging the gap between virtual and physical controls on
tabletops
Tangibles on tables
/
Weiss, Malte
/
Wagner, Julie
/
Jansen, Yvonne
/
Jennings, Roger
/
Khoshabeh, Ramsin
/
Hollan, James D.
/
Borchers, Jan
Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems
2009-04-04
v.1
p.481-490
Keywords: augmented virtuality, dynamic relabeling, multi-touch, tabletop interaction,
tangible user interfaces, toolkit, transparent widgets
© Copyright 2009 ACM
Summary: We present Silicone iLluminated Active Peripherals (SLAP), a system of
tangible, translucent widgets for use on multitouch tabletops. SLAP Widgets are
cast from silicone or made of acrylic, and include sliders, knobs, keyboards,
and buttons. They add tactile feedback to multi-touch tables, improving input
accuracy. Using rear projection, SLAP Widgets can be relabeled dynamically,
providing inexpensive, battery-free, and untethered augmentations. Furthermore,
SLAP combines the flexibility of virtual objects with physical affordances. We
evaluate how SLAP Widgets influence the user experience on tabletops compared
to virtual controls. Empirical studies show that SLAPWidgets are easy to use
and outperform virtual controls significantly in terms of accuracy and overall
interaction time.
[16]
SLAP widgets: bridging the gap between virtual and physical controls on
tabletops
Interactivity: on the table
/
Weiss, Malte
/
Jennings, Roger
/
Khoshabeh, Ramsin
/
Borchers, Jan
/
Wagner, Julie
/
Jansen, Yvonne
/
Hollan, James D.
Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems
2009-04-04
v.2
p.3229-3234
Keywords: dynamic relabeling, multi-touch, tabletop interaction, tangible user
interfaces, toolkit, transparent widgets
© Copyright 2009 ACM
Summary: We present Silicone iLluminated Active Peripherals (SLAP), a system of
tangible, transparent widgets for use on vision-based multi-touch tabletops.
SLAP Widgets are cast from silicone or made of acrylic and include sliders,
knobs, keyboards, and keypads. They add tactile feedback to multi-touch tables
and can be dynamically relabeled with rear projection. They are inexpensive,
battery-free, and untethered widgets combining the flexibility of virtual
objects with tangible affordances of physical objects. Our demonstration shows
how SLAP Widgets can augment input on multi-touch tabletops with modest
infrastructure costs.
[17]
Saltate!: a sensor-based system to support dance beginners
Spotlight on work in progress session 1
/
Drobny, Dieter
/
Weiss, Malte
/
Borchers, Jan
Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems
2009-04-04
v.2
p.3943-3948
Keywords: dancing, motor skill learning, wearable computing, wireless sensor system
© Copyright 2009 ACM
Summary: We present Saltate!, a wireless prototype system to support beginners of
ballroom dancing. Saltate! acquires data from force sensors mounted under the
dancers' feet, detects steps, and compares their timing to the timing of beats
in the music playing. If it detects mistakes, Saltate! emphasizes the beats in
the music acoustically to help the dancing couple stay in sync with the music.
[18]
Multi-user interaction in virtual audio spaces
Spotlight on work in progress session 2
/
Heller, Florian
/
Knott, Thomas
/
Weiss, Malte
/
Borchers, Jan
Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems
2009-04-04
v.2
p.4489-4494
Keywords: augmented reality, mobile computing, museum, spatial audio
© Copyright 2009 ACM
Summary: Audio guides are a common way to provide museum visitors with an opportunity
for personalized, self-paced information retrieval. However, this
personalization conflicts with some of the reasons many people go to museums,
i.e., to socialize, to be with friends, and to discuss the exhibit as they
experience it [1]. We developed an interactive museum experience based on audio
augmented reality that lets the visitor interact with a virtual spatial audio
soundscape. In this paper, we present some new interaction metaphors we use in
the design of this audio space, as well as some techniques to generate a group
experience within audio spaces.
[19]
SLAPbook: tangible widgets on multi-touch tables in groupware environments
Tabletop tangibles and augmented surfaces
/
Weiss, Malte
/
Wagner, Julie
/
Jennings, Roger
/
Jansen, Yvonne
/
Khoshabeh, Ramsin
/
Hollan, James D.
/
Borchers, Jan
Proceedings of the 3rd International Conference on Tangible and Embedded
Interaction
2009-02-18
p.297-300
© Copyright 2009 ACM
Summary: We present SLAPbook, an application using SLAP, translucent and tangible
widgets for use on vision-based multi-touch tabletops in Single Display
Groupware (SDG) environments. SLAP stands for Silicone ILluminated Active
Peripherals and includes widgets such as sliders, knobs, keyboards, and
buttons. The widgets and tactile feedback to multi-touch tables while
simultaneously providing dynamic relabeling to tangible objects using the
table's rear projection. SLAPbook provides multiple users the ability to add
and edit content to a guestbook, browse other peoples' entries, and access
personal data using a token-based personalization system. Interaction with the
table takes place in the personal and public space so that users can make use
of personal and shared controls to perform separate and coordinative actions.
[20]
DRAGON: a direct manipulation interface for frame-accurate in-scene video
navigation
Improved Video Navigation and Capture
/
Karrer, Thorsten
/
Weiss, Malte
/
Lee, Eric
/
Borcers, Jan
Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems
2008-04-05
v.1
p.247-250
© Copyright 2008 ACM
Summary: We present DRAGON, a direct manipulation interaction technique for
frame-accurate navigation in video scenes. This technique benefits tasks such
as professional and amateur video editing, review of sports footage, and
forensic analysis of video scenes. By directly dragging objects in the scene
along their movement trajectory, DRAGON enables users to quickly and precisely
navigate to a specific point in the video timeline where an object of interest
is in a desired location. Examples include the specific frame where a sprinter
crosses the finish line, or where a car passes a traffic light. Through a user
study, we show that DRAGON significantly reduces task completion time for
in-scene navigation tasks by an average of 19-42% compared to a standard
timeline slider. Qualitative feedback from users is also positive, with
multiple users indicating that the DRAGON interaction felt more natural than
the traditional timeline slider for in-scene navigation.