Aakar Gupta


Extend Screenshot
Investigating Remote Tactile Feedback for Mid-Air Text-Entry in Virtual Reality

Aakar Gupta, Majed Samad, Kenrick Kin, Per Ola Kristensson, and Hrvoje Benko
In Proceedings of ISMAR 2020

We investigate the utility of remote tactile feedback for freehand text-entry on a mid-air Qwerty keyboard in VR. We report on a multi-session text-entry study with 24 participants where we investigated four vibrotactile feedback conditions: on-fingers, on-wrist spatialized, on-wrist non-spatialized, and audio-visual only. Participants overwhelmingly prefer the tactile feedback conditions.
logo Paper   logo Video
Extend Screenshot
Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing

Jun Gong, Aakar Gupta, and Hrvoje Benko
In Proceedings of UIST 2020

Acustico is a passive acoustic sensing approach that enables tap detection and 2D tap localization on uninstrumented surfaces using a wristworn device. Our technique uses a novel application of acoustic time differences of arrival (TDOA) analysis. We adopt a sensor fusion approach by taking both “surface waves” (i.e., vibrations through surface) and “sound waves” (i.e., vibrations through air) to improve sensing resolution.
logo Paper   logo Video
Extend Screenshot
Extend, Push, Pull: Smartphone Mediated Interaction in Spatial Augmented Reality via Intuitive Mode Switching

Jeremy Hartmann, Aakar Gupta, and Daniel Vogel
In Proceedings of SUI 2020

This work proposes an interaction technique that enables pushing smartphone content out into spatial augmented reality (SAR), pulling content from SAR back into the phone, transformations, and content-specific manipulation. The technique relies on an implicit mode switching arm extension gesture. A random-forest classifier achieves 96% accuracy on detecting the gesture.
logo Paper   logo Video
Tangible Screenshot
Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media Objects

Aakar Gupta, Borui Lin, Siyi Ji, Arjav Patel, and Daniel Vogel
In Proceedings of CHI 2020

Today's digital media experiences lack the physicality of paging through an album, reading a newspaper, or meandering in a bookshelf. Overlaying physical objects with digital content via augmented reality holds promise towards bridging this gap. This work proposes a novel interaction framework, 'Replicate and Reuse' for incorporating tangbility and multimodality into such AR-overlaid physical objects.
logo Paper   logo Video
Pneusleeve Screenshot
PneuSleeve: In-fabric Multimodal Actuation and Sensing in a Soft, Compact, and Expressive Haptic Sleeve

Mengjia Zhu, Amirhossein H. Memar, Aakar Gupta, Majed Samad, Priyanshu Agarwal, Sean Keller, and Nick Colonnese
In Proceedings of CHI 2020 (HONORABLE MENTION AWARD)

Integration of soft haptic devices into garments can improve their usability and wearability for daily computing interactions. This work introduces PneuSleeve, a soft, compact, and expressive fabric forearm sleeve capable of rendering a range of haptic stimuli including compression, skin stretch, and vibration via pneumatic pressure control inside embroidered stretchable tubes.
logo Paper   logo Video
RotoSwype Screenshot
RotoSwype:Word-Gesture Typing using a Ring

Aakar Gupta, Cheng Ji, Hui-Shyong Yeo, Aaron Quigley, Daniel Vogel
In Proceedings of CHI 2019

RotoSwype is a technique for word-gesture typing by rotating a ring worn on the index finger. RotoSwype enables fast, accurate, single-handed text-input without encumbering the hand with a device, a desirable quality in many scenarios, including virtual or augmented reality.
logo Paper   logo Video
Tablet In VR Screenshot
TabletInVR: Exploring the Design Space for Using a Multi-Touch Tablet in Virtual Reality

Hemant Bhaskar Surale, Aakar Gupta, Mark Hancock, Daniel Vogel
In Proceedings of CHI 2019

TableInVR investigates how a table inside VR can support 3D modeling interaction tasks. It demonstrates how a tablet's precise touch input capability and passieve haptic feedback can be combined with barehand mid-air input to support creation, selection, rotate-translate-scale, and editing of 3D models inside VR.
logo Paper   logo Video
WRIST Screenshot
WRIST: Watch-Ring Interaction and Sensing Technique for Wrist Gestures and Macro-Micro Pointing

Hui-Shyong Yeo, Juyoung Lee, Hyung-il Kim, Aakar Gupta, Andrea Bianchi, Daniel Vogel, Hideki Koike, Woontack Woo, Aaron Quigley
In Proceedings of MobileHCI 2019

WRIST fuses the IMU sensor data from a smartwatch and a smartring to enable 6-DOF tracking of wrist+finger. This enables a new form of pointing, called macro-micro pointing for immersive scenarios. It further enables a class of wrist+finger gestures.
logo Paper   logo Video
Asterisk Screenshot
Asterisk and Obelisk: Motion Codes for Passive Tagging

Aakar Gupta, Jiushan Yang, Ravin Balakrishnan
In Proceedings of UIST 2018

We propose Motion Codes, a passive tagging mechanism that is based on the kinesthetic motion of the user's hand. To scan a motion tag the user simply traces their finger over the pattern and the motion is decoded into the encoded information by an inertial motion ring.
logo Paper   logo Video
HapticClench Screenshot
HapticClench: Investigating Squeeze Sensations using Memory Alloys

Aakar Gupta, Antony Albert Raj Irudayaraj, Ravin Balakrishnan
In Proceedings of UIST 2017

Squeezing is one of the most intimate forms of human contact. HapticClench generates squeezing sensations on the wrist using shape memory springs. We show that HapticClench can generate up to 4 distinguishable loads, works well in distracted scenarios, has high spatial acuity and can communicate gradual progression information.
logo Paper   logo Video
Summon Screenshot
Summon and Select: Rapid Interaction with Interface Controls in Mid-air

Aakar Gupta, Thomas Pietrzak, Cleon Yau, Nicolas Roussel, Ravin Balakrishnan
In Proceedings of ISS 2017

Current freehand interactions rely on point & select wherein the constant hand movement in air for pointer navigation leads to hand fatigue quickly. We introduce summon & select, a new model for freehand interaction where, instead of navigating to the control, the user summons it into focus and then manipulates it.
logo Paper   logo Video
Porous Screenshot
Porous Interfaces for Small Screen Multitasking using Finger Identification

Aakar Gupta, Muhammed Anwar, Ravin Balakrishnan
In Proceedings of UIST 2016

The lack of a dedicated multitasking interface in smartphones results in frequent app switching which has obvious temporal, physical, and cognitive costs. Porous interfaces enable fast and efficient smartphone multitasking using translucent windows and finger identification.
logo Paper   logo Video
Semaphoric Screenshot
Haptic Learning of Freehand Semaphoric Gestures

Aakar Gupta, Antony Irudayaraj, Vimal Chandran, Goutham Palaniappan, Khai N. Truong, Ravin Balakrishnan
In Proceedings of UIST 2016

Semaphoric gestures that act as shortcuts for mid-air commands require dedicated learning. We show that haptic gestural learning enables learning without visual engagement thus allowing users to learn in mobile scenarios.
logo Paper
DualKey Screenshot
DualKey: Miniature Screen Text Entry via Finger Identification

Aakar Gupta, Ravin Balakrishnan
In Proceedings of CHI 2016 (HONORABLE MENTION AWARD)

Fast and accurate access to letter keys for miniature screens remains an open question. We propose DualKey, a text entry technique that uses finger identification. In a 10-day study, DualKey outperforms existing techniques and achieves up to 25 words-per-min.
logo Paper   logo Video
DMT Screenshot
Direct Manipulation in Tactile Displays

Aakar Gupta, Thomas Pietrzak, Nicolas Roussel, Ravin Balakrishnan
In Proceedings of CHI 2016 (HONORABLE MENTION AWARD)

Wearables remain in persistent skin contact which demands the exploration of tactile interactions as rich as visual displays. We introduce the concept of a Direct Manipulation-enabled Tactile display that consists of a tactile pointing interface with a tactile screen, tactile pointer, and tactile targets.
logo Paper   logo Video
Mobile Crowdsourcing Screenshot
mClerk: Enabling Mobile Crowdsourcing in Developing Regions

Aakar Gupta, William Thies, Edward Cutrell, Ravin Balakrishnan
In Proceedings of CHI 2012

mClerk enables crowdsourced distribution of local-language digitization tasks to low-end mobile phones by leveraging a little-known protocol to send small images via ordinary SMS. mClerk spread virally from 10 users to 239 users during a 5-week deployment in semi-urban India and digitized over 25,000 words.
logo Paper   logo MIT-TR
Biometric Attendance Terminal
Biometric Monitoring as a Persuasive Technology: Ensuring Patients Visit Health Centers in India's Slums

Nupur Bhatnagar, Abhishek Sinha, Navkar Samdaria, Aakar Gupta, Shelly Batra, Manish Bhardwaj, William Thies
In Proceedings of Persuasive 2012

Tuberculosis patients in rural India are required to visit a center over 40 times over 6 months. We explore the role of a biometric attendance terminal, which enrolled over 2,300 patients across 25 centers, in persuading patients to complete health visits in slum communities of New Delhi, India.
logo Paper
Collage Screenshot
Collage: A Presentation Tool for the K-12 Classroom

Saurabh Panjwani, Aakar Gupta, Navkar Samdaria, Edward Cutrell, Kentaro Toyama
In Proceedings of ICTD 2010

Collage is a software presentation tool created exclusively for supporting instruction in a K-12 classroom in the developing world. The tool enables teachers to display digital scans of textbook pages along with digital multimedia in an interactive fashion.
logo Paper   logo Video
5Years Image
Five years of IndiaHCI: A Scientometric Analysis

Aakar Gupta
In Proceedings of IndiaHCI 2015

After five consecutive years of IndiaHCI (2010-2014), we analyze the demographics, citations and themes of its proceedings to reflect upon the way forward for the conference and the HCI community in India.
logo Paper


Mobile Crowdsourcing Screenshot
EduPal: Smarter Education

Aakar Gupta, Malolan Chetlur, Bikram Sengupta, Ashay U. Tamhane
In Workshop OUI-ITD 2013 at ICTD 2013

Researched auto-alignments of lecture videos and the accompanying content, slides, comments and recommendations for smart learning videos. Also conducted a field survey of state of the art education technologies and their 'openness'.
logo Paper   logo Patent
Prototype Screenshot
DISHA: Multiple Mice in Narrative Content-based Computer Aided Learning for Children

Aakar Gupta, Praveen Shekhar, Navkar Samdaria, Mohit Jain, Joyojeet Pal
In Oral Presentation at IndiaHCI 2010

The MultiPoint technology enables multiple students, each with their own mouse, to simultaneously engage on a single PC. In collaboration with NCERT, India, we developed a unique design methodology that allows teachers to be the primary designers for collaborative learning games that supplement classroom teaching.
logo Paper   logo ICTD'09 Demo   logo Video
DISHA Screenshot
Teachers as Game Designers: Lessons from a Collaborative Learning Exercise

Navkar Samdaria, Praveen Shekhar, Aakar GuptaDavid Hutchful
In Case Studies at IndiaHCI 2011

DISHA (Disease and Health Awareness) is a narrative-interactive MultiPoint application for spreading public health information among children in low-income regions. The project won the MultiPoint Education Award at the World Finals of Microsoft Imagine Cup 2009. [Video]
logo Paper   logo Video