Shumin Zhai

Orcid: 0000-0003-0752-2090

Affiliations:
  • IBM Almaden Research Center, San Jose, USA


According to our database1, Shumin Zhai authored at least 139 papers between 1993 and 2024.

Collaborative distances:

Awards

ACM Fellow

ACM Fellow 2010, "For contributions to human computer interface research and innovation.".

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
Neural Search Space in Gboard Decoder.
CoRR, 2024

Proofread: Fixes All Errors with One Tap.
CoRR, 2024

SkipWriter: LLM-Powered Abbreviated Writing on Tablets.
Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, 2024

Can Capacitive Touch Images Enhance Mobile Keyboard Decoding?
Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, 2024

Neural Search Space in Gboard Decoder.
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: EMNLP 2024, 2024

CRTypist: Simulating Touchscreen Typing Behavior via Computational Rationality.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024

Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024

2023
C-PAK: Correcting and Completing Variable-Length Prefix-Based Abbreviated Keystrokes.
ACM Trans. Comput. Hum. Interact., February, 2023

Private Federated Learning in Gboard.
CoRR, 2023

TouchType-GAN: Modeling Touch Typing with Generative Adversarial Network.
Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023

WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial Network.
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

2022
EyeSayCorrect: Eye Gaze and Voice Based Hands-free Text Correction for Mobile Devices.
Proceedings of the IUI 2022: 27th International Conference on Intelligent User Interfaces, Helsinki, Finland, March 22, 2022

TypeAnywhere: A QWERTY-Based Text Entry Solution for Ubiquitous Computing.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

2021
Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for Smartphones.
Proceedings of the UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology, 2021

Modeling Touch Point Distribution with Rotational Dual Gaussian Model.
Proceedings of the UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology, 2021

PhraseFlow: Designs and Empirical Studies of Phrase-Level Input.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

TapNet: The Design, Training, Implementation, and Applications of a Multi-Task Learning CNN for Off-Screen Mobile Input.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

Issues Related to Using Finger-Fitts law to Model One-Dimensional Touch Pointing Tasks.
Proceedings of the Chinese CHI 2021: The Ninth International Symposium of Chinese CHI, Online Event, Hong Kong, October 16, 2021

2020
Modeling Two Dimensional Touch Pointing.
Proceedings of the UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology, 2020

2019
i'sFree: Eyes-Free Gesture Typing via a Touch-Enabled Remote Control.
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

Text Entry Throughput: Towards Unifying Speed and Accuracy in a Single Performance Metric.
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

Active Edge: Designing Squeeze Gestures for the Google Pixel 2.
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild.
Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

Touchscreen Haptic Augmentation Effects on Tapping, Drag and Drop, and Path Following.
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

2018
Modeling Gesture-Typing Movements.
Hum. Comput. Interact., 2018

Typing on an Invisible Keyboard.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

Understanding the Uncertainty in 1D Unidirectional Moving Target Selection.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

2017
Modern Touchscreen Keyboards as Intelligent User Interfaces: A Research Review.
Proceedings of the 22nd International Conference on Intelligent User Interfaces, 2017

2016
Predicting Finger-Touch Accuracy Based on the Dual Gaussian Distribution Model.
Proceedings of the 29th Annual Symposium on User Interface Software and Technology, 2016

A Cost-Benefit Study of Text Entry Suggestion Interaction.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

WatchWriter: Tap and Gesture Typing on a Smartwatch Miniature Keyboard with Statistical Decoding.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

2015
TOCHI Editor-in-Chief Transition: Farewell from Shumin Zhai, Welcome Ken Hinckley.
ACM Trans. Comput. Hum. Interact., 2015

Differences and Similarities between Finger and Pen Stroke Gestures on Stationary and Mobile devices.
ACM Trans. Comput. Hum. Interact., 2015

Long short term memory neural network for keyboard gesture decoding.
Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

Optimizing Touchscreen Keyboards for Gesture Typing.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015

Performance and User Experience of Touchscreen and Gesture Keyboards in a Lab Setting and in the Wild.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015

Principles, Techniques and Perspectives on Optimization and HCI.
Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, 2015

Effects of Language Modeling and its Personalization on Touchscreen Typing Performance.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015

Technology Transfer of HCI Research Innovations: Challenges and Opportunities.
Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, 2015

2014
Editorial: TOCHI turns twenty.
ACM Trans. Comput. Hum. Interact., 2014

Both complete and correct?: multi-objective optimization of touchscreen keyboard.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

2013
The impact of candidate display styles for Japanese and Chinese characters on input efficiency.
Int. J. Hum. Comput. Stud., 2013

Bayesian touch: a statistical criterion of target selection with finger touch.
Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, 2013

Making touchscreen keyboards adaptive to keys, hand postures, and individuals: a hierarchical spatial backoff model approach.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

The future of HCI publishing in journals and books.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

FFitts law: modeling finger touch with fitts' law.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

Octopus: evaluating touchscreen keyboard correction and recognition algorithms via.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

2012
Multilingual Touchscreen Keyboard Design and Optimization.
Hum. Comput. Interact., 2012

Foundational Issues in Touch-Surface Stroke Gesture Design - An Integrative Review
Found. Trends Hum. Comput. Interact., 2012

The word-gesture keyboard: reimagining keyboard interaction.
Commun. ACM, 2012

Bimanual gesture keyboard.
Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, 2012

Touch behavior with different postures on soft smartphone keyboards.
Proceedings of the Mobile HCI '12, 2012

A comparative evaluation of finger and pen stroke gestures.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012

An investigation of the relationship between texture and human performance in steering tasks.
Proceedings of the Asia Pacific Conference on Computer Human Interaction, 2012

2011
Understanding information preview in mobile email processing.
Proceedings of the 13th Conference on Human-Computer Interaction with Mobile Devices and Services, 2011

Smart phone use by non-mobile business users.
Proceedings of the 13th Conference on Human-Computer Interaction with Mobile Devices and Services, 2011

2010
Foundations for designing and evaluating user interfaces based on the crossing paradigm.
ACM Trans. Comput. Hum. Interact., 2010

"Writing with music": Exploring the use of auditory feedback in gesture interfaces.
ACM Trans. Appl. Percept., 2010

Phone n' Computer: teaming up an information appliance with a PC.
Pers. Ubiquitous Comput., 2010

Pen pressure control in trajectory-based interaction.
Behav. Inf. Technol., 2010

SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture.
Proceedings of the 28th International Conference on Human Factors in Computing Systems, 2010

Quasi-qwerty soft keyboard optimization.
Proceedings of the 28th International Conference on Human Factors in Computing Systems, 2010

2009
Shapewriter on the iphone: from the laboratory to the real world.
Proceedings of the 27th International Conference on Human Factors in Computing Systems, 2009

The performance of touch screen soft buttons.
Proceedings of the 27th International Conference on Human Factors in Computing Systems, 2009

Using strokes as command shortcuts: cognitive benefits and toolkit support.
Proceedings of the 27th International Conference on Human Factors in Computing Systems, 2009

2008
Improving word-recognizers using an interactive lexicon with active and passive words.
Proceedings of the 13th International Conference on Intelligent User Interfaces, 2008

On the ease and efficiency of human-computer interfaces.
Proceedings of the Eye Tracking Research & Application Symposium, 2008

Interlaced QWERTY: accommodating ease of visual search and input flexibility in shape writing.
Proceedings of the 2008 Conference on Human Factors in Computing Systems, 2008

2007
Learning shape writing by game playing.
Proceedings of the Extended Abstracts Proceedings of the 2007 Conference on Human Factors in Computing Systems, 2007

Command strokes with and without preview: using pen gestures on keyboard for command selection.
Proceedings of the 2007 Conference on Human Factors in Computing Systems, 2007

Hard lessons: effort-inducing interfaces benefit spatial learning.
Proceedings of the 2007 Conference on Human Factors in Computing Systems, 2007

Modeling human performance of pen stroke gestures.
Proceedings of the 2007 Conference on Human Factors in Computing Systems, 2007

2006
Mobile Phones Will Become The Primary Personal Computing Devices.
Proceedings of the Seventh IEEE Workshop on Mobile Computing Systems & Applications, 2006

Connection Time for Strange Devices.
Proceedings of the Seventh IEEE Workshop on Mobile Computing Systems & Applications, 2006

Camera phone based motion sensing: interaction techniques, applications and performance study.
Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, 2006

The benefits of augmenting telephone voice menu navigation with visual browsing and search.
Proceedings of the 2006 Conference on Human Factors in Computing Systems, 2006

2005
Introduction to sensing-based interaction.
ACM Trans. Comput. Hum. Interact., 2005

In search of effective text input interfaces for off the desktop computing.
Interact. Comput., 2005

Dial and see: tackling the voice menu navigation problem with cross-device user experience integration.
Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, 2005

Relaxing stylus typing precision by geometric pattern matching.
Proceedings of the 10th International Conference on Intelligent User Interfaces, 2005

RealTourist - A Study of Augmenting Human-Human and Human-Computer Dialogue with Eye-Gaze Overlay.
Proceedings of the Human-Computer Interaction, 2005

Conversing with the user based on eye-gaze patterns.
Proceedings of the 2005 Conference on Human Factors in Computing Systems, 2005

2004
Human Action Laws in Electronic Virtual Worlds - An Empirical Study of Path Steering Performance in VR.
Presence Teleoperators Virtual Environ., 2004

Speed-accuracy tradeoff in Fitts' law tasks-on the equivalency of actual and nominal pointing precision.
Int. J. Hum. Comput. Stud., 2004

Characterizing computer input with Fitts' law parameters-the information and non-information aspects of pointing.
Int. J. Hum. Comput. Stud., 2004

Top-down learning strategies: can they facilitate stylus keyboard learning?
Int. J. Hum. Comput. Stud., 2004

SHARK<sup>2</sup>: a large vocabulary shorthand writing system for pen-based computers.
Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, 2004

TNT: a numeric keypad based text input method.
Proceedings of the 2004 Conference on Human Factors in Computing Systems, 2004

View size and pointing difficulty in multi-scale navigation.
Proceedings of the working conference on Advanced visual interfaces, 2004

2003
What's in the eyes for attentive input.
Commun. ACM, 2003

Human Movement Performance in Relation to Path Constraint - The Law of Steering in Locomotion.
Proceedings of the IEEE Virtual Reality Conference 2003 (VR 2003), 2003

Collaboration Meets Fitts' Law: Passing Virtual Objects with and without Haptic Force Feedback.
Proceedings of the Human-Computer Interaction INTERACT '03: IFIP TC13 International Conference on Human-Computer Interaction, 2003

Candidate Display Styles in Japanese Input.
Proceedings of the Human-Computer Interaction INTERACT '03: IFIP TC13 International Conference on Human-Computer Interaction, 2003

Shorthand writing on stylus keyboard.
Proceedings of the 2003 Conference on Human Factors in Computing Systems, 2003

Human on-line response to target expansion.
Proceedings of the 2003 Conference on Human Factors in Computing Systems, 2003

High precision touch screen interaction.
Proceedings of the 2003 Conference on Human Factors in Computing Systems, 2003

Refining Fitts' law models for bivariate pointing.
Proceedings of the 2003 Conference on Human Factors in Computing Systems, 2003

2002
Performance Optimization of Virtual Keyboards.
Hum. Comput. Interact., 2002

Movement model, hits distribution and learning in virtual keyboarding.
Proceedings of the CHI 2002 Conference on Human Factors in Computing Systems: Changing our World, 2002

More than dotting the i's - foundations for crossing-based interfaces.
Proceedings of the CHI 2002 Conference on Human Factors in Computing Systems: Changing our World, 2002

2001
Optimised Virtual Keyboards with and without Alphabetical Ordering - A Novice User Study.
Proceedings of the Human-Computer Interaction INTERACT '01: IFIP TC13 International Conference on Human-Computer Interaction, 2001

Designing Feedback for an Attentive Office.
Proceedings of the Human-Computer Interaction INTERACT '01: IFIP TC13 International Conference on Human-Computer Interaction, 2001

Telepresence under Exceptional Circumstances: Enriching the Connection to School for Sick Children.
Proceedings of the Human-Computer Interaction INTERACT '01: IFIP TC13 International Conference on Human-Computer Interaction, 2001

Alphabetically biased virtual keyboards are easier to use: layout does matter.
Proceedings of the CHI 2001 Extended Abstracts on Human Factors in Computing Systems, 2001

Chinese input with keyboard and eye-tracking: an anatomical study.
Proceedings of the CHI 2001 Conference on Human Factors in Computing Systems, Seattle, WA, USA, March 31, 2001

Scale effects in steering law tasks.
Proceedings of the CHI 2001 Conference on Human Factors in Computing Systems, Seattle, WA, USA, March 31, 2001

2000
The metropolis keyboard - an exploration of quantitative techniques for virtual keyboard design.
Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, 2000

Gaze and Speech in Attentive User Interfaces.
Proceedings of the Advances in Multimodal Interfaces, 2000

Hand eye coordination patterns in target selection.
Proceedings of the Eye Tracking Research & Application Symposium, 2000

Physics-based graphical keyboard design.
Proceedings of the CHI '00 Extended Abstracts on Human Factors in Computing Systems, 2000

1999
In Search of the 'Magic Carpet': Design and Experimentation of a Bimanual 3D Navigation Interface.
J. Vis. Lang. Comput., 1999

Multistream Input: An Experimental Study of Document Scrolling Methods.
IBM Syst. J., 1999

Keeping an Eye for HCI.
Proceedings of the XII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI '99), 1999

What You Feel Must Be What You See: Adding Tactile Feedback to the Trackpoint.
Proceedings of the Human-Computer Interaction INTERACT '99: IFIP TC13 International Conference on Human-Computer Interaction, 1999

Manual and Gaze Input Cascaded (MAGIC) Pointing.
Proceedings of the Proceeding of the CHI '99 Conference on Human Factors in Computing Systems: The CHI is the Limit, 1999

Performance Evaluation of Input Devices in Trajectory-Based Tasks: An Application of the Steering Law.
Proceedings of the Proceeding of the CHI '99 Conference on Human Factors in Computing Systems: The CHI is the Limit, 1999

1998
Manual and Cognitive Benefits of Two-Handed Input: An Experimental Study.
ACM Trans. Comput. Hum. Interact., 1998

Quantifying Coordination in Multiple DOF Movement and Its Application to Evaluating 6 DOF Input Devices.
Proceedings of the Proceeding of the CHI '98 Conference on Human Factors in Computing Systems, 1998

Representation Matters: The Effect of 3D Objects and a Spatial Metaphor in a Graphical User Interface.
Proceedings of the People and Computers XIII, Proceedings of HCI '98, 1998

1997
Anisotropic human performance in six degree-of-freedom tracking: an evaluation of three-dimensional display and control interfaces.
IEEE Trans. Syst. Man Cybern. Part A, 1997

Graphical Means of Directing User's Attention in the Visual Interface.
Proceedings of the Human-Computer Interaction, 1997

Improving Browsing Performance: A study of four input devices for scrolling and pointing tasks.
Proceedings of the Human-Computer Interaction, 1997

Visual attention techniques in the graphical user interface.
Proceedings of the Human Vision and Electronic Imaging II, 1997

Dual Stream Input for Pointing and Scrolling.
Proceedings of the Human Factors in Computing Systems, 1997

An Isometric Tongue Pointing Device.
Proceedings of the Human Factors in Computing Systems, 1997

Beyond Fitts' Law: Models for Trajectory-Based HCI Tasks.
Proceedings of the Human Factors in Computing Systems, 1997

1996
The Partial-Occlusion Effect: Utilizing Semitransparency in 3D Human-Computer Interaction.
ACM Trans. Comput. Hum. Interact., 1996

The Influence of Muscle Groups on Performance of Multiple Degree-of-Freedom Input.
Proceedings of the Conference on Human Factors in Computing Systems: Common Ground, 1996

1994
Input techniques for HCI in 3D environments.
Proceedings of the Conference on Human Factors in Computing Systems, 1994

The "Silk Cursor": investigating transparency for 3D target acquisition.
Proceedings of the Conference on Human Factors in Computing Systems, 1994

The "silk cursor": investigating.
Proceedings of the Conference on Human Factors in Computing Systems, 1994

1993
Virtual Reality for Palmtop Computers.
ACM Trans. Inf. Syst., 1993

From Icons to Interface Models: Designing Hypermedia from the Bottom Up.
Int. J. Man Mach. Stud., 1993

Human Performance Evaluation of Manipulation Schemes in Virtual Environments.
Proceedings of the IEEE Virtual Reality Annual International Symposium, 1993

Applications of augmented reality for human-robot communication.
Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems, 1993

An evaluation of four 6 degree-of-freedom input techniques.
Proceedings of the Human-Computer Interaction, 1993

ARGOS: a display system for augmenting reality.
Proceedings of the Human-Computer Interaction, 1993


  Loading...