Yang Li

Orcid: 0000-0001-7808-5524

Affiliations:
  • Google Research, Mountain View, CA, USA


According to our database1, Yang Li authored at least 99 papers between 2000 and 2024.

Collaborative distances:
  • Dijkstra number2 of four.
  • Erdős number3 of four.

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
Evaluating the effects of user motion and viewing mode on target selection in augmented reality.
Int. J. Hum. Comput. Stud., 2024

UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset.
CoRR, 2024

Revision Matters: Generative Design Guided by Revision Edits.
CoRR, 2024

CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion.
CoRR, 2024

UICrit: Enhancing Automated Design Evaluation with a UI Critique Dataset.
Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, 2024

MUG: Interactive Multimodal Grounding on User Interfaces.
Proceedings of the Findings of the Association for Computational Linguistics: EACL 2024, 2024


Automatic Macro Mining from Interaction Traces at Scale.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024

Generating Automatic Feedback on UI Mockups with Large Language Models.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024

2023
Improving Workflow Integration with xPath: Design and Evaluation of a Human-AI Diagnosis System in Pathology.
ACM Trans. Comput. Hum. Interact., April, 2023

PaLI-X: On Scaling up a Multilingual Vision and Language Model.
CoRR, 2023

PLay: Parametrically Conditioned Layout Generation using Latent Diffusion.
Proceedings of the International Conference on Machine Learning, 2023

Spotlight: Mobile UI Understanding using Vision-Language Models with a Focus.
Proceedings of the Eleventh International Conference on Learning Representations, 2023

A Zero-Shot Language Agent for Computer Control with Structured Reflection.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Enabling Conversational Interaction with Mobile UI using Large Language Models.
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

2022
Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scale.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

Computational Approaches for Understanding, Generating, and Adapting User Interfaces.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

2021
VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling.
CoRR, 2021

Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models.
CoRR, 2021

HelpViz: Automatic Generation of Contextual Visual MobileTutorials from Text-Based Instructions.
CoRR, 2021

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning.
Proceedings of the UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology, 2021

HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions.
Proceedings of the UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology, 2021

Large-Scale Modeling of Mobile User Click Behaviors Using Deep Learning.
Proceedings of the RecSys '21: Fifteenth ACM Conference on Recommender Systems, Amsterdam, The Netherlands, 27 September 2021, 2021

Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding.
Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

TapNet: The Design, Training, Implementation, and Applications of a Multi-Task Learning CNN for Off-Screen Mobile Input.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

Spacewalker: Rapid UI Design Exploration Using Lightweight Markup Enhancement and Crowd Genetic Programming.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

2020
Deep Learning Methods for Lung Cancer Segmentation in Whole-slide Histopathology Images - the ACDC@LungHP Challenge 2019.
CoRR, 2020

Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders.
CoRR, 2020

Multi-Stage Influence Function.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements.
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Personalized Flight Itinerary Ranking at Fliggy.
Proceedings of the CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, 2020

Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods.
Proceedings of the CHI '20: CHI Conference on Human Factors in Computing Systems, 2020

Artificial Intelligence for HCI: A Modern Approach.
Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020

Mapping Natural Language Instructions to Mobile UI Action Sequences.
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019
Influence of multi-modality on moving target selection in virtual reality.
Virtual Real. Intell. Hardw., 2019

Gesture interaction in virtual reality.
Virtual Real. Intell. Hardw., 2019

A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning.
CoRR, 2019

Minuet: Multimodal Interaction with an Internet of Things.
Proceedings of the Symposium on Spatial User Interaction, 2019

A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning.
Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Robustness Verification of Tree-based Models.
Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks.
Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019

Area Attention.
Proceedings of the 36th International Conference on Machine Learning, 2019

Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks.
Proceedings of the 7th International Conference on Learning Representations, 2019

You Look Twice: GaterNet for Dynamic Filter Selection in CNNs.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning.
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

2018
What is That in Your Hand?: Recognizing Grasped Objects via Forearm Electromyography Sensing.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2018

GaterNet: Dynamic Filter Selection in Convolutional Neural Network via a Dedicated Global Gating Network.
CoRR, 2018

Nonlinear Online Learning with Adaptive Nyström Approximation.
CoRR, 2018

GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking.
Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Time-Dependent Representation for Neural Event Sequence Prediction.
Proceedings of the 6th International Conference on Learning Representations, 2018

M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

Analysis and Modeling of Grid Performance on Touchscreen Mobile Devices.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

Predicting Human Performance in Vertical Menu Selection Using Deep Learning.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

Doppio: Tracking UI Flows and Code Changes for App Development.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World.
Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, 2018

2017
Improv: An Input Framework for Improvising Cross-Device Interaction by Demonstration.
ACM Trans. Comput. Hum. Interact., 2017

ZIPT: Zero-Integration Performance Testing of Mobile App Designs.
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017

Rico: A Mobile App Dataset for Building Data-Driven Design Applications.
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017

2016
Beyond the Touchscreen: An Exploration of Extending Interactions on Commodity Smartphones.
ACM Trans. Interact. Intell. Syst., 2016

Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices.
ACM Trans. Appl. Percept., 2016

Bootstrapping User-Defined Body Tapping Recognition with Offline-Learned Probabilistic Representation.
Proceedings of the 29th Annual Symposium on User Interface Software and Technology, 2016

Gesture morpher: video-based retargeting of multi-touch interactions.
Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, 2016

Mogeste: mobile tool for in-situ motion gesture design.
Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2016 ACM International Symposium on Wearable Computers, 2016

End-user development of cross-device user interfaces.
Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 2016

Enhancing Cross-Device Interaction Scripting with Interactive Illustrations.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

The Making of Cross-Device Experiences: A Hands-on Workshop.
Proceedings of the Companion Publication of the 2014 ACM Conference on Designing Interactive Systems, DIS '16, Brisbane, QLD, Australia, June 04, 2016

2015
Emotional Tone-Based Audio Continuous Emotion Recognition.
Proceedings of the MultiMedia Modeling - 21st International Conference, 2015

3D model-based continuous emotion recognition.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015

Gesture On: Enabling Always-On Touch Gestures for Fast Mobile Access from the Device Standby Mode.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015

Weave: Scripting Cross-Device Wearable Interaction.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015

2014
Optimistic Programming of Touch Interaction.
ACM Trans. Comput. Hum. Interact., 2014

Detecting tapping motion on the side of mobile devices by probabilistically combining hand postures.
Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, 2014

Reflection: enabling event prediction as an on-device service for mobile interaction.
Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, 2014

HOBS: head orientation-based selection in physical spaces.
Proceedings of the 2nd ACM Symposium on Spatial User Interaction, 2014

Hierarchical route maps for efficient navigation.
Proceedings of the 19th International Conference on Intelligent User Interfaces, 2014

Teaching motion gestures via recognizer feedback.
Proceedings of the 19th International Conference on Intelligent User Interfaces, 2014

GestKeyboard: enabling gesture-based interaction on ordinary physical keyboard.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

InkAnchor: enhancing informal ink-based note taking on touchscreen mobile phones.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

Gesture script: recognizing gestures and their structure using rendering scripts and interactively trained parts.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

Gesturemote: interacting with remote displays through touch gestures.
Proceedings of the International Working Conference on Advanced Visual Interfaces, 2014

2013
Open project: a lightweight framework for remote sharing of mobile applications.
Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, 2013

CrowdLearner: rapidly creating mobile recognizers using crowdsourcing.
Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, 2013

Gesture studio: authoring multi-touch interactions through demonstration and declaration.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

FFitts law: modeling finger touch with fitts' law.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

2012
Gesture Search: Random Access to Smartphone Content.
IEEE Pervasive Comput., 2012

Bootstrapping personal gesture shortcuts with the wisdom of the crowd and handwriting recognition.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012

Gesture coder: a tool for programming multi-touch gestures by demonstration.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012

Tap, swipe, or move: attentional demands for distracted smartphone input.
Proceedings of the International Working Conference on Advanced Visual Interfaces, 2012

Gesture-based interaction: a new dimension for mobile user interfaces.
Proceedings of the International Working Conference on Advanced Visual Interfaces, 2012

2011
User-defined motion gestures for mobile interaction.
Proceedings of the International Conference on Human Factors in Computing Systems, 2011

DoubleFlip: a motion gesture delimiter for mobile interaction.
Proceedings of the International Conference on Human Factors in Computing Systems, 2011

Gesture avatar: a technique for operating mobile user interfaces using gestures.
Proceedings of the International Conference on Human Factors in Computing Systems, 2011

Deep shot: a framework for migrating tasks across devices using mobile phone cameras.
Proceedings of the International Conference on Human Factors in Computing Systems, 2011

Experimental analysis of touch-screen gesture designs in mobile environments.
Proceedings of the International Conference on Human Factors in Computing Systems, 2011

2010
Gesture search: a tool for fast mobile data access.
Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, 2010

Protractor: a fast and accurate gesture recognizer.
Proceedings of the 28th International Conference on Human Factors in Computing Systems, 2010

2009
Beyond Pinch and Flick: Enriching Mobile Gesture Interaction.
Computer, 2009

2000
A Comparison on Free Interaction Models for Mobile Layout System.
Proceedings of the Handheld and Ubiquitous Computing, Second International Symposium, 2000


  Loading...