Jeffrey Nichols

Orcid: 0000-0002-6880-8546

Affiliations:
  • Apple
  • Google (former)


According to our database1, Jeffrey Nichols authored at least 109 papers between 2001 and 2024.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating UI Operation Impacts.
CoRR, 2024

Misty: UI Prototyping Through Interactive Conceptual Blending.
CoRR, 2024

Automated Code Fix Suggestions for Accessibility Issues in Mobile Apps.
CoRR, 2024

Keyframer: Empowering Animation Design using Large Language Models.
CoRR, 2024

BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks.
Proceedings of the 2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2024

UIClip: A Data-driven Model for Assessing User Interface Design.
Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, 2024

UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback.
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs.
Proceedings of the Computer Vision - ECCV 2024, 2024

AXNav: Replaying Accessibility Tests from Natural Language.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024

Computational Methodologies for Understanding, Automating, and Evaluating User Interfaces.
Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, 2024

2023
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations.
CoRR, 2023

Towards Automated Accessibility Report Generation for Mobile Apps.
CoRR, 2023

Screen Correspondence: Mapping Interchangeable Elements between UIs.
CoRR, 2023

Never-ending Learning of User Interfaces.
Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023

WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics.
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

The Future of Computational Approaches for Understanding and Adapting User Interfaces.
Proceedings of the Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

2022
Alert Now or Never: Understanding and Predicting Notification Preferences of Smartphone Users.
ACM Trans. Comput. Hum. Interact., 2022

Reflow: Automatically Improving Touch Interactions in Mobile Applications through Pixel-based Refinements.
CoRR, 2022

Extracting Replayable Interactions from Videos of Mobile App Usage.
CoRR, 2022

Understanding Screen Relationships from Screenshots of Smartphone Applications.
Proceedings of the IUI 2022: 27th International Conference on Intelligent User Interfaces, Helsinki, Finland, March 22, 2022

Towards Complete Icon Labeling in Mobile Applications.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

Computational Approaches for Understanding, Generating, and Adapting User Interfaces.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

2021
Sketch-based Creativity Support Tools using Deep Learning.
CoRR, 2021

Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots.
Proceedings of the UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology, 2021

Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

2020
AI4AUI: Workshop on AI Methods for Adaptive User Interfaces.
Proceedings of the IUI '20: 25th International Conference on Intelligent User Interfaces, 2020

Designing and Evaluating Head-based Pointing on Smartphones for People with Motor Impairments.
Proceedings of the ASSETS '20: The 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020

2019
Swire: Sketch-based User Interface Retrieval.
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

2018
Welcome Letter.
Proc. ACM Hum. Comput. Interact., 2018

A Computational Method for Evaluating UI Patterns.
CoRR, 2018

Towards Malware Detection via CPU Power Consumption: Data Collection Design and Analytics (Extended Version).
CoRR, 2018

Towards Malware Detection via CPU Power Consumption: Data Collection Design and Analytics.
Proceedings of the 17th IEEE International Conference On Trust, 2018

2017
Editorial: End-User Development for the Internet of Things.
ACM Trans. Comput. Hum. Interact., 2017

Welcome to the First Issue of PACMHCI EICS.
Proc. ACM Hum. Comput. Interact., 2017

GOAALLL!: Using sentiment in the world cup to explore theories of emotion.
Image Vis. Comput., 2017

ZIPT: Zero-Integration Performance Testing of Mobile App Designs.
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017

Rico: A Mobile App Dataset for Building Data-Driven Design Applications.
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017

Towards a Cyber Defense Framework for SCADA Systems Based on Power Consumption Monitoring.
Proceedings of the 50th Hawaii International Conference on System Sciences, 2017

The Moving Context Kit: Designing for Context Shifts in Multi-Device Experiences.
Proceedings of the 2017 Conference on Designing Interactive Systems, 2017

2016
ACM IUI 2016 conference highlights.
AI Matters, 2016

End-user development of cross-device user interfaces.
Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 2016

Exploring Engagement in a 'Social Crowd' on Twitter.
Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing, 2016

The Making of Cross-Device Experiences: A Hands-on Workshop.
Proceedings of the Companion Publication of the 2014 ACM Conference on Designing Interactive Systems, DIS '16, Brisbane, QLD, Australia, June 04, 2016

Understanding the Challenges of Designing and Developing Multi-Device Experiences.
Proceedings of the 2016 ACM Conference on Designing Interactive Systems, DIS '16, Brisbane, QLD, Australia, June 04, 2016

2015
Who Will Retweet This? Detecting Strangers from Twitter to Retweet Information.
ACM Trans. Intell. Syst. Technol., 2015

Systems and tools for cross-device user interfaces.
Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 2015

InkWell: A Creative Writer's Creative Assistant.
Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition, 2015

2014
Home Location Identification of Twitter Users.
ACM Trans. Intell. Syst. Technol., 2014

Optimizing The Selection of Strangers To Answer Questions in Social Media.
CoRR, 2014

Why Are You More Engaged? Predicting Social Engagement from Word Use.
CoRR, 2014

System U: automatically deriving personality traits from social media for people recommendation.
Proceedings of the Eighth ACM Conference on Recommender Systems, 2014

Who will retweet this?: Automatically Identifying and Engaging Strangers on Twitter to Spread Information.
Proceedings of the 19th International Conference on Intelligent User Interfaces, 2014

Modeling User Attitude toward Controversial Topics in Online Social Media.
Proceedings of the Eighth International Conference on Weblogs and Social Media, 2014

Understanding individuals' personal values from social media word use.
Proceedings of the Computer Supported Cooperative Work, 2014

DUBMOD14 - International Workshop on Data-driven User Behavioral Modeling and Mining from Social Media.
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, 2014

Opportunities and risks of discovering personality traits from social media.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

Social media participation and performance at work: a longitudinal study.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

You read what you value: understanding personal values and reading interests.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

2013
LiveAction: Automating Web Task Model Generation.
ACM Trans. Interact. Intell. Syst., 2013

Chorus: a crowd-powered conversational assistant.
Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, 2013

Recommending targeted strangers from whom to solicit information on social media.
Proceedings of the 18th International Conference on Intelligent User Interfaces, 2013

When Will You Answer This? Estimating Response Time in Twitter.
Proceedings of the Seventh International Conference on Weblogs and Social Media, 2013

CrowdE: Filtering Tweets for Direct Customer Engagements.
Proceedings of the Seventh International Conference on Weblogs and Social Media, 2013

Using the crowd to understand and adapt user interfaces.
Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 2013

Using public social media to find answers to questions.
Proceedings of the 2013 International Conference on Collaboration Technologies and Systems, 2013

Analyzing the quality of information solicited from targeted strangers on social media.
Proceedings of the Computer Supported Cooperative Work, 2013

Question routing to user communities.
Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, 2013

DUBMOD13: international workshop on data-driven user behavioral modelling and mining from social media.
Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, 2013

The role of engineering work in CHI.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

2012
Summarizing sporting events using twitter.
Proceedings of the 17th International Conference on Intelligent User Interfaces, 2012

1st international workshop on user modeling from social media.
Proceedings of the 17th International Conference on Intelligent User Interfaces, 2012

Where Is This Tweet From? Inferring Home Locations of Twitter Users.
Proceedings of the Sixth International Conference on Weblogs and Social Media, 2012

Asking questions of targeted strangers on social networks.
Proceedings of the CSCW '12 Computer Supported Cooperative Work, 2012

Come meet me at Ulduar: progression raiding in world of warcraft.
Proceedings of the CSCW '12 Computer Supported Cooperative Work, 2012

DUBMMSM'12: international workshop on data-driven user behavioral modeling and mining from social media.
Proceedings of the 21st ACM International Conference on Information and Knowledge Management, 2012

RepliCHI SIG: from a panel to a new submission venue for replication.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012

Invited engineering community SIG: the role of engineering work in CHI.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012

2011
Playbook: Revision Control and Comparison for Interactive Mockups.
Proceedings of the End-User Development - Third International Symposium, 2011

2010
A conversational interface to web automation.
Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, 2010

Here's what i did: sharing and reusing web activity with ActionShot.
Proceedings of the 28th International Conference on Human Factors in Computing Systems, 2010

2009
Creating a lightweight user interface description language: An overview and analysis of the personal universal controller project.
ACM Trans. Comput. Hum. Interact., 2009

Mining web interactions to automatically create mash-ups.
Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, 2009

End-user programming of mashups with vegemite.
Proceedings of the 14th International Conference on Intelligent User Interfaces, 2009

Trailblazer: enabling blind users to blaze trails through the web.
Proceedings of the 14th International Conference on Intelligent User Interfaces, 2009

Interpreting Written How-To Instructions.
Proceedings of the IJCAI 2009, 2009

PlayByPlay: collaborative web browsing for desktop and mobile devices.
Proceedings of the 27th International Conference on Human Factors in Computing Systems, 2009

Workshop on end user programming for the web.
Proceedings of the 27th International Conference on Human Factors in Computing Systems, 2009

2008
An infrastructure for extending applications' user experiences across multiple personal devices.
Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, 2008

Highlight: a system for creating and deploying mobile web applications.
Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, 2008

Mobilization by demonstration: using traces to re-author existing web sites.
Proceedings of the 13th International Conference on Intelligent User Interfaces, 2008

2007
Demonstrating the viability of automatically generated user interfaces.
Proceedings of the 2007 Conference on Human Factors in Computing Systems, 2007

2006
Controlling Home and Office Appliances with Smart Phones.
IEEE Pervasive Comput., 2006

Huddle: automatically generating interfaces for systems of multiple connected appliances.
Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, 2006

The many faces of consistency in cross-platform design.
Proceedings of the Extended Abstracts Proceedings of the 2006 Conference on Human Factors in Computing Systems, 2006

UNIFORM: automatically generating consistent remote control user interfaces.
Proceedings of the 2006 Conference on Human Factors in Computing Systems, 2006

2004
Taking Handheld Devices to the Next Level.
Computer, 2004

Improving automatic interface generation with smart templates.
Proceedings of the 9th International Conference on Intelligent User Interfaces, 2004

2003
Studying the Use of Handhelds to Control Smart Appliances.
Proceedings of the 23rd International Conference on Distributed Computing Systems Workshops (ICDCS 2003 Workshops), 2003

Personal universal controllers: controlling complex appliances with GUIs and speech.
Proceedings of the Extended abstracts of the 2003 Conference on Human Factors in Computing Systems, 2003

2002
Generating remote control interfaces for complex appliances.
Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology, 2002

Requirements for Automatically Generating Multi-Modal Interfaces for Complex Appliances.
Proceedings of the 4th IEEE International Conference on Multimodal Interfaces (ICMI 2002), 2002

Flexi-Modal and Multi-Machine User Interfaces.
Proceedings of the 4th IEEE International Conference on Multimodal Interfaces (ICMI 2002), 2002

Informing automatic generation of remote control interfaces with human designs.
Proceedings of the Extended abstracts of the 2002 Conference on Human Factors in Computing Systems, 2002

Interacting at a distance: measuring the performance of laser pointers and other devices.
Proceedings of the CHI 2002 Conference on Human Factors in Computing Systems: Changing our World, 2002

Using handhelds to help people with motor impairments.
Proceedings of the ACM Conference on Assistive Technologies, 2002

Mediator and medium: doors as interruption gateways and aesthetic displays.
Proceedings of the 4th Conference on Designing Interactive Systems: Processes, 2002

2001
Scwm: An Extensible Constraint-Enabled Window Manager.
Proceedings of the FREENIX Track: 2001 USENIX Annual Technical Conference, 2001

Interacting at a Distance Using Semantic Snarfing.
Proceedings of the Ubicomp 2001: Ubiquitous Computing, 2001

Using handhelds as controls for everyday appliances: a paper prototype study.
Proceedings of the CHI 2001 Extended Abstracts on Human Factors in Computing Systems, 2001


  Loading...