Ben Lafreniere, Ph.D.
- ben [dot] lafreniere [at] gmail [dot] com
- benlafreniere.ca
- github.com/lafrenben
- linkedin.com/in/lafrenben
Research Interests
Broadly, my research focuses on designing and prototyping interactive systems to investigate how emerging technologies expand the boundaries of human-computer interaction.
Recently, my work has centered on Human-AI interaction and the design of intelligent user interfaces. I have also conducted research on gesture-based interaction, and interactive help and learning techniques for feature-rich software.
I believe strongly in a human-centered design approach to developing new technologies, where the work is continuously grounded in the needs and requirements of users.
Employment
-
Research Scientist, Reality Labs Research, Meta
-
Research Scientist and Co-Founder, Chatham Labs
-
Distinguished Research Scientist, Autodesk Research
-
Postdoctoral Researcher, Interaction Lab, University of Saskatchewan
-
Lead Developer, Places4Students Inc.
Education
-
Ph.D. in Computer Science, University of Waterloo
Advisor: Michael Terry
Thesis: Task-Centric User Interfaces -
M.Math. in Computer Science, University of Waterloo
Advisor: Anna Lubiw
Thesis: Packing Unit Disks -
B.Sc. Honours Computer Science (Software Engineering Option), University of Windsor
Minors: Mathematics, Philosophy
Publications
Journal articles (fully reviewed, archival)
-
Gaze as an Indicator of Input Recognition Errors. 2022. Candace E. Peacock, Ben Lafreniere, Ting Zhang, Stephanie Santosa, Hrvoje Benko, Tanya R. Jonker. Proceedings of the ACM on Human-Computer Interaction [38% AR]
-
Investigating Cross-Modal Approaches for Evaluating Error Acceptability of a Recognition-Based Input Technique. 2022. Jay Henderson, Tanya R. Jonker, Edward Lank, Daniel Wigdor, Ben Lafreniere. Proceedings of the ACM on Interactive, Mobile, Wearable, and Ubiquitous Technologies
-
Investigating the Post-Training Persistence of Expert Interaction Techniques. 2017. Ben Lafreniere, Carl Gutwin, Andy Cockburn. ACM Transactions on Computer-Human Interaction
-
A Lower Bound on the Area of a 3-Coloured Disk Packing. 2010. Peter Brass, Ferran Hurtado, Benjamin Lafreniere, and Anna Lubiw. International Journal of Computational Geometry and Applications (IJCGA)
-
Time and Space Adaptation for Computational Grids with the ATOP-Grid Middleware. 2008. Angela C. Sodan, Garima Gupta, Lin Han, Lun Liu, and Ben Lafreniere. Journal of Future Generation Computer Systems
-
On the All-Farthest-Segments problem for a planar set of points. 2006. Asish Mukhopadhyay, Samidh Chatterjee, and Ben Lafreniere. Information Processing Letters
Conference papers (fully reviewed, archival)
-
Authoring LLM-Based Assistance for Real-World Contexts and Tasks. 2025. Hai Dang, Michelle Li, Tovi Grossman, Kashyap Todi, Ben Lafreniere. ACM International Conference on Intelligent User Interfaces (to appear)
-
MR-Driven Near-Future Realities: Previewing Everyday Life Real-World Experiences Using Mixed Reality. 2024. Florian Mathis, Brad A. Myers, Ben Lafreniere, Michael Glueck, David P. S. Marques. ACM International Conference on Multimodal Interaction [38% AR]
-
Body Language for VUIs: Exploring Gestures to Enhance Interactions with Voice User Interfaces. 2024. Liwei Wu, Ben Lafreniere, Tovi Grossman, Thomas White, Stephanie Santosa. ACM Designing Interactive Systems Conference [27% AR]
-
Interactive Mediation Techniques for Error-Aware Gesture Input Systems. 2024. Rawan Alghofaili, Naveen Sendhilnathan, Ting Zhang, Tovi Grossman, Michael Glueck, Tanya R. Jonker, Ben Lafreniere. Graphics Interface [41% AR]
-
Exploring Visualizations for Precisely Guiding Bare Hand Gestures in Virtual Reality. 2024. Xizi Wang, Ben Lafreniere, Jian Zhao. ACM CHI Conference on Human Factors in Computing Systems [26% AR]
-
FrameKit: A Tool for Authoring Adaptive UIs Using Keyframes. 2024. Jason Wu, Kashyap Todi, Joannes Chan, Brad A. Myers, Ben Lafreniere. ACM International Conference on Intelligent User Interfaces [24% AR]Best paper award (top 2 papers)
-
XR Input Error Mediation for Hand-Based Input: Task and Context Influences a User's Preference. 2023. Tica Lin, Ben Lafreniere, Yan Xu, Tovi Grossman, Daniel Wigdor, Michael Glueck. IEEE International Symposium on Mixed and Augmented Reality [28% AR]
-
Detecting Input Recognition Errors and User Errors Using Gaze Dynamics in Virtual Reality. 2022. Naveen Sendhilnathan, Ting Zhang, Ben Lafreniere, Tovi Grossman, Tanya R. Jonker. ACM Symposium on User Interface Software and Technology [26% AR]
-
TwoTorials: A Remote Cooperative Tutorial System for 3D Design Software. 2022. Sultan A. Alharthi, Ben Lafreniere, Tovi Grossman, George Fitzmaurice. Graphics Interface
-
False Positives vs. False Negatives: The Effects of Recovery Time and Cognitive Costs on Input Error Preference. 2021. Ben Lafreniere, Tanya R. Jonker, Stephanie Santosa, Mark Parent, Michael Glueck, Tovi Grossman, Hrvoje Benko, Daniel Wigdor. ACM Symposium on User Interface Software and Technology [26% AR]
-
PatchProv: Supporting Improvisational Design Practices for Modern Quilting. 2021. Mackenzie Leake, Frances Lai, Tovi Grossman, Daniel Wigdor, Ben Lafreniere. ACM CHI Conference on Human Factors in Computing Systems [26% AR]
-
Workflow Graphs: A Computational Model of Collective Task Strategies for 3D Design Software. 2020. Minsuk Chang, Ben Lafreniere, Juho Kim, George Fitzmaurice, Tovi Grossman. Graphics Interface [52% AR]
-
DreamRooms: Prototyping Rooms in Collaboration with a Generative Process. 2019. Ariel Weingarten, Ben Lafreniere, George Fitzmaurice, Tovi Grossman. Graphics Interface [52% AR]
-
Blocks-to-CAD: A Cross-Application Bridge from Minecraft to 3D Modeling. 2018. Ben Lafreniere, Tovi Grossman. ACM Symposium on User Interface Software and Technology [21% AR]
-
Maestro: Designing a System for Real-Time Orchestration of 3D Modeling Workshops. 2018. Volodymyr Dziubak, Ben Lafreniere, Tovi Grossman, Andrea Bunt, George Fitzmaurice. ACM Symposium on User Interface Software and Technology [21% AR]
-
ElectroTutor: Test-Driven Physical Computing Tutorials. 2018. Jeremy Warner, Ben Lafreniere, George Fitzmaurice, Tovi Grossman. ACM Symposium on User Interface Software and Technology [21% AR]
-
Investigating How Online Help and Learning Resources Support Children's Use of 3D Design Software. 2018. Nathaniel Hudson, Ben Lafreniere, Parmit Chilana, Tovi Grossman. ACM CHI Conference on Human Factors in Computing Systems [26% AR]
-
Leveraging Community-Generated Videos and Command Logs to Classify and Recommend Software Workflows. 2018. Xu Wang, Ben Lafreniere, Tovi Grossman. ACM CHI Conference on Human Factors in Computing Systems [26% AR]
-
No Need to Stop What You're Doing: Exploring No-Handed Smartwatch Interaction. 2017. Seongkook Heo, Michelle Annett, Ben Lafreniere, Tovi Grossman, George Fitzmaurice. Graphics Interface [50% AR]
-
Crowdsourced Fabrication. 2016. Ben Lafreniere, Tovi Grossman, Fraser Anderson, Justin Matejka, Heather Kerrick, Danil Nagy, Lauren Vasey, Evan Atherton, Nicholas Beirne, Marcelo Coelho, Nicholas Cote, Steven Li, Andy Nogueira, Long Nguyen, Tobias Schwinn, James Stoddart, David Thomasson, Ray Wang, Thomas White, David Benjamin, Maurice Conti, Achim Menges, George Fitzmaurice. ACM Symposium on User Interface Software and Technology [21% AR]
-
Faster Command Selection on Touchscreen Watches. 2016. Ben Lafreniere, Carl Gutwin, Andy Cockburn, Tovi Grossman. ACM CHI Conference on Human Factors in Computing Systems [23% AR]
-
Peak-End Effects on Player Experience in Casual Games. 2016. Carl Gutwin, Christianne Rooke, Andy Cockburn, Regan Mandryk, Ben Lafreniere. ACM CHI Conference on Human Factors in Computing Systems [23% AR]Best of CHI honorable mention (top 5%)
-
HandMark Menus: Rapid Command Selection and Large Command Sets on Multi-Touch Displays. 2016. Md. Sami Uddin, Carl Gutwin, Ben Lafreniere. ACM CHI Conference on Human Factors in Computing Systems [23% AR]
-
These Aren't the Commands You're Looking For: Addressing False Feedforward in Feature-Rich Software. 2015. Ben Lafreniere, Parmit Chilana, Adam Fourney, Michael Terry. ACM Symposium on User Interface Software and Technology [24% AR]
-
Testing the Rehearsal Hypothesis with Two FastTap Interfaces. 2015. Carl Gutwin, Andy Cockburn, Ben Lafreniere. Graphics Interface [38% AR]
-
CheatSheet: A Contextual Interactive Memory Aid for Web Applications. 2015. Layton Vermette, Parmit Chilana, Michael Terry, Adam Fourney, Ben Lafreniere, Travis Kerr. Graphics Interface [38% AR]
-
Task-Centric Interfaces for Feature-Rich Software. 2014. Ben Lafreniere, Andrea Bunt, and Michael Terry. Annual Conference of the Australian Computer-Human Interaction Special Interest Group (CHISIG) [48% AR]
-
Investigating the Feasibility of Extracting Tool Demonstrations from In-Situ Video Content. 2014. Ben Lafreniere, Tovi Grossman, Justin Matejka, and George Fitzmaurice. ACM CHI Conference on Human Factors in Computing Systems [23% AR]Best of CHI honorable mention (top 5%)
-
TaggedComments: Promoting and Integrating User Comments in Online Application Tutorials. 2014. Andrea Bunt, Patrick Dubois, Ben Lafreniere, Michael Terry, and David Cormack. ACM CHI Conference on Human Factors in Computing Systems [23% AR]
-
Understanding the Roles and Uses of Web Tutorials. 2013. Ben Lafreniere, Andrea Bunt, Matthew Lount, and Michael Terry. International AAAI Conference on Weblogs and Social Media [21% AR]
-
Community Enhanced Tutorials: Improving Tutorials with Multiple Demonstrations. 2013. Ben Lafreniere, Tovi Grossman, and George Fitzmaurice. ACM CHI Conference on Human Factors in Computing Systems [20% AR]
-
“Then Click OK!” Extracting References to Interface Elements in Online Documentation. 2012. Adam Fourney, Ben Lafreniere, Richard Mann, and Michael Terry. ACM CHI Conference on Human Factors in Computing Systems [24% AR]
-
Characterizing Large-Scale Use of a Direct Manipulation Application in the Wild. 2010. Ben Lafreniere, Andrea Bunt, John Whissell, Charles Clarke, and Michael Terry. Graphics Interface [41% AR]
-
Perceptions and Practices of Usability in the Free/Open Source Software (FOSS) Community. 2010. Michael Terry, Matthew Kay, and Ben Lafreniere. ACM CHI Conference on Human Factors in Computing Systems [22% AR]
Extended abstracts & workshop papers (lightly reviewed)
-
AdaptableGIMP: Designing a Socially-Adaptable Interface. 2011. Ben Lafreniere, Andrea Bunt, Matthew Lount, Filip Krynicki, and Michael Terry. ACM Symposium on User Interface Software and Technology
-
ScoPred – Scalable User-Directed Performance Prediction Using Complexity Modeling and Historical Data. 2005. Benjamin J. Lafreniere and Angela C. Sodan. 11th Workshop on Job Scheduling Strategies for Parallel Processing
Theses
-
Task-Centric User Interfaces. 2014. Benjamin J. Lafreniere. PhD dissertation, University of Waterloo
-
Packing Unit Disks. 2008. Benjamin J. Lafreniere. Master's thesis, University of Waterloo
Patents
-
Goal-driven human-machine interaction architecture, and systems and methods of use thereof (WO-2024227132-A1). Benjamin Lafreniere, Peiqi Tang, Kashyap TODI, Tanya Renee Jonker, David Owen Driver. Filed 2024-04-29.
-
Systems and methods for using natural gaze dynamics to detect input recognition errors (WO-2023028171-A1). Hrvoje Benko, Ting Zhang, Tanya Renee Jonker, Candace Peacock, Benjamin Lafreniere, Rawan ALGHOFAILI, Michael Glueck. Filed 2022-08-24.
-
Systems and methods for using natural gaze dynamics to detect input recognition errors (US-2023069764-A1). Tanya Renee Jonker, Candace Peacock, Benjamin LAFRENIERE, Ting Zhang, Hrvoje Benko, Rawan Alghofaili, Michael Glueck. Filed 2022-07-15.
-
Systems and methods for adaptive input thresholding (US-11579704-B2). Benjamin LAFRENIERE, Tanya Renee Jonker, Stephanie Santosa, Hrvoje Benko, Daniel John Wigdor. Filed 2021-03-24. Granted 2023-02-14.
-
Techniques for workflow analysis and design task optimization (US-11586464-B2). Tovi Grossman, George Fitzmaurice, Benjamin LAFRENIERE, Juho Kim, Minsuk CHANG, Kaveh HASSANI. Filed 2019-12-05. Granted 2023-02-21.
-
Techniques for analyzing the proficiency of users of software applications (WO-2020086596-A3). Tovi Grossman, Alexandra R. BERGIN, Benjamin Lafreniere, Michael Sturtz, Jaime A. PERKINS, Adam L. MENTER, Howard R. SWEARER, George Fitzmaurice, Justin Frank Matejka, Ji In Shin, William SABRAM, Michael L. Mcmanus. Filed 2019-10-22.
-
Computer-aided techniques for iteratively generating designs (US-2020242201-A1). Benjamin LAFRENIERE, Tovi Grossman, Ariel WEINGARTEN, George Fitzmaurice. Filed 2019-01-24.
-
Techniques for classifying and recommending software workflows (US-11823015-B2). Tovi Grossman, Benjamin LAFRENIERE, Xu Wang. Filed 2019-01-14. Granted 2023-11-21.
-
Real-time orchestration for software learning workshops (US-2019213912-A1). Tovi Grossman, Benjamin LAFRENIERE, George Fitzmaurice, Volodymyr DZIUBAK, Andrea BUNT. Filed 2019-01-04.
-
Cross-application interface that facilitates software application training (US-2019213911-A1). Benjamin LAFRENIERE, Tovi Grossman. Filed 2018-10-10.
-
Tutorial-based techniques for building computing systems (US-2020043363-A1). Tovi Grossman, Jeremy WARNER, George Fitzmaurice, Benjamin LAFRENIERE. Filed 2018-07-31.
-
Techniques for transitioning from a first navigation scheme to a second navigation scheme (US-2019050134-A1). Tovi Grossman, Benjamin LAFRENIERE. Filed 2017-08-11.
-
Techniques for transitioning from a first navigation scheme to a second navigation scheme (US-11474660-B2). Tovi Grossman, Benjamin LAFRENIERE. Filed 2017-08-11. Granted 2022-10-18.
-
No-handed smartwatch interaction techniques (US-2018024642-A1). Seongkook Heo, George Fitzmaurice, Benjamin LAFRENIERE, Tovi Grossman. Filed 2017-07-14.
-
Automated supervision of construction operations in an intelligent workspace (US-2017148116-A1). Tovi Grossman, George Fitzmaurice, Anderson Nogueira, Nick Beirne, Justin Frank Matejka, Danil Nagy, Steven Li, Benjamin LAFRENIERE, Heather Kerrick, Thomas White, Fraser ANDERSON, Evan Atherton, David Thomasson, Arthur Harsuvanakit, Maurice Ugo Conti. Filed 2016-11-22.
-
Extracting demonstrations from in-situ video content (US-2015160836-A1). Benjamin LAFRENIERE, Tovi Grossman, Justin Frank Matejka, George Fitzmaurice. Filed 2014-12-04.
-
Community enhanced tutorials: improving tutorials with multiple demonstrations (US-9665234-B2). Benjamin LAFRENIERE, Tovi Grossman, George Fitzmaurice. Filed 2013-04-16. Granted 2017-05-30.
Research Interns (PhD Students)
-
Liwei (Alan) Wu, University of Waterloo. Internship Co-Supervisor.
[ C32 ] -
Hai Dang, University of Bayreuth. Internship Primary Supervisor.
Now Co-founder / CTO of Mercura (AI startup).
[ C34 ] -
Dishita Turakhia, Massachusetts Institute of Technology. Internship Primary Supervisor.
Now Faculty at NYU Tandon School of Engineering.
-
Jason Wu, Carnegie Mellon University. Internship Primary Supervisor.
Now Research Scientist at Apple.
[ C29 ] -
Fred Callaway, Princeton University. Internship Primary Supervisor.
Now Postdoctoral Researcher with NYU and Harvard.
-
Rawan Alghofaili, George Mason University. Internship Primary Supervisor.
Now Assistant Professor, University of Texas at Dallas.
[ C31 ] -
Mackenzie Leake, Stanford University. Internship Primary Supervisor.
Now Research Scientist at Adobe.
[ C24 ] -
Jay Henderson, University of Waterloo. Internship Primary Supervisor.
Now Assistant Professor, Memorial University of Newfoundland.
[ J5 ] -
Minsuk Chang, KAIST. Internship Primary Supervisor.
Now Research Scientist at Google Deepmind.
[ C23 ] -
Sultan A. Alharthi, University of New Mexico. Internship Primary Supervisor.
Now Assistant Professor, University of Jeddah.
[ C26 ] -
Ariel Weingarten, University of California, San Diego. Internship Primary Supervisor.
[ C22 ] -
Jeremy Warner, University of California, Berkeley. Internship Primary Supervisor.
Now Research Scientist at Apple.
[ C19 ] -
Volodymyr Dziubak, University of Manitoba. Internship Primary Supervisor.
Now Software Developer at Wealthsimple.
[ C20 ] -
Xu Wang, Carnegie Mellon University. Internship Co-Supervisor.
Now Assistant Professor, University of Michigan.
[ C17 ] -
Seongkook Heo, KAIST. Internship Co-Supervisor.
Now Assistant Professor, University of Virginia.
[ C16 ]
Talks
All first-authored conference papers listed above were also given as presentations at their respective conferences and are not listed again in this section.
Invited talks
-
Some Training Required: Designing for Software Learning and Skill Development CLUE Lab Carelton University, Ottawa, ON, Canada
-
Novice-to-Expert Transition in FastTap Interfaces DGP Lab University of Toronto, ON, Canada
-
Novice-to-Expert Transition in FastTap Interfaces Autodesk Research Toronto, ON, Canada
-
Reimagining Feature-Rich Software: Task-Centric Inerfaces and Other Projects University of Canterbury Christchurch, New Zealand
-
Understanding the Faces and Uses of Online Tutorials Autodesk Research Toronto, ON, Canada
-
Introducing AdaptableGIMP Computer Science Club University of Waterloo, ON, Canada
-
Introducing AdaptableGIMP Libre Graphics Meeting Montreal, QC, Canada
Workshop presentations
-
Socially-Adaptable Interfaces: Crowdsourcing Customization CHI 2011 Workshop on Crowdsourcing and Human Computation Vancouver, BC, Canada
-
Building a Customization Culture into GIMP CHI 2010 Workshop on The Future of FLOSS in CHI Research and Practice Atlanta, GA, USA
Course guest lectures
-
Feature-Rich Software and Task-Centric User Interfaces CMPT481/811: Human-Computer Interaction, University of Saskatchewan
-
Visual Design CS349/SE382: User Interfaces, University of Waterloo
-
Introduction to Android Development CS349/SE382: User Interfaces, University of Waterloo
-
Visual Design CS349/SE382: User Interfaces, University of Waterloo
-
Introduction to AdaptableGIMP MSCI343: Human-Computer Interaction, University of Waterloo
Scholarships, Fellowships, and Awards
-
NSERC Postdoctoral Fellowship
Amount: $90,000 (partially declined due to accepting a full-time position) -
David R. Cheriton Graduate Scholarship
Amount: $20,000 (over 2 years) -
NSERC Postgraduate Scholarship - Doctoral
Amount: $63,000 (over 3 years) -
NSERC Alexander Graham Bell Canada Graduate Scholarship
Amount: $17,500 -
Ontario Graduate Scholarship
Amount: $30,000 (over 2 years) -
President's Graduate Scholarship, University of Waterloo
Amount: $50,000 (over 5 years) -
Convocated with Distinction, University of Windsor
-
Dean's Honour Roll, University of Windsor
-
President's Roll Scholar, University of Windsor
Teaching Activities
-
Co-instructor, University of Saskatchewan
CMPT: Surface Application Development -
Teaching Assistant, University of Waterloo
CS349: User Interfaces (5 terms), CS489: Human Computer Interaction (1 term), CS240: Data Structures and Data Management (6 terms), CS234: Developing Programming Principles (1 term), CS133: Concepts for Advanced Computer Usage (1 term) -
Teaching Assistant, University of Windsor
60-256: Systems Programming (2 terms)
Service
As an associate chair (conferences)
-
ACM CHI Conference on Human Factors in Computing Systems (Blending Interaction: Engineering Interactive Systems & Tools subcommittee)
-
ACM CHI Conference on Human Factors in Computing Systems (Interaction Techniques, Devices, and Modalities subcommittee)
-
Graphics Interface (HCI track)
As a reviewer (conferences)
● = Special recognition for exceptional reviews.
-
CHI 2025●, 2024(AC)●●, 2023(AC)●, 2022(AC)●●, 2021●, 2020(AC)●, 2019, 2018●●●, 2017●●, 2016●, 2015, 2014, 2013, 2012
-
GI 2025(AC), 2019(AC), 2018(AC), 2017(AC), 2016(AC), 2015
-
NordiCHI 2024
-
UIST 2023●, 2022, 2021●, 2020, 2019, 2018, 2017, 2016, 2015, 2014, 2013, 2012
-
SIGGRAPH Papers 2022, 2019
-
ACM DIS 2019, 2014, 2012
-
IEEE VR 2018
-
CHI PLAY 2016
-
ACM ISS 2016
-
CHI Works-in-Progress / Late-Breaking Work 2016, 2015, 2014, 2013
-
CSCW 2015
-
CHI alt.chi 2010
-
ACM IUI 2010
As a reviewer (journals)
-
Displays 2024
-
TOCHI 2023, 2021, 2020, 2019, 2016, 2014
-
IJHCI 2017
Volunteering
-
Student Volunteer - ACM CHI 2014
SV at CHI 2014 and the CHI 2014 program committee meeting. -
Volunteer - CEMC Workshop in Computer Science for Young Women
This event invites young women in grades 9/10 from across Canada to take part in lectures, labs, and hands-on activities on different facets of computer science. In 2009 and 2011 I ran sessions on Human-Computer Interaction. In 2014 I helped run sessions on digital hardware and PC disassembly. -
Volunteer - 17th Canadian Conference on Computational Geometry
Designed conference logo, helped to assemble print proceedings.
Media Coverage
-
Universal Robots at Autodesk for human-robot collaboration in construction Design World
-
Make the Free GIMP Photo Editor Easier to Use PC World Digital Focus Blog
-
LGM: Usability and AdaptableGIMP Linux Weekly News
-
AdaptableGIMP: User Interfaces for Users Libre Graphics Magazine, Issue 1.2
Research Internships and Assistantships
-
Research Assistant, University of Windsor
Supervisor: Asish Mukhopadhyay
Developed an efficient algorithm for the All-Farthest-Segments problem for a planar set of points.
[ J1 ]