Besmira Nushi

According to our database, Besmira Nushi authored at least 42 papers between 2011 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Eureka: Evaluating and Understanding Large Foundation Models.

Vidhisha Balachandran, Jingya Chen, Neel Joshi, Besmira Nushi, Hamid Palangi, Eduardo Salinas, Vibhav Vineet, James Woffinden-Luey, Safoora Yousefi

CoRR, 2024

Understanding Information Storage and Transfer in Multi-modal Large Language Models.

Samyadeep Basu, Martin Grayson, Cecily Morrison, Besmira Nushi, Soheil Feizi, Daniela Massiceti

CoRR, 2024

Introducing v0.5 of the AI Safety Benchmark from MLCommons.

Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, Victor Akinwande, Namir Al-Nuaimi, Najla Alfaraj, Elie Alhajjar, Lora Aroyo, Trupti Bavalatti, Borhane Blili-Hamelin, Kurt D. Bollacker, Rishi Bomassani, Marisa Ferrara Boston, Siméon Campos, Kal Chakra, Canyu Chen, Cody Coleman, Zacharie Delpierre Coudert, Leon Derczynski, Debojyoti Dutta, Ian Eisenberg, James Ezick, Heather Frase, Brian Fuller, Ram Gandikota, Agasthya Gangavarapu, Ananya Gangavarapu, James Gealy, Rajat Ghosh, James Goel, Usman Gohar, Subhra S. Goswami, Scott A. Hale, Wiebke Hutiri, Joseph Marvin Imperial, Surgan Jandial, Nick Judd, Felix Juefei-Xu, Foutse Khomh, Bhavya Kailkhura, Hannah Rose Kirk, Kevin Klyman, Chris Knotz, Michael Kuchnik, Shachi H. Kumar, Chris Lengerich, Bo Li, Zeyi Liao, Eileen Peters Long, Victor Lu, Yifan Mai, Priyanka Mary Mammen, Kelvin Manyeki, Sean McGregor, Virendra Mehta, Shafee Mohammed, Emanuel Moss, Lama Nachman, Dinesh Jinenhally Naganna, Amin Nikanjam, Besmira Nushi, Luis Oala, Iftach Orr, Alicia Parrish, Cigdem Patlak, William Pietri, Forough Poursabzi-Sangdeh, Eleonora Presani, Fabrizio Puletti, Paul Röttger, Saurav Sahay, Tim Santos, Nino Scherrer, Alice Schoenauer Sebag, Patrick Schramowski, Abolfazl Shahbazi, Vin Sharma, Xudong Shen, Vamsi Sistla, Leonard Tang, Davide Testuggine, Vithursan Thangarasa, Elizabeth Anne Watkins, Rebecca Weiss, Chris Welty, Tyler Wilbers, Adina Williams, Carole-Jean Wu, Poonam Yadav, Xianjun Yang, Yi Zeng, Wenhui Zhang, Fedor Zhdanov, Jiacheng Zhu, Percy Liang, Peter Mattson, Joaquin Vanschoren

CoRR, 2024

Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models.

Sebastian Bordt, Harsha Nori, Vanessa Rodrigues, Besmira Nushi, Rich Caruana

CoRR, 2024

Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models.

Mert Yüksekgönül, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi

Proceedings of the Twelfth International Conference on Learning Representations, 2024

KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval.

Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yüksekgönül, Rahee Ghosh Peshawaria, Ranjita Naik, Besmira Nushi

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Advancing Human-AI Complementarity: The Impact of User Expertise and Algorithmic Tuning on Joint Decision Making.

Kori Inkpen, Shreya Chappidi, Keri Mallari, Besmira Nushi, Divya Ramesh, Pietro Michelucci, Vani Mandava, Libuse Hannah Veprek, Gabrielle Quinn

ACM Trans. Comput. Hum. Interact., October, 2023

Diversity of Thought Improves Reasoning Abilities of Large Language Models.

Ranjita Naik, Varun Chandrasekaran, Mert Yüksekgönül, Hamid Palangi, Besmira Nushi

CoRR, 2023

Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning.

Yu Yang, Besmira Nushi, Hamid Palangi, Baharan Mirzasoleiman

Proceedings of the International Conference on Machine Learning, 2023

Social Biases through the Text-to-Image Generation Lens.

Ranjita Naik, Besmira Nushi

Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society, 2023

2022

Benchmarking Spatial Relationships in Text-to-Image Generation.

Tejas Gokhale, Hamid Palangi, Besmira Nushi, Vibhav Vineet, Eric Horvitz, Ece Kamar, Chitta Baral, Yezhou Yang

CoRR, 2022

HINT: Integration Testing for AI-based features with Humans in the Loop.

Quan Ze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi

Proceedings of the IUI 2022: 27th International Conference on Intelligent User Interfaces, Helsinki, Finland, March 22, 2022

Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imaging.

Riccardo Fogliato, Shreya Chappidi, Matthew P. Lungren, Paul Fisher, Diane Wilson, Michael Fitzke, Mark Parkinson, Eric Horvitz, Kori Inkpen, Besmira Nushi

Proceedings of the FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, June 21, 2022

Investigations of Performance and Bias in Human-AI Teamwork in Hiring.

Andi Peng, Besmira Nushi, Emre Kiciman, Kori Inkpen, Ece Kamar

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Hierarchical Analysis of Visual COVID-19 Features from Chest Radiographs.

Shruthi Bannur, Ozan Oktay, Melanie Bernhardt, Anton Schwaighofer, Rajesh Jena, Besmira Nushi, Sharan Wadhwani, Aditya V. Nori, Kal Natarajan, Shazad Ashraf, Javier Alvarez-Valle, Daniel C. Castro

CoRR, 2021

Understanding Failures of Deep Networks via Robust Feature Extraction.

Sahil Singla, Besmira Nushi, Shital Shah, Ece Kamar, Eric Horvitz

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance.

Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Túlio Ribeiro, Daniel S. Weld

Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork.

Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Daniel S. Weld

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Optimizing AI for Teamwork.

Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Daniel S. Weld

CoRR, 2020

SQuINTing at VQA Models: Interrogating VQA Models with Sub-Questions.

Ramprasaath R. Selvaraju, Purva Tendulkar, Devi Parikh, Eric Horvitz, Marco Ribeiro, Besmira Nushi, Ece Kamar

CoRR, 2020

Characterizing Search-Engine Traffic to Internet Research Agency Web Properties.

Alexander Spangher, Gireeja Ranade, Besmira Nushi, Adam Fourney, Eric Horvitz

Proceedings of the WWW '20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020, 2020

An Empirical Analysis of Backward Compatibility in Machine Learning Systems.

Megha Srivastava, Besmira Nushi, Ece Kamar, Shital Shah, Eric Horvitz

Proceedings of the KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2020

SQuINTing at VQA Models: Introspecting VQA Models With Sub-Questions.

Ramprasaath R. Selvaraju, Purva Tendulkar, Devi Parikh, Eric Horvitz, Marco Túlio Ribeiro, Besmira Nushi, Ece Kamar

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Metareasoning in Modular Software Systems: On-the-Fly Configuration Using Reinforcement Learning with Rich Contextual Representations.

Aditya Modi, Debadeepta Dey, Alekh Agarwal, Adith Swaminathan, Besmira Nushi, Sean Andrist, Eric Horvitz

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

A Case for Backward Compatibility for Human-AI Teams.

Gagan Bansal, Besmira Nushi, Ece Kamar, Daniel S. Weld, Walter S. Lasecki, Eric Horvitz

CoRR, 2019

Software engineering for machine learning: a case study.

Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLine, Harald C. Gall, Ece Kamar, Nachiappan Nagappan, Besmira Nushi, Thomas Zimmermann

Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice, 2019

What You See Is What You Get? The Impact of Representation Criteria on Human Bias in Hiring.

Andi Peng, Besmira Nushi, Emre Kiciman, Kori Inkpen, Siddharth Suri, Ece Kamar

Proceedings of the Seventh AAAI Conference on Human Computation and Crowdsourcing, 2019

Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance.

Gagan Bansal, Besmira Nushi, Ece Kamar, Walter S. Lasecki, Daniel S. Weld, Eric Horvitz

Proceedings of the Seventh AAAI Conference on Human Computation and Crowdsourcing, 2019

Guidelines for Human-AI Interaction.

Saleema Amershi, Daniel S. Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi T. Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

Overcoming Blind Spots in the Real World: Leveraging Complementary Abilities for Joint Execution.

Ramya Ramakrishnan, Ece Kamar, Besmira Nushi, Debadeepta Dey, Julie Shah, Eric Horvitz

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff.

Gagan Bansal, Besmira Nushi, Ece Kamar, Daniel S. Weld, Walter S. Lasecki, Eric Horvitz

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

Analysis of Strategy and Spread of Russia-sponsored Content in the US in 2017.

Alexander Spangher, Gireeja Ranade, Besmira Nushi, Adam Fourney, Eric Horvitz

CoRR, 2018

Towards Accountable AI: Hybrid Human-Machine Analyses for Characterizing System Failure.

Besmira Nushi, Ece Kamar, Eric Horvitz

Proceedings of the Sixth AAAI Conference on Human Computation and Crowdsourcing, 2018

2017

On Human Intellect and Machine Failures: Troubleshooting Integrative Machine Learning Systems.

Besmira Nushi, Ece Kamar, Eric Horvitz, Donald Kossmann

Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

2016

Quality Control and Optimization for Hybrid Crowd-Machine Learning Systems.

Besmira Nushi

PhD thesis, 2016

Learning and Feature Selection under Budget Constraints in Crowdsourcing.

Besmira Nushi, Adish Singla, Andreas Krause, Donald Kossmann

Proceedings of the Fourth AAAI Conference on Human Computation and Crowdsourcing, 2016

2015

Fault-Tolerant Entity Resolution with the Crowd.

Anja Gruenheid, Besmira Nushi, Tim Kraska, Wolfgang Gatterbauer, Donald Kossmann

CoRR, 2015

CrowdSTAR: A Social Task Routing Framework for Online Communities.

Besmira Nushi, Omar Alonso, Martin Hentschel, Vasileios Kandylas

Proceedings of the Engineering the Web in the Big Data Era - 15th International Conference, 2015

Crowd Access Path Optimization: Diversity Matters.

Besmira Nushi, Adish Singla, Anja Gruenheid, Erfan Zamanian, Andreas Krause, Donald Kossmann

Proceedings of the Third AAAI Conference on Human Computation and Crowdsourcing, 2015

2013

When is A=B?

Anja Gruenheid, Donald Kossmann, Besmira Nushi

Bull. EATCS, 2013

2012

Uncertain Time-Series Similarity: Return to the Basics.

Michele Dallachiesa, Besmira Nushi, Katsiaryna Mirylenka, Themis Palpanas

Proc. VLDB Endow., 2012

2011

Similarity matching for uncertain time series: analytical and experimental comparison.

Michele Dallachiesa, Besmira Nushi, Katsiaryna Mirylenka, Themis Palpanas

Proceedings of the 2nd ACM SIGSPATIAL International Workshop on Querying and Mining Uncertain Spatio-Temporal Data, 2011