Carnegie Mellon University

Human-AI Complementarity Workshop: Dynamic Alignment

Academic Workshop - September 24-25, 2026

Downtown Pittsburgh skyline

The NSF AI Institute for Societal Decision Making (NSF AI-SDM) sponsors the participation of selected speakers and students in an annual workshop of Human-AI Complementarity for Decision Making. Human-AI Complementarity, defined as the condition in which Humans + AI working together results in better decisions than humans or AI working alone, is a broad goal pursued in several projects of the NSF AI-SDM.

In 2026, we will focus on the emerging challenge of dynamic alignment to achieve human-AI complementarity: designing AI systems that not only emulate human preferences, but also coordinate effectively with humans over trajectories of interaction. We are particularly motivated by the observation that current alignment paradigms largely optimize for static preferences and single-turn evaluations, while many deployment challenges emerge only through longitudinal interaction. This workshop therefore aims to bridge perspectives from ML and the social sciences to better understand how to design, optimize, and evaluate human-AI systems operating in dynamic environments.

The goals of the workshop are:

  • To deliver state of the art instruction on desirable ideas to achieve dynamic and complementary human-AI alignment
  • To generate common knowledge about pressing research challenges
  • To generate new shared ideas to address these challenges in future research

📌 Special Announcement for 2026 Applicants

We are pleased to announce that AI Magazine has accepted our proposal for an upcoming Special Issue centered on our workshop's core theme: "Dynamic Human-AI Complementarity."

NSF AI-SDM will be guest-editing this special issue and will author an opening perspective piece. Potential authors for the special issue articles will be exclusively invited from this year's workshop participants.

Details will be provided during the workshop to those interested in contributing an article. Please note that the deadline for submitting the full article will be November 15, 2026. Additional details about the submission timeline and other guidelines will be shared with interested contributors.

Work from Participants:

Participants of the workshop will represent multiple disciplines: decision science, cognitive science, computer science, machine learning, and others. The workshop will bring together academics of various levels including faculty and students working in the areas of Human and AI complementarity and Decision Making at the individual, group and societal levels.

Every participant of the workshop will need to be actively engaged in specific activities:

  • As tutorial Instructor that will deliver state-of-the-art educational material
  • As students that actively participate in tutorials and present their own work on interactive poster sessions
  • As presenters who briefly provide key contributions to a research topic
  • As discussant and AIdea generator to actively engage in the specification of proposals

AI-SDM Logo NSF Logo

Keynote Speakers

Smitha Milli

Smitha Milli

Research Scientist, Meta Superintelligence Labs

Thursday, Sept 24

Smitha Milli is a Research Scientist at Meta Superintelligence Labs where they lead the AI & Society team. They received their BS and PhD in Electrical Engineering & Computer Science from UC Berkeley. Their research focuses on pluralistic alignment and collective governance of AI systems, i.e., ensuring that systems are effective for and inclusive of people who hold diverse and conflicting viewpoints. Their work has been discussed in live television such as on 60 Minutes, in policy outlets such as Tech Policy Press and the Knight First Amendment Institute, and in testimony to the House Financial Services Committee.

Professor Ganna Pogrebna

Ganna Pogrebna

David Trimble Chair, Queen's Business School | Lead for Behavioural Data Science, The Alan Turing Institute

Thursday, Sept 24

Professor Ganna Pogrebna is a pioneer in Behavioural Data Science and an internationally recognized scholar working at the intersection of Artificial Intelligence, behavioral science, and decision theory. She serves as the inaugural David Trimble Chair in Leadership and Organisational Transformation at Queen's Business School (Queen's University Belfast) and leads the Behavioural Data Science strand at The Alan Turing Institute (UK). Her research focuses on the social, ethical, and behavioral dimensions of emerging technologies, analyzing how individuals and groups coordinate, negotiate risk, and make decisions in dynamic, uncertainty-driven environments.

Jennifer Neville

Jennifer Neville

Partner Research Manager, Microsoft Research | Professor of Computer Science and Statistics, Purdue University

Friday, Sept 25
Jennifer Neville is a Partner Research Manager at Microsoft Research Redmond, where she leads the AI Interaction and Learning research team, and the Samuel Conte Chair Professor of Computer Science and Statistics at Purdue University. Her research focuses on understanding how machine learning and AI systems behave in realistic environments. She studies how interactions among users, tasks, and AI systems shape behavior in long-horizon workflows, with the goal of developing more reliable, adaptive, and collaborative AI systems. Her research combines empirical evaluation, theoretical analysis, and machine learning methods to better understand the limitations of current AI systems and improve their performance in real-world settings.
Robin Murphy

Robin Murphy

Professor Emerita of Computer Science and Engineering, Texas A&M University

Friday, Sept 25

Robin Murphy is a Professor Emerita of Computer Science & Engineering Texas A&M and the co-founder of Center for Robot-Assisted Search and Rescue (CRASAR). She has over 200 publications on artificial intelligence, human-robot interaction, and robotics including the seminal textbook “Introduction to AI Robotics and Disaster Robotics, second edition, as well as Disaster Robotics, and Robotics Through Science Fiction: AI Explained Through Six Classic Robot Short Stories. Dr. Murphy is an AAAS, ACM, and IEEE fellow for her work in disaster robotics and human-robot interaction. Her participant-observer ethnographic research at over 30 disasters has identified gaps and opportunities for the use of AI and robotics in high pressure, cognitively demanding domains. 

Venue

The workshop will take place September 24-25, 2026 at the Rivers Club Pittsburgh located in the downtown area.   The venue address is 301 Grant St Suite 411, Pittsburgh, PA 15219. Numerous cultural sites, entertainment options, and historical landmarks are located nearby.  Several examples are marked on the map below.

Downtown Pittsburgh skyline
Workshop Agenda
Workshop activities on Thursday will take place from 8:15am to 5:00pm, with a dinner in the evening.  The workshop will continue on Friday from 8:00am to 5:00pm. All sessions (except where noted) will be held in the Three Rivers Ballroom on the 6th floor of the Rivers Club.

Click here for a complete list of accepted abstracts

Thursday, September 24th
Breakfast
7:45-8:15

Breakfast

Introduction
8:15-8:30

Introductions and Goals

Coty Gonzalez, NSF AI-SDM Co-Director
Norman Gottron, NSF AI-SDM Managing Director
Tutorials
8:30-10:30

Session 1: Parallel Tutorials

Tutorial Track A
Bidirectional Human-AI Alignment: From Static Preferences to Dynamic Human-AI Complementarity
Location: Three Rivers Ballroom

Tiffany Knearem, TK Research
Hua Shen, NYU Shanghai
Jenny Liang, Carnegie Mellon University

Tutorial Track B
Calibration, Decisions, and Collaboration in Learning

Location: Duquesne Room

Ira Globus-Harris, Cornell University
Natalie Collina, University of Pennsylvania

Coffee Break
10:30-10:45
Coffee

Keynote
10:45-11:30

Session 2: Keynote Talk

Smitha Milli
Research Scientist, Meta Superintelligence Labs

Poster Spotlights
11:30-12:30

Session 3: Spotlight Lightning Talks

20x speakers, no Q&A

Lunch
12:30-1:30

Lunch

Plenary Session I
1:30-2:45

Session 4: Adaptive Alignment and Oversight

Babak Heydari, Northeastern University
Daniel Cohen, Reichman University
Min Lee, Singapore Management University
Grace Liu, Carnegie Mellon University

Coffee Break
2:45-3:00
Coffee
Keynote
3:00-3:45
Session 5: Keynote Talk

Ganna Pogrebna
David Trimble Chair, Queen's Business School
Lead for Behavioural Data Science, The Alan Turing Institute
Plenary Session II
3:45-5:00
Session 6: Design and Organization of Humans and AI

Ori Plonsky, Technion Israel Institute of Technology
Emily Hu, Massachusetts Institute of Technology
Tobias Rebholz, Duke University
Rishub Jain, Sampura Research
Dinner
5:00-7:00

Dinner & Networking

Friday, September 25th
Breakfast
8:00-8:30

Breakfast

Introduction
8:30-8:35

Day 2 Welcome

Coty Gonzalez, NSF AI-SDM Co-Director
Keynote
8:35-9:20
Session 7: Keynote Talk

Jennifer Neville
Professor of Computer Science and Statistics, Purdue University
Partner Research Manager, Microsoft Research

Industry Highlights
9:20-10:20

Session 8: Industry Highlight Talks

Gaia Molinaro, Microsoft
Myke Cohen, Aptima, Inc.
Tim Pappa, Christopher Williams, Aadam Dirie, Walmart Global Tech
Alessandro Oltramari, Bosch Research

Coffee Break
10:20-10:35
Coffee
Plenary Session III
10:35-11:50

Session 9: Social Effects in Human-AI Interaction

Danny Oppenheimer, Carnegie Mellon University
Rachit Dubey, University of California, Los Angeles
Grace Roessling, Carnegie Mellon University
Angel Hwang, University of Southern California

Lunch
11:50-12:50

Lunch

Keynote
12:50-1:35
Session 10: Keynote Talk

Robin Murphy
Professor Emerita of Computer Science and Engineering, Texas A&M University

Scenario Exercises
1:35-3:35

Session 11: Scenario Exercises

Table groups analyze scenarios to address core human-AI evaluation and oversight challenges, concluding with group report-outs.

Coffee Break
3:35-3:50

Coffee

Panel Discussion
3:50-4:50

Session 12: Dynamic Alignment in Human-AI Interactions

Anita Woolley, Carnegie Mellon University
Milind Tambe, Harvard University
Jennifer Trueblood, Indiana University
Vincent Conitzer, Carnegie Mellon University

Closing Remarks
4:50-5:00

Closing Remarks

Coty Gonzalez, NSF AI-SDM Co-Director
Departure

Travel Information

How to travel to and around Pittsburgh:

  • By plane via Pittsburgh International Airport. - Pittsburgh Regional Transit offers public transit service to and from Pittsburgh International Airport via the 28X Airport Flyer.  The 28X route serves Pittsburgh International Airport, Downtown Pittsburgh, and Oakland seven days a week.  Riders using cash to pay their transit fares must have exact change; credit cards are not accepted on vehicles.  Credit cards are accepted at the ticket vending machine in Baggage Claim inside Door #2. The ticket vending machine allows riders to buy daily, 7-day or 30-day tickets, or add stored value onto a ConnectCard or ConnecTix.
  • By train via Amtrak. - Amtrak's Union Station is located at 1100 Liberty Avenue, Pittsburgh, PA 15222.  
  • By long distance bus via Greyhound. - The Greyhound Bus Terminal is located five miles from campus in downtown Pittsburgh.  The station terminal is located at the intersection of 11th Street and Liberty Avenue
  • Local bus via Pittsburgh Regional Transport. - The PRT network offers bus, light rail, and incline services in Allegheny County.  Please see their website for schedules and rider information.

The following hotels are located <0.5 mile from the workshop venue: