Carnegie Mellon University
AI Measurement Science & Engineering (AIMSEC)

CMU-NIST Cooperative Research Center

2026 — 26 publications

Sorted by date, newest first

Andy LiuMona DiabOctober 2026
Predicting Alignment Generalization with Value Representations

Liu, A., Bhatia, M., Stanczak, K., Diab, M., Shwartz, V., et al. · arXiv:2610.12410

↗ arXiv
Yubo LiRamayya KrishnanRema PadmanSeptember 2026
JEV-as-a-Judge: Accept When Confident, Escalate When Unsure

Li, Y., Miao, Y., Krishnan, R., & Padman, R. · arXiv:2609.26550

↗ arXiv
Kimberly Le TruongAnna KawakamiHoda HeidariSeptember 2026
A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance

Truong, K. L., Johnson, N., Kawakami, A., & Heidari, H. · arXiv:2609.16592

↗ arXiv
Aarushi JaitlyAnand RaoRamayya KrishnanRema Padman2026
Multi-Agent AI Frameworks for Clinical Diagnosis Support: Benchmarking LLM Reasoning with Sleep Disorders as a Testbed

Jaitly, A., Berhane, H., Burman, D., Rao, A., Krishnan, R., & Padman, R. · IEEE ICHI 2026

↗ IEEE ICHI
Yubo LiRamayya KrishnanRema Padman2026
Beyond Natural-Language Interfaces: Decisions, Scores, and Predictive Distributions

Li, Y., Krishnan, R., & Padman, R. · 2026

↗ PDF
Yubo LiRamayya KrishnanRema Padman2026
Calibration-Aware Reinforcement Learning for Large Language Models: A Survey of Objectives, Optimization, and Decision-Making

Li, Y., Miao, Y., Krishnan, R., & Padman, R. · 2026

↗ KiltHub
Eli Ben-Michael2026
Longitudinal Causal Inference with Selective Eligibility: Application to Pretrial Risk Assessment

Jiang, Z., Ben-Michael, E., Greiner, D. J., Halen, R., & Imai, K. · The Annals of Applied Statistics, 20(3), 2026

↗ AOAS
Ramayya KrishnanJuly 2026
Benchmarking AI on Knowledge Work with Realistic Business Cases and the Implications for Business Education and White-Collar Labor

Patel, A., Hosanagar, K., Krishnan, R., Callison-Burch, C., & Lakhani, K. · arXiv:2607.16057

↗ arXiv
Yubo LiRamayya KrishnanRema PadmanJuly 2026
Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Models

Li, Y., Shen, X., Miao, Y., Yao, X., Ding, X., Krishnan, R., & Padman, R. · Transactions on Machine Learning Research (TMLR), 2026

↗ TMLR
Yubo LiJuly 2026
Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries

Li, Y. · Transactions on Machine Learning Research (TMLR), 2026

↗ TMLR
Lujo BauerJuly 2026
User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios

Wu, X., Li, W., Kaushik, R., Bauer, L., & Onoue, K. · ACL 2026 (Long Papers)

↗ ACL
Aditi RaghunathanJune 2026
Hardening Agent Benchmarks with Adversarial Hacker-Fixer Loops

Zhong, Z., Segal, I., Bercovich, I., Saxena, S., Zhang, K., et al., & Raghunathan, A. · arXiv:2606.08960

↗ arXiv
Lujo BauerJune 2026
Security and Privacy Prompts in the Wild: What Users Ask LLMs and How LLMs Respond

Kim, H., Wu, X., Akgul, O., Bauer, L., & Christin, N. · arXiv:2606.18062

↗ arXiv
Fernando DiazJune 2026
Characterizing Cultural Localization in AI-Generated Stories

Bhatt, S., Vijay, S., Milbauer, J., & Diaz, F. · arXiv:2606.14626

↗ arXiv
Anand RaoHong ShenMay 2026
Towards Apples to Apples for AI Evaluations: From Real-World Use Cases to Evaluation Scenarios

Choong, Y. Y., Greene, K., Qian, A., Marasli, M., Yang, Z., Rao, A., & Shen, H. · arXiv:2605.07986

↗ arXiv
Zico KolterMay 2026
Measuring Five-Nines Reliability: Sample-Efficient LLM Evaluation in Saturated Benchmarks

Kim, E., Gu, C., Tiwari, V., & Kolter, J. Z. · arXiv:2605.11209

↗ arXiv
Hong ShenMay 2026
Actualizing Ethical Principles for Curating Large-Scale Training Datasets in the Era of Massive AI Models

Cazacu, S., Qian, A., Zhao, D., Pine, K., Walker, S., & Shen, H. · ACM FAccT CRAFT, 2026

↗ FAccT
Mingqian ZhengMaarten SapApril 2026
Useless but Safe? Benchmarking Utility Recovery with User Intent Clarification in Multi-Turn Conversations

Zheng, M., & Sap, M. · arXiv:2604.27093

↗ arXiv
Hong ShenApril 2026
What People See (and Miss) About Generative AI Risks: Perceptions of Failures, Risks, and Who Should Address Them

Li, M., Bickersteth, W., Tang, N., Kapoor, P., Win, K., Zhong, P., & Shen, H. · arXiv:2604.22654

↗ arXiv
Hong ShenApril 2026
Human Expertise for AI Red-Teaming and Scalable Evaluation

Qian, A., Chandhiramowuli, S., Dabbish, L., & Shen, H. · CHI EA '26, Barcelona, Spain

↗ CHI
Yubo LiRamayya KrishnanRema PadmanMarch 2026
The Model Says Walk: How Surface Heuristics Override Implicit Constraints in LLM Reasoning

Li, Y., Zhang, L., Jiang, T., Krishnan, R., & Padman, R. · arXiv:2603.29025

↗ arXiv
Yubo LiRamayya KrishnanRema PadmanMarch 2026
When Documents Disagree: Measuring Institutional Variation in Transplant Guidance with Retrieval-Augmented Language Models

Li, Y., Krishnan, R., & Padman, R. · arXiv:2603.21460

↗ arXiv
Yubo LiRema PadmanRamayya KrishnanMarch 2026
Confidence as Control: A Survey of Confidence Utilization in Large Language Models

Zhou, Y., Shen, X., Miao, Y., & Krishnan, R. · 2026

↗ Link
Yubo LiRamayya KrishnanRema PadmanFebruary 2026
Consistency of Large Reasoning Models Under Multi-Turn Attacks

Li, Y., Krishnan, R., & Padman, R. · arXiv:2602.13093

↗ arXiv
Ramayya KrishnanRema PadmanFebruary 2026
Closing Reasoning Gaps in Clinical Agents with Differential Reasoning Learning

Liu, J., Jiang, Y., Krishnan, R., Padman, R., Zhang, Y., & Bian, J. · arXiv:2602.09945

↗ arXiv
Eli Ben-MichaelFebruary 2026
Omitted Variable Bias in Language Models Under Distribution Shift

Lin, V., Morency, L. P., & Ben-Michael, E. · arXiv:2602.16784

↗ arXiv

2025 — 11 publications

Kenneth Holstein2025
Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection

Jung, J. Y., Saxena, D., Park, M., Kim, J., Forlizzi, J., & Holstein, K. · arXiv:2506.17494

↗ arXiv
Mingqian ZhengMaarten Sap2025
Let Them Down Easy! Contextual Effects of LLM Guardrails on User Perceptions and Preferences

Zheng, M., & Sap, M. · Findings of EMNLP 2025

↗ EMNLP
Lujo Bauer2025
Estimating LLM Consistency: A User Baseline vs Surrogate Metrics

Wu, X., Lin, W., Akgul, O., & Bauer, L. · EMNLP 2025

↗ EMNLP
Ramayya Krishnan29 Dec 2025
ML Compass: Navigating Capability, Cost, and Compliance Trade-offs in AI Model Deployment

Digalakis Jr, V., Krishnan, R., Fernandez, G. M., & Orfanoudaki, A. · arXiv:2512.23487

↗ arXiv
Hoda HeidariOctober 2025
The AI Power Disparity Index: Toward a Compound Measure of AI Actors' Power to Shape the AI Ecosystem

Kim, R. M., Kuehnert, B., Lazar, S., Singh, R., & Heidari, H. · AIES 2025

↗ AIES
Hoda HeidariOctober 2025
Moral Change or Noise? On Problems of Aligning AI With Temporally Unstable Human Feedback

Keswani, V., Cousins, C., Nguyen, B., & Heidari, H. · arXiv:2511.10032

↗ arXiv
Yubo LiRamayya KrishnanRema PadmanOctober 2025
Time-To-Inconsistency: A Survival Analysis of Large Language Model Robustness to Adversarial Attacks

Krishnan, R., & Padman, R. · arXiv:2510.02712

↗ arXiv
Roman BelaireAugust 2025
Automatic LLM Red Teaming

Belaire, R., Sinha, A., & Varakantham, P. · arXiv:2508.04451

↗ arXiv
Cathy JiaoChenyan XiongJuly 2025
DATE-LM: Benchmarking Data Attribution Evaluation for Large Language Models

Jiao, C., Pan, Y., Xiao, E., Sheng, D., Jain, N., Zhao, H., Dasgupta, I., Ma, J. W., & Xiong, C. · NeurIPS 2025 Datasets & Benchmarks

↗ arXiv
Ramayya KrishnanJune 2025
From Posting to Prediction: Building Validated Workforce Analytics

Charuvilparambil Titus, N. G., Krishnan, R., & Telang, R. · SSRN:4906323

↗ SSRN
No publications match your search.