Research paper

Aggregate vs. Personalized Judges in Business Idea Evaluation: Evidence from Expert Disagreement

Published by Association for Computational LinguisticsJul 2026PDF

Compare individual and aggregate evaluators when experts disagree about a proposed business idea.

Model evaluation Language technology

Aggregate vs. Personalized Judges in Business Idea Evaluation: Evidence from Expert Disagreement cover

Resource access

Get the full resource

Enter your business details to read the full resource.

First nameLast nameWork emailCompanyJob titleCountry or region

Wataru Hirota, Tomoki Taniguchi, Tomoko Ohkuma, Kosuke Takahashi, Takahiro Omi, Kosuke Arima, Takuto Asakura, Chung-Chi Chen, Tatsuya Ishigaki. Aggregate vs. Personalized Judges in Business Idea Evaluation: Evidence from Expert Disagreement. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track). © 2026 Association for Computational Linguistics. CC BY 4.0. 10.18653/v1/2026.acl-industry.61. Original PDF, unmodified.

CC BY 4.0

Aggregate vs. Personalized Judges in Business Idea Evaluation: Evidence from Expert Disagreement

Related research.

Learning Selective LLM Autonomy from Copilot Feedback in Enterprise Customer Support Workflows

ECom-Bench: Can LLM Agent Resolve Real-World E-commerce Customer Support Issues?

Retrieval Enhancements for RAG: Insights from a Deployed Customer Support Chatbot