← All posts
2024-07-25 linkedin

🐻🤖 AI Papers by Cornell Researchers!! (7/18-7/25)"

🐻🤖 AI Papers by Cornell Researchers!! (7/18-7/25)" "🤖 I Could’ve Asked That: Reformulating Unanswerable Questions (2024-07-24)" "When seeking information from unfamiliar documents, users frequently pose questions that cannot be answered by the documents. While existing large language models (LLMs) identify these unanswerable questions, they do not assist users in reformulating their questions, thereby reducing their overall utility. We curate CouldAsk, an evaluation benchmark composed of existing and new datasets for document-grounded question answering, specifically designed to study reformulating unanswerable questions. We evaluate state-of-the-art open-source and proprietary LLMs on CouldAsk. The results demonstrate the limited capabilities of these models in reformulating questions." "" "🤖 WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries (2024-07-24)" "While hallucinations of large language models (LLMs) prevail as a major challenge, existing evaluation benchmarks on factuality do not cover the diverse domains of knowledge that the real-world users of LLMs seek information about. To bridge this gap, we introduce WildHallucinations, a benchmark that evaluates factuality. It does so by prompting LLMs to generate information about entities mined from user-chatbot conversations in the wild. These generations are then automatically fact-checked against a systematically curated knowledge source collected from web search." "" "🤖 Correcting the Mythos of KL-Regularization: Direct Alignment without Overoptimization via Chi-Squared Preference Optimization (2024-07-18)" "Language model alignment methods, such as reinforcement learning from human feedback (RLHF), have led to impressive advances in language model capabilities, but existing techniques are limited by a widely observed phenomenon known as overoptimization, where the quality of the language model plateaus or degrades over the course of the alignment process. Overoptimization is often attributed to overfitting to an inaccurate reward model, and while it can be mitigated through online data collection, this is infeasible in many settings. This raises a fundamental question: Do existing offline alignment algorithms make the most of the data they have, or can their sample-efficiency be improved further?" "" "#ai #artificialintelligence #machinelearning #research
← 🐻🏛️ Cornellians in Public Service!! Bajinder Paul ’91 was Chief Information Officer for… Mobile uploads →