"Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation"A major blind spo...

"Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation"A major blind spot just now getting formal treatment: maximizing retrieval relevance can paradoxically surface sycophantic evidence that reinforces hallucinations rather than correcting them. SIGIR 2026's CoRM-RAG proposes counterfactual risk minimization to align retrieval with decision safety, not just similarity.https://dl.acm.org/doi/10.1145/3805712.3809631#research #AI #science

Read Original

Related

Mastodon discussion 23m ago

我們不只需要讓 AI 對齊人類,也需要讓社會準備好迎接 AI。這就是「反向對齊」(Reverse Alignment)的核心概念。一般談到 AI 對齊,關注的是:如何讓 AI 遵循人類的價值、意圖與安全規範。反向對齊則把問題轉向另一面:當 ...

我們不只需要讓 AI 對齊人類,也需要讓社會準備好迎接 AI。這就是「反向對齊」(Reverse Alignment)的核心概念。一般談到 AI 對齊,關注的是:如何讓 AI 遵循人類的價值、意圖與安全規範。反向對齊則把問題轉向另一面:當 AI 快速進入企業、學校、政府與日常生活,我們的制度、工作方式、專業技能與治理機制,是否也跟得上?假如組織只導入更強大的...