KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models-Reference-Cited by-同舟云学术

KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models

Published:2024-05-13 Issue: Volume:2 Page:2226-2237
ISSN:
Container-title:Proceedings of the ACM Web Conference 2024
language:
Short-container-title:

Author:

Bai Yuyang¹^ORCID,Feng Shangbin²^ORCID,Balachandran Vidhisha³^ORCID,Tan Zhaoxuan⁴^ORCID,Lou Shiqi¹^ORCID,He Tianxing²^ORCID,Tsvetkov Yulia²^ORCID

Affiliation:

1. Xi'an Jiaotong University, Xi'an, China

2. University of Washington, Seattle, USA

3. Carnegie Mellon University, Pittsburgh, USA

4. University of Notre Dame, Notre Dame, USA

Funder

Office of the Director of National Intelligence

Intelligence Advanced Research Projects Activity

National Science Foundation, Faculty Early Career Development Program

Defense Advanced Research Projects Agency

Alfred P.~Sloan Foundation Fellowship

National Science Foundation

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3589334.3645623

Reference64 articles.

1. Reason first, then respond: Modular Generation for Knowledge-infused Dialogue

2. Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infilling

3. Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, Wenliang Dai, Dan Su, Bryan Wilie, Holy Lovenia, Ziwei Ji, Tiezheng Yu, Willy Chung, Quyet V. Do, Yan Xu, and Pascale Fung. 2023. A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity. ArXiv abs/2302.04023 (2023).

4. Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-Relational Data. In Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2 (Lake Tahoe, Nevada) (NIPS'13). Curran Associates Inc., Red Hook, NY, USA, 2787--2795.