TensorX
返回文献探索

Paper · arXiv 2309.07990

Leveraging Contextual Information for Effective Entity Salience Detection

Rajarshi Bhowmik, Marco Ponza, Atharva Tendle, Anant Gupta, Rebecca Jiang, Xingyu Lu, Qian Zhao, Daniel Preotiuc-Pietro

7 upvotesSeptember 14, 2023arXiv 预印本
AI 摘要

Fine-tuning medium-sized language models with a cross-encoder style significantly improves salient entity detection compared to feature engineering approaches.

cross-encoder stylezero-shot promptinginstruction-tuned language modelsmedium-sized pre-trained language modelssalient entity detection

Abstract

In text documents such as news articles, the content and key events usually revolve around a subset of all the entities mentioned in a document. These entities, often deemed as salient entities, provide useful cues of the aboutness of a document to a reader. Identifying the salience of entities was found helpful in several downstream applications such as search, ranking, and entity-centric summarization, among others. Prior work on salient entity detection mainly focused on machine learning models that require heavy feature engineering. We show that fine-tuning medium-sized language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches. To this end, we conduct a comprehensive benchmarking of four publicly available datasets using models representative of the medium-sized pre-trained language model family. Additionally, we show that zero-shot prompting of instruction-tuned language models yields inferior results, indicating the task's uniqueness and complexity.

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号