5,492,862 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

Research papers

Publications about AI methods and applications.

How to use the library

Resources

Search results
Search stays within research papers.
Research paper

Effective Context Selection in LLM-based Leaderboard Generation: An Empirical Study

This paper explores the impact of context selection on the efficiency of Large Language Models (LLMs) in generating Artificial Intelligence (AI) research leaderboards, a task defined as the extraction of (Task, Dataset, Metric, Score) quadruples from scholarly articles. By framing this challenge as a text generation objective and employing instruction finetuning with the FLAN-T5 collection, we introduce a novel method that surpasses traditional Natural Language Inference (NLI) approaches in adapting to new developments without a predefined taxonomy. Through experimentation with three distinct context types of varying selectivity and length, o

Kabongo, Salomon, D'Souza, Jennifer, Auer, Sören
Creative Commons Attribution 4.0 InternationalView resource
Research paper

Evaluating the Robustness to Instructions of Large Language Models

Recently, Instruction fine-tuning has risen to prominence as a potential method for enhancing the zero-shot capabilities of Large Language Models (LLMs) on novel tasks. This technique has shown an exceptional ability to boost the performance of moderately sized LLMs, sometimes even reaching performance levels comparable to those of much larger model variants. The focus is on the robustness of instruction-tuned LLMs to seen and unseen tasks. We conducted an exploration of six models including Alpaca, Vicuna, WizardLM, and Traditional Task-oriented Models(Flan-T5-XL/XXL, T0++) using real-world relation extraction datasets as case studies. We ca

Ni, Yuansheng, Jiang, Sichao, wu, Xinyu, Shen, Hui, Zhou, Yuli
arXiv.org perpetual, non-exclusive licenseView resource
Research paper

Exploring Large Language Models for Ontology Alignment

This work investigates the applicability of recent generative Large Language Models (LLMs), such as the GPT series and Flan-T5, to ontology alignment for identifying concept equivalence mappings across ontologies. To test the zero-shot performance of Flan-T5-XXL and GPT-3.5-turbo, we leverage challenging subsets from two equivalence matching datasets of the OAEI Bio-ML track, taking into account concept labels and structural contexts. Preliminary findings suggest that LLMs have the potential to outperform existing ontology alignment systems like BERTMap, given careful framework and prompt design.

He, Yuan, Chen, Jiaoyan, Dong, Hang, Horrocks, Ian
arXiv.org perpetual, non-exclusive licenseView resource

Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.