Research papers

Publications about AI methods and applications.

Resources

Search results

Sort by

Research paper

Adversarial attack detection in resource-constrained environments: a stable and sequential federated learning architecture with TinyLlama-1.1B

Research paper by Sevim Ceylan Böcekçi and collaborators, published 2026 in Cluster Computing. Research area: Privacy-Preserving Technologies in Data.

Sevim Ceylan Böcekçi, Kazım Yıldız

Not specifiedView resource

Research paper

Integrating Retrieval-Augmented Generation with Fine-Tuned TinyLlama for Domain-Specific Applications: Enhancing Data Sovereignty and Localised Compliance

Research paper by Kenneth Meng Yong Wong and collaborators, published 2026 in IEEE International Conference on Computation, Big-Data and Engineering (ICCBE). Research area: Topic Modeling.

Kenneth Meng Yong Wong, Wei Jie Wong, Chi Wee Tan

Not specifiedView resource

Research paper

Integration of Transformer-Based Language Models with Humanoid Robots: A Case Study Using NAO and TinyLlama for Real-Time Conversational Interaction

Research paper by Vitória Augusta Braga de Souza, published 2026. Research area: Speech and dialogue systems.

Vitória Augusta Braga de Souza

Not specifiedView resource

Research paper

Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling

Research paper by Haebin Shin and collaborators. Published 2025-03-24. Topics: Token-level Lexical Alignment, Teacher Guided Loss, VocAgnoLM, language modeling, student model.

Haebin Shin, Lei Ji, Xiao Liu, Yeyun Gong

CC BY 4.0View resource

Research paper

Prime Anchor: Solving Catastrophic Forgetting in GPT-2, TinyLlama, and Mistral via Spectral Topology and the Riemann Hypothesis

Research paper by Frank Morales, published 2026 in Zenodo (CERN European Organization for Nuclear Research). Research area: Domain Adaptation and Few-Shot Learning.

Frank Morales

Not specifiedView resource

Research paper

Prompt Injection and Data Leakage in Large Language Models: An Empirical Study on TinyLlama

Research paper by Jeet Vijaykumar Thakkar, published 2026 in Zenodo (CERN European Organization for Nuclear Research). Research area: Adversarial Robustness in Machine Learning.

Jeet Vijaykumar Thakkar

Not specifiedView resource

Research paper

SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models

Research paper by Peng Gao and collaborators. Published 2024-02-08. Topics: SPHINX-X, Multimodality Large Language Model, MLLM, visual encoders, skip tokens.

Peng Gao, Renrui Zhang, Chris Liu, Longtian Qiu, Siyuan Huang, Weifeng Lin, Shitian Zhao, Shijie Geng, Ziyi Lin, Peng Jin, Kaipeng Zhang, Wenqi Shao, Conghui He, Junjun He, Hao Shao, Pan Lu, Hongsheng Li, Yu Qiao

Not specifiedView resource

Research paper

TinyLlama: An Open-Source Small Language Model

Research paper by Peiyuan Zhang and collaborators. Published 2024-01-04. Topics: FlashAttention, Llama 2, TinyLlama, language model.

Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, Wei Lu

Not specifiedView resource

Research paper

When Life gives you LLMs, make LLM-ADE: Large Language Models with Adaptive Data Engineering

This paper presents the LLM-ADE framework, a novel methodology for continued pre-training of large language models (LLMs) that addresses the challenges of catastrophic forgetting and double descent. LLM-ADE employs dynamic architectural adjustments, including selective block freezing and expansion, tailored to specific datasets. This strategy enhances model adaptability to new data while preserving previously acquired knowledge. We demonstrate LLM-ADE's effectiveness on the TinyLlama model across various general knowledge benchmarks, showing significant performance improvements without the drawbacks of traditional continuous training methods.

Choi, Stephen, Gazeley, William

Creative Commons Attribution 4.0 InternationalView resource

Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.

Resources

No matching resources