5,334,782 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

Research papers

Publications about AI methods and applications.

How to use the library

Resources

Search results
Search stays within research papers.
Research paper

SSM-Aware Fine-Tuning for Hybrid Mamba-Transformer Models: A Comparative Study on Granite 4.0-H-Micro

We present a systematic study of LoRA fine-tuning strategies for IBM Granite 4.0-H-Micro, a 3.2B-parameter hybrid architecture comprising 36 Mamba-2 state space layers and 4 Transformer attention layers. We evaluate four fine-tuning approaches against an unmodified baseline across three domain-specific tasks: document classification (24K examples), schema mapping (15K examples), and structured rule generation (9K examples). Our investigation proceeds in two stages. First, we find that co-training LoRA adapters with unfrozen SSM core parameters (A_log, D, dt_bias) yields consistent improvements across all tasks (V3). However, PEFT's adapter-on

Cody, Ford
Creative Commons Attribution 4.0 InternationalView resource

Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.