Models & Infrastructure

LongLLaMa

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method. - CStanKonrad/long_llama