Researchers at MIT's CSAIL published a design for Recursive Language Models (RLM), a technique for improving LLM performance on long-context tasks. RLMs use a programming environment to recursively ...
Abstract: This paper presents a novel adaptive moving window forgetting factor method specifically designed for the decoupled recursive least squares approach applied to the second-order equivalent ...