Models · TheAIGRID ·
The First Real LLM Breakthrough Is Here... SubQ (1000x Less Compute)
SubQ announced a new approach for long-context LLMs, claiming up to 12 million token context and much lower compute than standard transformer attention. The post says the method, called SubQ 1.1 Small, is designed to reduce the cost of handling long sequences.