In the early years of modern neural language models, the dominant strategy for improving artificial intelligence systems was simple: provide the model with more data, larger context windows, and increasingly complex architectures. Transformers, first introduced in 2017, quickly became the backbone of natural language processing systems because of their ability to evaluate relationships between every…