Project Strawberry at OpenAI, Mixture of a million experts, NeedleBench: Evaluating a million token context, scaling to a trillion-token datastore for retrieval, Qwen 2 tech report
AI Research Roundup 24.07.19 - Scaling
Project Strawberry at OpenAI, Mixture of a million experts, NeedleBench: Evaluating a million token context, scaling to a trillion-token datastore for retrieval, Qwen 2 tech report