Are new LLM models trained on old benchmarks?

by rand0mwalk on 6/22/2024, 3:45:44 AM with 0 comments
When training new LLMs, does data from benchmarks like MMLU make it into the training data (either questions from the benchmark or related discussion)? If so, are these benchmarks still helpful for evaluating models trained after their publication?