• by inciampati on 2/3/2025, 5:54:04 PM

    Reasoning models from OpenAI forget what their past reasoning. The reasoning tokens are removed from context after the user-visible response is generated. It's not what I expected, given that memory of reasoning is the key to chain or thought's success.