Many assumptions, like just assuming our electricity comes from a fossil fuel source. Mine does not. Nuclear and Hydro in majority. Therefore 0 emissions regardless of model.
I guess they only tested 70B or 8B? Nothing in between?
Who even runs 70B anyway? Your common option of 2 gpus of 16GB each slots you into 32B nicely.
Many assumptions, like just assuming our electricity comes from a fossil fuel source. Mine does not. Nuclear and Hydro in majority. Therefore 0 emissions regardless of model.
I guess they only tested 70B or 8B? Nothing in between?
Who even runs 70B anyway? Your common option of 2 gpus of 16GB each slots you into 32B nicely.
Llama 3.3 70B is suspiciously low.