Running the Eval on My Own Silicon
The capstone: the full pipeline on a 4090+3090 pair — faster than two of three rented datacenter runs, for 68 cents of electricity. Plus the +17% environment variable and the wall that stopped a bigger model.
Tag
local-inference
1 post tagged local-inference.