Halve of the scheduled trains didn’t run today in Belgium.

Only half were cancelled? Man, that sounds nice.

Really? When I was trying to get it to run a little while ago, I kept running out of memory with my 3060 12GB running 20B models, but prehaps I had it configured wrong.

For most of the good LLM models its going to take a high-end computer with a top of the line GPU. For image generation, a more mid-range gaming computer works just fine.

Edit: correction. You don’t necessary need a good GPU specifically