I thought of a weekly thread to post about what you set up lately, what kind of problems you currently think about or are running into, what new device you added to your homelab or what interesting service or article you read.

So I decided to just try it. Maybe we find a format that works! It doesn’t have to be me, feel free to create this post on Sunday if it’s not up already.

  • @rutrumAEnglish
    2•4 hours ago

    I replaced my tabbyml code assistant this week with ollama+continue.dev. But I’m having issues with speed. I think this is because I switched from code qwen 2.5B (ish) to Deepeek Coder 9B (ish) and I think I’m pushing the limits of my GPU. Maybe I’ll spend today sorting out which models I want to use and which computers I want to use them on so I dont run into this issue (I’ve got ollama on 2 computers with 3 GPUs shared between them, for a total of 24GB VRAM)