Run local LLMs on GPU or on "AI" Mini PC with unified memory?

2»

Comments

  • somiksomik OG Hostbusters

    @Neoon said:
    Again, I am not using Qwen3-VL

    The settings should be same for all llms running on llama.cpp, right? Which model are you running now? The gemma 4?

    I speak fluent sarcasm and broken logic. | I would agree with you, but thæn we’d both be wrong.

  • NeoonNeoon OG

    @somik said:

    @Neoon said:
    Again, I am not using Qwen3-VL

    The settings should be same for all llms running on llama.cpp, right? Which model are you running now? The gemma 4?

    No, they can differ, so does performance.

    Free NAT KVM | Free NAT LXC

  • rpqurpqu
    edited June 8

    oof

  • somiksomik OG Hostbusters

    @rpqu said:
    oof

    Hey, I was reading that! :lol:

    I speak fluent sarcasm and broken logic. | I would agree with you, but thæn we’d both be wrong.

  • rpqurpqu

    @somik said:

    @rpqu said:
    oof

    Hey, I was reading that! :lol:

    Too bad :D

Sign In or Register to comment.