John_Q_Developer
John_Q_Developer
My Blog
About
- Username
- John_Q_Developer
- Joined
- Visits
- 43
- Last Active
- Roles
- Member
- Thanked
- 5
Comments
-
(Quote) Pretty sure he is trying to advertise or create an opportunity to adverise his tools and isn't getting the kind of responses he wanted.
-
I agree the Ignore User feature is useful for ignoring spammy-hosts and allows for self-moderation. So its an improvement. My understanding of the rules is anyone can post a freebie (i.e. beta-testing some software). That correct?
-
(Quote) Switch to ipv6 only.
-
Sorry, bought after a couple days with no one responding.
-
Thanks for the guide :) I won't use it personally (I think LocalLLMs don't have the performance/benefit ratio yet without multiple GPUs as I've said elsewhere) but I'm sure people who are local llm curious will :)
-
The basic issue is you need multiple GPUs to run at usable (i.e. as fast as you can track the results) speeds for local AI. Inference is the domain of datacenters and servers right now. Not worth it to run locally unless you really need the privacy…