Neoon

Back to Profile

Neoon

About

Username: Neoon
Joined: November 2019
Visits: 12,003
Last Active: 4:58PM
Roles: Member, OG, Content Writer, Senpai
Thanked: 4103

Turns out, you can launch 0.80€/m VM's on https://portal.gcore.com
Sadly MJJ discovered it first, so most of the stock is gone.

Right now you can get a VM in Dubai for 0.80€/m I…

Thanked by (1)xms
EnLighten mahNuts

Thanked by (1)ehab
I can fit Q4 on my 32gigs, Q6 is too tight.
Q6 fits easily on the 64gig idle dedi though.

Google just released a new gemma model, might be worth trying, just 12B so fits 16GB.

Thanked by (1)deafcon
> @Neoon said:
> Look mom, we are on TV
> https://point.free/blog/gemma-4-on-a-2016-xeon/

Actually, ik has a webinterface now.
github.com/ikawrakow/ik_ll…

Thanked by (1)deafcon
When South West?

Thanked by (1)Not_Oles
> @deafcon said:
> I don't have a KS-LE-B, but I do have a Xeon Gold 6212u with 80 gigs locally that is idle most of the time. Have you played with vision at all? Can it actually do an…

Thanked by (1)deafcon
To enable vision support, MPT and the recommended parameters, you can provide a config file for llama.cpp to load.
I copied the original of the subreddit, this is mine currently.
https:…

Thanked by (1)localhost
> @ehab said:
> > @Neoon said:
> > BS, if you wanna run something with 10t/s get a KS-LE-B.
> > Unified Memory isn't as fast as a RTX 6000 Blackwell.
…

Thanked by (1)ehab
> @AnthonySmith said:
> > @Neoon said:
> > big oof
> >
> > "when a client area user submits a request that includes an addonId parameter, WHMCS…

Thanked by (1)AnthonySmith
big oof

"when a client area user submits a request that includes an addonId parameter, WHMCS fails to verify whether that addon actually belongs to the requesting account. Swap in a di…

Thanked by (1)Nadwey
bro, do I really have to whitelist fkn modules, kurwa.

Thanked by (2)rpqu AnthonySmith
See, I have been setup for failure from the start.
I didn't try with BIOS / Seabios, these images where UEFI, fk me.

Thanked by (2)Not_Oles AnthonySmith
See, I couldn't replicate that wizzard magic of yours.
The problem seems to be the booting phase.

if I go below 200MB on boot, the VM fails to load into ramdisk.
Despite …

Thanked by (1)Not_Oles
> @Falzo said:
> > @Neoon said:
> > Funny, so people send out fishing emails when your domain is about to expire.
> > They look fake and cheap af.
>…

Thanked by (1)Falzo
> @Neoon said:
> > @WSS said:
> > Actually, you're kind of fucked with LXC/LXD now that I think about it. @Neoon whatcha doing? Just removing modules?
>
…

Thanked by (2)oloke WSS
> @WSS said:
> Actually, you're kind of fucked with LXC/LXD now that I think about it. @Neoon whatcha doing? Just removing modules?

Disabling them yes.

Thanked by (2)skorous WSS
Just a heads up.

I set Sandefjord, Helsinki and Meppel for new deployments, to KVM only.
A Buildserver for KVM templates will happen soonTM, so we can hopefully also offer 128MB…

Thanked by (5)ElonBezos Wonder_Woman oloke AnthonySmith flips
I got a VM with a provider on LET in Mevspace, it was okay so far.

Thanked by (2)AnthonySmith oloke
> @Neoon said:
> **Maintenance Announcement**
> We still got 4 nodes running LXD, that are yet not migrated.
> The plan is for the next weekend to migrate them to Inc…

Thanked by (3)host_c oloke bliss
> @havoc said:
> > @localhost said:
> > > @havoc said:
> > > On CPU using a MoE model is often a better better than dense since you’ve got lots of memo…

Thanked by (1)localhost
> @somik said:
> > @Neoon said:
> > I benchmarked the KS-MYSTERY with E5 and Xeon G and compared to the KS-LE-B.
> > Always benchmarked bare metal though, no…

Thanked by (1)localhost
> @somik said:
> > @Neoon said:
> > I benchmarked, the E5, E3 and Xeon G.
> > E5 was the worst, multi threaded.
>
> You benchmarked usin…

Thanked by (1)localhost
> @somik said:
> > @Neoon said:
> > > @localhost said:
> > >
> > > Got it working
> > >
> > > On E3-…

Thanked by (1)localhost
Most common models
https://huggingface.co/unsloth/collections
He quants all sorts of models, including uncensored ones.
https://huggingface.co/mradermacher
More uncensored…

Thanked by (1)localhost
Element deez nuts

Thanked by (2)ehab WSS
> @kekshost said:
> > @AnthonySmith said:
> > Nice, where in Germany is it?
> Falkenstein

Please don't tell me you are another Hetzner reseller.

Thanked by (2)SashkaPro yoursunny
ayo virmache is alive

/\_/\
( o.o )
> ^ <

Thanked by (1)Wonder_Woman
> @WSS said:
> > @Neoon said:
> > > @somik said:
> > > > @Neoon said:
> > > > > @havoc said:
> > > > > &…

Thanked by (1)WSS
> @FrankZ said:
> > @localhost said:
> > Whats best way to find iut the true location of a vps?
> >
> >
>
> Ask me or @N…

Thanked by (3)localhost FrankZ Wonder_Woman
I mean, sounds like a joke to me.
I had one VPS "suspended" like a few weeks ago.

I got accused to running DDoS, they only suspended IPv4 but not IPv6 neither the VPS itself.

Thanked by (1)host_c
**Relocation Announcement**
Our backend currently runs in AMS with Gigahost, Gigahost is gonna discontinue AMS on Wednesday morning.
Hence our backend gets physically moved to Norway, t…

Thanked by (1)Wonder_Woman
**Maintenance Announcement**
We still got 4 nodes running LXD, that are yet not migrated.
The plan is for the next weekend to migrate them to Incus plus a distro upgrade with a new kern…

Thanked by (1)Wonder_Woman
We had 6€/y Frankfurt, also a 12€/y Frankfurt on OGF with IPv4, the last week.

Thanked by (1)black444
So, you got one of these KS-LE-B and want to run some LLM models?
Smol short guide.

Grab the dependencies we need.
`apt-get install pciutils build-essential cmake curl li…

Thanked by (2)Not_Oles localhost