havoc
havoc
About
- Username
- havoc
- Joined
- Visits
- 2,894
- Last Active
- Roles
- Member, OG, Content Writer, Senpai
- Thanked
- 1353
Comments
-
Hold my beer while I hotswap a CPU
-
(Quote) > # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## #> # Yet-Another-Bench-Script #> # v2025-04-20 #> # https://github.com/masonr/yet-another-bench-script #> …
-
(Quote) On openrouter you can sort by price and set limit to zero. There is usually a surprisingly large range of free ones that is API enabled. For paid it's worth taking a closer look at their caching strategy too. e.g. DeepS caches till bytes th…
-
@Encoders Arch. I've got cuda in containers working. Current issue is something more pedestrian. Somehow it's not happy with the DB it's trying to create. Thinking I'll just do inference and anythingllm on separate machines. Guess I'd lose GPU acc…
-
Tried that ahead of docker. :/ On that the fault is likely with my system though. Arch/Hyprland/Wayland...so doesn't seem to play nice with GTK. I'll figure it out eventually. Or just stick it on a VM/LXC
-
(Quote) Meant the AnythingLLM part. Tried both the docker run off their site and messed around with docker compose. May have something to do with me using podman instead of docker though. Serving models part I've got covered pretty well.
-
Anybody having luck on linux? Neither the appimage nor docker launch for me
-
Sorry if I derailed your AI+documents a bit there.. To clarify I'm looking for local AI, but one that benefits from doing a search to integrate info and ideally add links. e.g. This piece of LLM response contains links to huggingface (Image) I t…
-
Anybody got any good results on ways to integrate search? Finding myself leaning more & more on online AIs because LLM+Search is better for most of my tech research than either search or LLM separately. So far Brave API and SearXNG seem like b…
-
Haven't yet, but have been watching discussions on it. Best as I can tell iPhone gang in selfhosted space is going for an app called PhotoSync, which has a 6 bucks lifetime tier of some sort to enable more features. Haven't explored it yet, but tha…
-
Decided to build custom scripts that simulate real proxmox tasks. Want to set up tuned ZFS volumes for each so don't think i'll get around real world tasks. So far LXC testing looks like this: Created container in seconds:4.04Started container in s…
-
(Quote) Oh that looks promising. Got an error on trying to compile it. /* Counters */int files_created; /* number of files created */int files_deleted; /* number of files deleted */int files_read; /* number of files read */int files_appended;…
-
P1600X optane drive fio Disk Speed Tests (Mixed R/W 50/50) (Partition /dev/mapper/p1600x-vm--105--disk--0):---------------------------------Block Size | 4k (IOPS) | 64k (IOPS) ------ | --- ---- | ---- -…
-
(Quote) They're all different things. Haven't found a nice diagram that has an overview, but best as I can tell it's like this: Neural network (broad overarching category) * Graph neural nets --> The recommendations somik listed * LLMs (but eve…
-
(Quote) Well sometimes it takes me two tries to figure out whether the script needs to start with #! or !# but yes absolute bash master right here
-
(Quote) Alas I don't think I'm impressing you lot with my janky homeserver. But yeah basically want something that feels snappy for real world homelab proxmox use. So if I'm gonna spend a bunch of time tuning may as well try to measure the right me…
-
Deepseek claims they're profitable, so while there is lots of free VC money shenanigans going on I don't think it's true across the board. That said...deepseek is in China...who knows what sort of indirect subsidies (elec price etc) they didn't cou…
-
(Quote) Now I just need 20 grand worth of GPUs to run it...
-
(Quote) Yeah should be fine though you'd need to quantize it a bit to make space for context. I'd probably do qwen3 models. Either dense one or you can try the MoEs 32B and put it on system mem partially. Will still be fast given low activations in …
-
(Quote) Good tip! Thanks.
-
(Quote) Keep forgetting they don't just help themselves to my wallet...
-
They just charged me a late payment fee :(
-
Kinda curious which country moves fastest to adapt to this entire change. Clearly the genie is not going back in the bottle so we're going have sizable chunks of professions that are going to need a plan B. And not sure how flexible the average ~45 …
-
(Quote) #!/bin/bashapt install build-essential make cmake libcurl4-openssl-dev curl python3-pip pkg-config libopenblas-dev gitgit clone https://github.com/ggml-org/llama.cppcd llama.cpp/cmake -B build -DGGML_BLAS=ON -DGGML_BLAS_VENDOR=OpenBLAScmake …
-
More impressed that someone found a CPU with a sample size of one passmark: (Image)