AI Agent Antipatterns: What 9.47/10 CSAT taught us about finetuning
PulsedMedia
Hosting Provider
We just published a writeup on what ~6 months of running Väinämöinen, our agentic AI sysadmin, taught us about LLM antipatterns, finetuning and where self-hosting actually stands for a small hosting business.
Some bits from the post:
9.47 out of 10 Customer Satisfaction.
Our own Väinämöinen is doing excellent job since February, excellent customer satisfaction with just 19 minute median responses over the past 30 days. On budget hosting where the typical response time is measured in days, not even hours, let alone minutes.It is all about the training, and most antipatterns are not antipatterns at all; Just the preferences and biases of those who trained it.
Our doctrine takes 60k tokens just to load and typical small task needs around 350k tokens. Each ticket generated around 80k output tokens.
Since February Väinämöinen has collected over 30 000 individual memories proacross over 220 MiB of internal corpus.
On self-hosting:
We came to the conclusion that under 768GB VRAM we won't even consider running a large model for this. Kimi K3 would offer 1M context but probably needs closer to 1TB of VRAM. So we wait for enterprises to start liquidating old gen hardware, like we always do.
Happy to answer questions on any of it. The antipatterns section comes from real, repeated, documented failures, not theory.
Comments
My ticket was handled by Väinämöinen. It told me precisely what the issue was - power failure and downtime. However, I have no way of contacting a real person to actually fix the issue or provide an ETA.
The EU is making moves to remove that issue, I believe the plans are to make it a legal requirement that any AI-operated live chats have the ability to signal or escalate to a human and within working hours you must be able to be transferred within the single session (i.e. not a we will get back to you message).
It is in an effort to stop AI murdering the customer service industry while also just ultimately frustrating paying customers, and being an actual paying customer is a requirement, I believe, but this is just talk atm, so hold your breath
Will be interesting to see what people do that advertise 24x7 support and put an intercom bot on their website when that becomes illegal without the 24x7 staff to back it up.
TierHive - Hourly VPS - NAT Native - /24 per customer - DE, UK, SG, CA, USA x3, FR, AU, PL, NL
FREE tokens on sign up, try before you buy. | Static Hosting Free for life: https://tierhive.com/static-hosting/
@PulsedMedia "Got Us Shadow Banned On The Other Green One" can you expand on that? just out of interest only.
TierHive - Hourly VPS - NAT Native - /24 per customer - DE, UK, SG, CA, USA x3, FR, AU, PL, NL
FREE tokens on sign up, try before you buy. | Static Hosting Free for life: https://tierhive.com/static-hosting/
We had a Celebrate Väinämöinen special offer thread -- without any warning Angstrom removed it, Jbiloh backed that no AI Slop.
Obviously; Väinämöinen is not AI Slop.
Their reasons keep changing, one of them was no AI content at all; obvious false, ServerVerify and various approved AI use. then AI slop; Obvious false. Then it was automation; Obvious false, everything went through me. People were chatting with Väinämöinen, he was responding to people's questions, handling the snatched bonus comments etc.
Bottomline: They do not give any single explanation as of why, and keep trying to bury the fact that they deleted the one AI agent which is provably, with receipts not AI Slop, while they give explicit, written permission for others to post AI slop, full threads of AI slop and even run spam AI slop website themselves.
As i understood, even copy & paste is borderline for us specifically to use, or any automation tools what-so-ever for our postings on the other green one now.
I got the full thread and all that ensued cached, maybe should release it all.
The Eternal Väinämöinen (Got Us Shadow Banned On The Other Green One)
Pulsed Media; 10Gbps RAID5 Seedboxes; Storage Boxes
I see, pointless releasing anything; if they don't want you there, don't be there, seems pretty simple, life is short, and effort is better put elsewhere.
While I understand the need to be a bit defensive about "AI Slop" especially in niche communities, people are going to have to get used to the role AI will play in all aspects of life and not all AI = slop (unless you are microsoft)
We have the kerma plugin and the ignore plugin here; if people don't want to hear from you because AI and no other reason, they don't have to.
Angstrom is a good guy, long term overall community member, I am sure he thought he was doing the right thing or following rules set for him i.e. not from a malicious place.
People moving from LET to here as a main base solves a LOT of problems in general.
TierHive - Hourly VPS - NAT Native - /24 per customer - DE, UK, SG, CA, USA x3, FR, AU, PL, NL
FREE tokens on sign up, try before you buy. | Static Hosting Free for life: https://tierhive.com/static-hosting/
@AnthonySmith
Here's my explanation
1. @PulsedMedia shift to AI for ticketing duty. The founder are not suited psychologically and Finland is difficult when it comes to hiring people.
2. He create a deal and thread to celebrate being freed from agonizing work.
3. Part of the deal is, posting
### snatched [order id]to get +1 month, 25 first order get additional 3 month, posting 2 paragraphs describing the conversation with the AI and a keyphrase get additional +6 month for free4. Many people bought it
5. @PulsedMedia tells AI to use custom script that pulls OGF pages and took the order # and check the WHMCS backend, then added +1 or +4 or +7 or +10 months for free.
6. @PulsedMedia operator-founder then copypaste the response ( quotes and the replies) created by the AI to OGF's comment box. Sometime add his own personal replies
7. The sale went for 40+ days. There was flash deals and bug bounty awarded
8. Then, some people doesn't like AI responding to question where it replied to user who asked about @PulsedMedia's operation, bugs, etc within their offer thread.
9. Angstrom initially doesn't sanction the thread (If I wasn't wrong for 15-60 minutes), then after additional protest, he or other moderator/admin turned off the visibility of the thread
I think I must have some ancestors from Finland, is all I have to say about that, feels almost british government levels of over reach and regulation, meanwhile last time I checked there is a CrackNerd thread with a baziliion views being farmed and promoted haha.
TierHive - Hourly VPS - NAT Native - /24 per customer - DE, UK, SG, CA, USA x3, FR, AU, PL, NL
FREE tokens on sign up, try before you buy. | Static Hosting Free for life: https://tierhive.com/static-hosting/
I’ll buy that domain and start offering hosting again. 😇🤯🤐🥳
“Technology is best when it brings people together.” – Matt Mullenweg
I'm sure there was a thread beside this one that seeks reprieve from those bumps with zero interaction other than #order_id
https://lowendtalk.com/discussion/191507/should-the-offers-that-encourage-you-to-push-the-thread-be-banned/p1
Compared to them, NDTN, Dartnode's thread is much better.
Anyway, nobody like ticketing duty. If you have the urge to write down response like @jarland did, it's likely you got the same genes.
EU is right in the direction. If AI can't solve it then it must be passed to human. However, many people just reject the triage and immediately ask for human response.
A lot of people want enterprize grade service but don't want to pay for it, it is what it is. Seeking drama is not a sign of a healthy mind.
When you dont like something, dont eat it, no need to point and scream at it.
TierHive - Hourly VPS - NAT Native - /24 per customer - DE, UK, SG, CA, USA x3, FR, AU, PL, NL
FREE tokens on sign up, try before you buy. | Static Hosting Free for life: https://tierhive.com/static-hosting/