Saik0Shinigami

I don’t think this answers the question

They're specifically showing you that in the use case you asked about the assertions must change. Your question is bad for the case that you're specifically asking about.

So no, it doesn't answer the question... But your question has a bunch more caveats that must be accounted for that you're just straight up missing.

The two most common reasons I hear are 1) no trust in the companies hosting the tools to protect consumers and 2) rampant theft of IP to train LLM models.

My reason is that you can't trust the answers regardless. Hallucinations are a rampant problem. Even if we managed to cut it down to 1/100 query will hallucinate, you can't trust ANYTHING. We've seen well trained and targeted AIs that don't directly take user input (so can't be super manipulated) in google search results recommending that people put glue on their pizzas to make the cheese stick better... or that geologists recommend eating a rock a day.

If a custom tailored AI can't cut it... the general ones are not going to be all that valuable without significant external validation/moderation.

I started on cluster (8) of rpi3b and a Synology NAS 10 years ago... prior to that was just storing it all on random hdd (harddrive toaster was alway present and loaded on my desk) and on my computer. these days you can get those little intel n100 or n150 boxes for pretty cheap too. There's a lot of options, and a lot of mature software tech to make it all work well together.

So about that... I actually got solar installed on my house and when the "electrician" (subbed out contractor with dubious credentials but was operating under a legit company) ran dedicated breakers for the servers... the junction box caught fire.

That was a fun 2am to wake up at.

But it's pretty safe now. Have had several master electricians come in and evaluate it all at this point and all of them are happy with it now.

More or less exactly this. Most of my servers are company decommission (some companies have a strict upgrade cycle, and I even have like 3 more "spares" sitting around). I've found some government liquidation here and there as well which has been great for resale to recoup some of what I spend. I have something like 4TB of Ram sitting in a box somewhere that I should sell somewhere...

Some stuff was "decent" ebay buys. A few items I just had to pony up for. Battery backups was mostly paid at full msrp, but has been worth it. HDDs are mostly "refurb" and built up over time as well, which is why raidz2 and several spares in the zfs pool.

But yeah, about 10 years of building it up. I use it as my playground for professional development, and it's helped prove a lot of what I say on my resume.

When you have a functional setup like this, and can show that to potential employer. It's been the best sole investment I've ever made. It's netted me more money in contracts by many many times what I put into it.

Edit: and saved me from countless "cloud" privacy violations, data breaches, etc...

Edit2: Recurring costs is basically energy. The rack itself uses about 90kWh a day (about $5/day for me), cooling and all. My solar install creates just about that much per day as well so that's all offset (and if I ever move my equipment into a colo, my house will basically have no electric bill at all). Internet is $165 a month, which is fucking great IMO... VPN is paid every 3 years or whatever that cycle is on. If I was to just take the non-replaceable stuff (about 20tb worth of data at last check, and a bunch of lxc containers) and put that on a VPS somewhere I'd be paying at least 10x what I do now in someone else's datacenter, forget that that's a recurring monthly cost.

Edit3: Just because it is likely useful information for SOMEONE out there... If you know that your setup takes 10kWh a day, you need to account for another %50 for cooling, so you should actually expect 15kWh in that usecase. My actual rack uses ~60... 30 more is cooling. I actually have all my power usages broken out in a sankey graph... Even goes further to break it down on a per server usage as well, but I can't take a reasonable screenshot that doesn't show personal information. This is 24 hours of usage (specifically 04/30, yesterday) and "garage dedicated" is what the A/C unit I have in the bottom of my rack is plugged into.

Fiber, 8gbps through Quantum Fiber (part of the Lumen/Centurylink family). No throttling here...

My bottleneck is the vpn that I have to have between me and the world... unfortunately. I only trust specific private trackers to not use it. I actually setup 4 seed boxes (VMs) in my garage to push more data out.

Proxmox cluster... and big storage truenas node.

And a dirty amount of networking... big cables on the right is QSFP, 40gbps 2x in lagg per server.

These pictures were just after a transplant to a new server rack. So everything is off... but the blinkin' lights are real.

Edit: Didn't turn off anything before I ran these...

Heh... I'm actually rewatching Dragon Ball right now.

Let's just say that I do my part seeding Linux ISOs.

~72 TB uploaded the past 30 days.

I am unfortunately the epitome of a data hoarder. I still have files that I generated/created 30 years ago...

Check again...

That's "free space". The 414 represents ~62% of my space (38% used). I'm at just under 700 for usable space. And 2 disks are out of the array at the moment because the backplane went stupid. Turns out that it's a pain in the ass to open server chassis to replace a backplane when you have to unmount 70 disks. And I'm pretty lazy.

6 x RAIDZ2 | 10 wide | 14.55 TiB
873TiB raw.
960TB raw.

This graph might be better...

I'm personally downvoting because it's also an issue in windows as well. So it's completely incorrect and unfair to complain that linux is "less stable" when the same exact issue is a problem on windows...

https://www.spacebar.news/windows-pc-sleep-broken/

It's been an issue for years. And I'd argue that windows supporting this "new" shit standard probably makes new laptops suck for linux as well as vendors rip out older sleep states that linux uses that modern windows doesn't.

As do I.. had a coworker message me about using adobe to merge/split pdfs... rather than walking them through the adobe workflow, just linked them right to the url... It's so easy to use that I didn't have to say anything more. they got it in seconds that would have taken me minutes of back and forth to explain to them.

It's great. Simple tools for simple purpose.