Somebody send a gift basket to the Skype CEO, he's not doing so well.
Bishma
My experience is with systems that handle nearly 1000 pageviews per second. We did use a spread of haproxy servers to handle routing and SNI, but they were being fed offender lists by external analysis tools (built in-house).
Most often because they don't download any of the css of external js files from the pages they scrape. But there are a lot of other patterns you can detect once you have their traffic logs loaded in a time series database. I used an ELK stack back in the day.
When I was serving high volume sites (that were targeted by scrapers) I had a collection of files in CDN that contained nothing but the word "no" over and over. Scrapers who barely hit our detection thresholds saw all their requests go to the 50M version. Super aggressive scrapers got the 10G version. And the scripts that just wouldn't stop got the 50G version.
It didn't move the needle on budget, but hopefully it cost them.
"Significantly better than ChatGPT" and "Good" aren't the same. Like ipecac is significantly better to drink than sewage water.
I went long enough without using Google (probably a year-ish) that, when I accidentally made a Google search a few days ago, it was a jarring experience.
It felt wrong the same way other search engines did when I first deGoogled. It was kind of nice actually.
And they didn't do a heart with a banner in front of it that says "Mom"?
For the 12 hours it takes them to make that money back, their c-suites will be fuming.
I use Proxmox because its handy to be able to use both LXC containers and full VMs. I installed it as an ISO so its built on top of Debian. There are helper scripts specific to installing Home Assistant on a VM (as well as a number of other things). And the proxmox UI comes in handy.
I have Home Assistant in a VM so I can run it on top of HAOS. Then the rest of the box is set up as an unprivileged LXC where I installed docker. I run all my *ARR apps straight on my Synology (via docker) so they have fast access to my Library volume, and everything else running on the setup I just described. Then I use Portainer to maintain my containers so I can manage both the syno and proxmox docker installs from one page.
Not true at all. If you want to run Home Assistant on top of Home Assistant OS then it needs to be on bare metal or a full VM because its an OS. Running on HAOS is easy mode, but not required.

Shortened lives, hastened climate change, and stunted development is a small price to pay for being able to see a nude version of any photo posted to xitter.