Selfhosted

60093 readers

758 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam.
Posts here are to be centered around self-hosting. Please ensure it is clear in your post how it relates to self-hosting.
Don't duplicate the full text of your blog or git here. Just post the link for folks to click.
Submission headline should match the article title.
No trolling.
Promotion posts require your active participation in selfhosting or related communities, or the post will be removed. No more than 10% of your posts or comments may be self-promotional, or your post will be removed. F/LOSS Exception: If your post is about a project that is completely open source & can be self-hosted in full without payment, your post is exempt from this rule as long as you continue to engage in comments.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

Are ISPs responsible for bots having residential IPs or is this a user problem? (lemmy.world)

submitted 2 days ago by Maroon@lemmy.world to c/selfhosted@lemmy.world

42 comments fedilink hide all child comments

I'm trying to understand the bot problem in the internet and finding more ways to defend myself. One thing that I can't seem to understand is why most bots, scrapers and crawlers seem to have residential IPs.

Is it that ISPs are being paid by tech-bros to assign them these IPs?
Is it that residential devices have been hacked /contain malware that does this?
Is it trivial for companies to assign themselves residential IPs?
Paid volunteers are doing this for AI companies?

Or is there is some other reason for this?

Obviously this is a problem because one can rotate / cycle through residential IPs and if I aggressively block each offender in my logs permanently, then the next person assigned this IP who may be a legitimate user will be unable to access my site.

you are viewing a single comment's thread
view the rest of the comments

[–] Mordikan@kbin.earth 8 points 2 days ago (1 children)

You mention crappy security practices from the ISP but then mention the user's action (installing "free" VPNs). Why is the ISP on the hook for the user making terrible decisions?

What is the correct security practice in that instance? Fire the customer for being an idiot? Maybe just DENY IP ANY ANY on outbound traffic?

How do you protect somebody who is intent on running themselves off a cliff?

[–] 0x0@lemmy.zip 1 points 2 days ago* (last edited 2 days ago)

I mention two separate issues.

ISPs are absolutely on the hook for forcing crap hardware onto (non technical) users.

Users are to blame for installing crapware.

Can you tell them apart now?

ISPs should be held liable for the crap they sell – they'd start taking security seriously.

As for users, depends on the motives, but educating them to the risks (and not in a you wouldn't download a car way).