In my opinion and based on my limited knowledge not being a lawyer, moderating is not equal to publishing. Deleting illegal material is not publishing. At least that is how I will move forward on my little semi-private and private forums until my lawyers advise me otherwise.
Or Waymo going into an active crime scene, loads of cop cars, guns drawn? [1] Cops yelling to get away and instead Waymo pulls over closer to the crime scene causing the passengers to panic.
Do git clients support HTTP/2.0 yet? Or could they use SSH? I ask because I block most of the bots by requiring HTTP/2.0 even on my silliest of throw-away sites. I agree their caching method is good and should be done when much of the content is cachable. Blocking specific IP's is a never-ending game of whack-a-mole. I do block some data-centers ASN's as I do not expect real people to come from them even though they could. It's an acceptable trade-off for my junk. There are many things people can learn from capturing TCP SYN packets for a day and comparing to access logs sorting out bots vs legit people. There are quite a few headers that a browser will send that most bots do not. Many bots also lack sending a valid TCP MSS and TCP WINDOW.
Anyway, test some scrapers and bots here [1] and let me know if they get through. A successful response will show "Can your bot see this? If so you win 10 bot points." and a figlet banner. Read-only SFTP login is "mirror" and no pw.
[Edit] - I should add that I require bots to tell me they speak English optionally in addition to other languages but not a couple that are blocked, e.g. en,de-DE,de good, de-DE,de will fail, because. Not suggesting anyone do this.
It's of course optional to block whatever one finds appropriate for their use case. My hobby stuff is not revenue generating so I have more options at my disposal.
Those with revenue generating systems should capture TCP SYN traffic for while, monitor access logs and give it that college try to correlate bots vs legit users with traffic characteristics. Sometimes generalizations can be derived from the correlation and some of those generalizations can be permitted or denied. There really isn't a one size fits all solution but hopefully my example can give ideas in additional directions to go. Git repos are probably the hardest to protect since I presume many of the git libraries and tools are using older protocols and may look a lot like bots. If one could get people to clone/commit with SSH there are additional protections that can be utilized at that layer.
[Edit] Other options lay outside of ones network such as either doing pull requests for or making feature requests for the maintainers of the git libraries so that HTTP requests look a lot more like a real browser to stand out from 99% of the bots. The vast majority of bots use really old libraries.
Here [1] is the zero knowledge solution. It has existed for ages but not adopted likely due to not providing a name, SSN, location and credit card. No third parties, no dependency on CDN's, no sharing or leaking ... anything.
Given that solution is unlikely to be legislated into action I would suggest people are just going to share adult content on Usenet, Tor, P2P, within G/PG rated video games by plonking down a virtual theater and streaming from a throw-away VM and fully automating syncing with LFTP+mirror+SFTP, sharing USB NVME drives, mobile ephemeral websites over WiFi and other methods when people get tired of this Top/Bottom relationship lobbyists want us to participate in. As a plus side, driving people underground means zero tracking, rules, taxes, obligations, leaking email addresses, etc...
Fungus is very much alive and to meet peoples caloric requirements means massacring hundreds of trillions of them. We just can't easily hear them scream. They communicate with one another over massive fungal networks in forests and jungles. Fungus are fascinating. They can recognize patterns and make decisions. Slime mold is even more interesting in that it can remember complex patterns, solve mapping challenges and make decisions without a nervous system suggesting our understanding of the term life is likely very incomplete. Slime mold can remember feeding times and locations.
We're only massacring the fruiting bodies. The mycelium is just fine and lives on to create even more fruiting bodies. It's like picking apples from an apple tree. The tree itself isn't harmed in the slightest. The only difference is that many fruits are designed to be eaten so that the seeds can pass an germinate, whereas mushrooms achieve this through spore release.
For some of these fungal meat-substitute products, I think you do eat the mycelia (for bystanders, the fruiting body we eat is mushrooms). But I don't think the fungus is bothered about it the same way the chicken is.
I feel like this might have been shown in the 2019 documentary 'Fantastic Fungi' (https://www.imdb.com/title/tt8258074/) - really interesting and fun movie.
Appropriate example, more than some may realize. Walt Disney and Adolf Hitler were good friends. Walt would send him a real of cartoons every month. Adolf and his senior leaders would watch it at the resort in the Alps. One may still be able to find the silent films that one of his mistresses filmed showing them watching cartoons on the projector with his senior leaders. Adolf was big into art and appreciated the work Disney created. There was a project about 15 or so years ago to use computing power to figure out what Adolf was saying based on his muscle movements since she was filming from behind him at an angle. I can't remember what the project was called. I saw it on a TV program.
reply