minus-squareShitpostCentral@lemmy.worldtoTechnology@lemmy.world•AI companies are violating a basic social contract of the web and and ignoring robots.txtlinkfedilinkEnglisharrow-up0·9 months agoYou’re second point is a good one, but you absolutely can log the IP which requested robots.txt. That’s just a standard part of any http server ever, no JavaScript needed. linkfedilink
minus-squareShitpostCentral@lemmy.worldOPtoPiracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com•How does Usenet content not immediately get DMCA'd into oblivion?linkfedilinkEnglisharrow-up0·10 months agoThis makes perfect sense. Thank you! linkfedilink
ShitpostCentral@lemmy.world to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 10 months agoHow does Usenet content not immediately get DMCA'd into oblivion?plus-squaremessage-squaremessage-square26fedilinkarrow-up10arrow-down10
arrow-up10arrow-down1message-squareHow does Usenet content not immediately get DMCA'd into oblivion?plus-squareShitpostCentral@lemmy.world to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 10 months agomessage-square26fedilink
You’re second point is a good one, but you absolutely can log the IP which requested robots.txt. That’s just a standard part of any http server ever, no JavaScript needed.