Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 9 months agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square200fedilinkarrow-up11.09Karrow-down115cross-posted to: [email protected][email protected][email protected][email protected]
arrow-up11.08Karrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 9 months agomessage-square200fedilinkcross-posted to: [email protected][email protected][email protected][email protected]
minus-squarelily33@lemm.eelinkfedilinkEnglisharrow-up35arrow-down18·9 months agoWhat social contract? When sites regularly have a robots.txt that says “only Google may crawl”, and are effectively helping enforce a monolopy, that’s not a social contract I’d ever agree to.
minus-squareImgonnatrythis@sh.itjust.workslinkfedilinkEnglisharrow-up17·9 months agoI had a one-eared rabbit. He was a monolopy.
minus-squareAshelyn@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1arrow-down3·9 months agoSounds like a Pal name lol
minus-squareassassin_aragorn@lemmy.worldlinkfedilinkEnglisharrow-up2·9 months agoOnly if its model is a Lopunny missing an ear
minus-squareAshelyn@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·9 months agoI was thinking of a short lil bunny wearing a top hat and monocle with one ear sticking out of the center of the top hat but that works too
minus-squareCosmic Cleric@lemmy.worldlinkfedilinkEnglisharrow-up6arrow-down1·9 months ago When sites regularly have a robots.txt that says “only Google may crawl” Is that actually true? If so, why would they do that?
What social contract? When sites regularly have a
robots.txt
that says “only Google may crawl”, and are effectively helping enforce a monolopy, that’s not a social contract I’d ever agree to.I had a one-eared rabbit. He was a monolopy.
Sounds like a Pal name lol
Only if its model is a Lopunny missing an ear
I was thinking of a short lil bunny wearing a top hat and monocle with one ear sticking out of the center of the top hat but that works too
Is that actually true?
If so, why would they do that?