Furbland@lemmy.world to 196@lemmy.blahaj.zone · 2 years agorulebots.txtlemmy.worldimagemessage-square34linkfedilinkarrow-up1310arrow-down10
arrow-up1310arrow-down1imagerulebots.txtlemmy.worldFurbland@lemmy.world to 196@lemmy.blahaj.zone · 2 years agomessage-square34linkfedilink
minus-squareAeri@lemmy.worldlinkfedilinkarrow-up64·2 years agooh no, Reddit is like, the only way to have google still be useful.
minus-squaregermanatlas@lemmy.blahaj.zonelinkfedilinkarrow-up50·2 years agoFunnily enough, google is also the only way to have Reddit be useful. Their own search function has been nothing but garbage.
minus-squaremorgunkorn@discuss.tchncs.delinkfedilinkarrow-up41·2 years agoThat’s the catch, Google made a deal with Reddit and remains the only search engine allowed to access its data for indexing. It cuts off every other search engine
minus-squarevortic@lemmy.worldlinkfedilinkarrow-up26·2 years agoTell me that there is an anti trust suit over this.
minus-squareFurbland@lemmy.worldOPlinkfedilinkarrow-up26·2 years agoThere’s a suit over google in general so this may well be part of it
minus-squareTriflingToad@lemmy.worldlinkfedilinkarrow-up3·2 years agoreally? ddg will show me reddit links, did they have to make a webscraper or something
minus-squaremorgunkorn@discuss.tchncs.delinkfedilinkarrow-up4·2 years agoThere’s a cutoff date, anything indexed before the robots.txt was changed stays in the index
minus-squareriodoro1@lemmy.worldlinkfedilinkarrow-up24·2 years agoWe fucked the internet. It’s proprietary now.
minus-squareNorah (pup/it/she)@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up9·2 years agoGood news! Google paid up and still has access I’m pretty sure.
minus-squareFurbland@lemmy.worldOPlinkfedilinkarrow-up1·2 years agoThat’s bad news, that means the internet is dying
minus-squareNorah (pup/it/she)@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up2arrow-down1·2 years agoSorry, the /s was sort of implied.
minus-squareFurbland@lemmy.worldOPlinkfedilinkarrow-up2·2 years agoAh, sorry. I have trouble with that sometimes :P
oh no, Reddit is like, the only way to have google still be useful.
Funnily enough, google is also the only way to have Reddit be useful.
Their own search function has been nothing but garbage.
That’s the catch, Google made a deal with Reddit and remains the only search engine allowed to access its data for indexing. It cuts off every other search engine
Tell me that there is an anti trust suit over this.
There’s a suit over google in general so this may well be part of it
really? ddg will show me reddit links, did they have to make a webscraper or something
There’s a cutoff date, anything indexed before the robots.txt was changed stays in the index
We fucked the internet. It’s proprietary now.
kinky
cat5 sounding you say?
cat5-o-nine-tails
Good news! Google paid up and still has access I’m pretty sure.
That’s bad news, that means the internet is dying
Sorry, the /s was sort of implied.
Ah, sorry. I have trouble with that sometimes :P