☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 7 months agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square6linkfedilinkarrow-up132arrow-down10cross-posted to: news@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.socialtechnology@lemmy.zipnews@endlesstalk.org
arrow-up132arrow-down1external-linkReddit will block the Internet Archivewww.theverge.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 7 months agomessage-square6linkfedilinkcross-posted to: news@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.socialtechnology@lemmy.zipnews@endlesstalk.org
minus-squareLargeAdultRedBook [none/use name]@hexbear.netlinkfedilinkEnglisharrow-up1·7 months agoHow so? Do archive services not also archive content from linked CDNs?
minus-squareThermonuclearEgg@hexbear.netlinkfedilinkEnglisharrow-up2·7 months agoMaybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively
How so? Do archive services not also archive content from linked CDNs?
Maybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively