both crawling and displaying web pages. as of april , wayback is ignoring robots.txt more broadly, not just for u.s. government websites. [ ] [ ] [ ] [ ] uses[ edit ] from its public launch in , the wayback machine has been studied by scholars both for the ways it stores and collects data as well as...