• User-Agent-Strings (1 bis 5 / 22)

    Add User-Agent-String



    115102   (df8fe, 8/31/2009 1:22:27 AM via XML-API)
    EditDelete
    IP-Adresses
    Mozilla/5.0 (compatible; heritrix/3.0.0-SNAPSHOT-20090828.180147 http://crawler.archive.org)

    64874   (drothe, 6/13/2009 12:11:25 PM via XML-API)
    EditDelete
    IP-Adresses
    Mozilla/5.0 (compatible; heritrix/1.14.1 http://www.cdlib.org/)

    54748   (drothe, 3/6/2009 10:19:29 AM via XML-API)
    EditDelete
    IP-Adresses
    Mozilla/5.0 (compatible; heritrix/2.0.1 http://annotate.de/)

    55033   (drothe, 3/9/2009 10:09:11 AM via XML-API)
    EditDelete
    IP-Adresses
    Mozilla/5.0 (compatible; heritrix1-10-0; http://www.webintegration.at)

    55498   (drothe, 3/12/2009 11:24:27 PM via XML-API)
    EditDelete
    IP-Adresses
    Mozilla/5.0 (compatible; heritrix/2.0.2 http://www.ellerdale.com/crawler.html)

 
  • Comments (1 to 5 / 1)

    Kristof Zerbe
    Friday, 16.11.2007 09:44
    Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.