• User-Agent-Strings (1 bis 5 / 5)

    Add User-Agent-String

    24684   (anonymous, 9/5/2008 3:39:02 PM via Ubiquity-Command)
    EditDelete
    IP-Adresses
    IRLbot/2.0 ( http://irl.cs.tamu.edu/crawler)
    16163   (kristof, 3/7/2008 4:02:47 AM via Web-Service, SOAP)
    EditDelete
    IP-Adresses
    IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler/)
    247   (kristof, 11/16/2006 2:57:28 PM)
    EditDelete
    IP-Adresses
    IRLbot/2.0 (+http://irl.cs.tamu.edu/crawler)
    248   (kristof, 11/16/2006 2:57:28 PM)
    EditDelete
    IP-Adresses
    IRLbot/2.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
    7560   (kristof, 7/19/2007 9:46:26 AM)
    EditDelete
    IP-Adresses
    IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
 

  • Comments (1 to 1 / 1)

    Kristof Zerbe
    kristof
    Friday, 05.09.2008 15:48
    IRLbot is a Texas A&M research project that investigates algorithms for mapping the topology of the Internet and discovering the various parts of the web. The crawler downloads random web pages (text only) and follows certain links to find other websites.