Crawler

Results: 444



#Item
191World Wide Web / Uniform resource identifier / Uniform resource locator / Robots exclusion standard / Port / Sitemaps / Web crawlers / Information science / Computing

Mercator: A Scalable, Extensible Web Crawler Allan Heydon and Marc Najork Compaq Systems Research Center 130 Lytton Ave. Palo Alto, CA 94301 {heydon,najork}@pa.dec.com

Add to Reading List

Source URL: www.cs.ucr.edu

Language: English - Date: 2006-09-08 22:19:53
192Web crawler / Prototype / Technology / Intellectual property law / Patent law / Royalties

FINANCE AND PROCUREMENT SERVICE Thessaloniki, 3 September 2014 OPEN INVITATION TO TENDER

Add to Reading List

Source URL: www.cedefop.europa.eu

Language: English - Date: 2014-11-04 07:14:13
193Synchronize It / Poisson process / Database / Database management systems / Statistics / Web crawler

Effective Page Refresh Policies For Web Crawlers JUNGHOO CHO University of California, Los Angeles and HECTOR GARCIA-MOLINA Stanford University

Add to Reading List

Source URL: oak.cs.ucla.edu

Language: English - Date: 2004-02-02 18:42:51
194Search engine optimization / Web design / Data mining / Information retrieval / Cluster chemistry / Cluster analysis / Web crawler / Site map / World Wide Web / Statistics / Computing / Information science

On the Evolution of Clusters of Near-Duplicate Web Pages Dennis Fetterly Microsoft Research 1065 La Avenida Mountain View, CA[removed]removed]

Add to Reading List

Source URL: research.microsoft.com

Language: English - Date: 2009-07-21 20:59:58
195Search engine technology / Search engine indexing / Invisible Web / Web search engine / Web search query / Search engine / Web query classification / Sitemaps / Google Search / Information science / Information retrieval / Web crawler

Web Search Engines: Practice and Experience Tao Yang, University of California at Santa Barbara Apostolos Gerasoulis, Rutgers University 1

Add to Reading List

Source URL: www.cs.ucsb.edu

Language: English - Date: 2014-06-02 10:21:25
196Oracle Database / Oracle Ultra Search / Oracle RAC / Web crawler / Oracle Application Server / Oracle Enterprise Manager / Software / Computing / Oracle Corporation

Oracle Ultra Search Administrator’s Guide

Add to Reading List

Source URL: docs.oracle.com

Language: English - Date: 2014-11-22 05:06:57
197World Wide Web / Internet / Information retrieval / Robots exclusion standard / Web search engine / United States House of Representatives Page / Distributed web crawling / Information science / Web crawlers / Computing

An Adaptive Model for Optimizing Performance of an Incremental Web Crawler Jenny Edwards 

Add to Reading List

Source URL: www10.org

Language: English - Date: 2001-03-23 05:17:32
198Web crawlers / Networks / Social networks / Copying mechanism / Barabási–Albert model / Network topology / Semantic similarity / Cluster analysis / Focused crawler / Graph theory / Statistics / Mathematics

Growing and navigating the small world Web by local content Filippo Menczer† Department of Management Sciences, University of Iowa, Iowa City, IA[removed]Edited by Elwyn R. Berlekamp, University of California, Berkeley,

Add to Reading List

Source URL: snap.stanford.edu

Language: English - Date: 2011-12-04 14:11:42
199Information science / Web crawler / Sitemaps / Archive / Website / Web content / Link rot / Heritrix / World Wide Web / Web archiving / Computing

The UK Government Web Archive Guidance for digital and records management teams © Crown copyright 2015 You may re-use this information (excluding logos) free of charge in any format or medium, under

Add to Reading List

Source URL: www.nationalarchives.gov.uk

Language: English - Date: 2015-01-29 07:28:53
200Web crawler / Prototype / Technology / Intellectual property law / Patent law / Royalties

FINANCE AND PROCUREMENT SERVICE Thessaloniki, 3 September 2014 OPEN INVITATION TO TENDER

Add to Reading List

Source URL: www.cedefop.europa.eu

Language: English - Date: 2014-11-04 07:14:13
UPDATE