stargeek
PHP news website logo.
home    PHP scripts    articles    seo tools    links    search    contact    shop    realtors


The state of distributed search







The state of distributed search

The state of distributed search 08/09/2004 04:12 AM

Even as commercial search engines like Google, Yahoo, and MSN Search grow more dominant, a new distributed search engine with the unglamorous name Grub is taking a different tack. Grub aims to take participants' unused bandwidth and CPU cycles to crawl more than 10 billion Web documents and maintain an up-to-date index of the Web.




This is a GrokNews Entry: (what is grok?)





Similar Items

The state of distributed search

Grok Headline matches for The state of distributed search

Distributed State Machines


Distributed State Machines 03/14/2005 05:06 PM
State machines are a fundamental concept in computer science.  The concept is simple: sequentially feed a series of inputs, in a particular order, to a black box in order to obtain a desired result. ...

Distributed Search Engines


Distributed Search Engines 08/21/2004 08:15 PM

Distributed Search Engines

Distributed Search Engines
http://www.openp2p.com/pub/t/74

A comprehensive annodated listing of 31 distributed search engines compiled by the OpenP2P organization. This has been added to Deep Web Research Subject Tracerâ„¢ Information Blog and Grid Resources Subject Tracerâ„¢ Information Blog.

YACY distributed WWW search engine


YACY distributed WWW search engine 08/04/2004 01:48 PM
YACY's first appearance

Design of a Parallel and Distributed Web
Search Engine


Design of a Parallel and Distributed Web
Search Engine
07/31/2004 05:11 AM
Design of a Parallel and Distributed Web Search Engine by Salvatore Orlando, Raffaele Perego, and Fabrizio Silvestri
http: //eprints.osti.gov/cgi-bin/dexpldcgi?qry1125085327;2

Abstract by Authors
This paper describes the architecture of MOSE (My Own Search Engine), a scalable parallel and distributed engine for searching the web. MOSE was specifically designed to efficiently exploit affordable parallel architectures, such as clusters of workstations. Its modular and scalable architecture can easily be tuned to fulfill the bandwidth requirements of the application at hand. Both task-parallel and data-parallel approaches are exploited within MOSE in order to increase the throughput and efficiently use communication, storing and computational resources. We used a collection of html documents as a benchmark, and conducted preliminary experiments on a cluster of three SMP Linux PCs. This has been added to Bot Research Subject Tracer™ Information Blog.

IBM Issued Search Patent: "Distributed
Metadata Searching System"


IBM Issued Search Patent: "Distributed
Metadata Searching System"
08/17/2002 12:10 PM
Open call for patent interpretation. If we are reading this right, IBM was granted a sweeping patent on "distributed" (P2P) search engines.

State questions Microsoft search plans


State questions Microsoft search plans 04/14/2004 07:45 PM
Massachusetts investigates whether the company is unlawfully wielding its desktop dominance in its plans to enter the search engine market.

Announcing Elegus.com: Search Any US
Federal or State Government Website


Announcing Elegus.com: Search Any US
Federal or State Government Website
03/28/2005 03:27 AM
Elegus Corporation has announced the launch of Elegus.com. Elegus.com allows users to search the content of almost any US Federal or State government website or group of sites from one convenient location. [PRWEB Mar 28, 2005]

great web searching tool, free download,
cool search web, search the web, google
web search, web search engine


great web searching tool, free download,
cool search web, search the web, google
web search, web search engine
06/20/2004 03:27 AM
Re-Search is a new product that you can load it on your desktop. Of course it is totally free. Search the web became easy, fast and effectively! [PRWEB Jun 20, 2004]

State by State: For Many in Missouri,
Picking a President Is More a Matter of
Values Than Policy


State by State: For Many in Missouri,
Picking a President Is More a Matter of
Values Than Policy
09/20/2004 12:51 AM
an article about Missouri

nytimes.com/2004/09/19/politics/campaign/19state.html
track this site | 3 links


State of the Campaign - Bush, Kerry, and
Clark debate the State of the Union. By
William Saletan


State of the Campaign - Bush, Kerry, and
Clark debate the State of the Union. By
William Saletan
01/22/2004 09:13 AM
analysis of the last night's State of the Union speech .. Here's William Saletan of Slate .. relatively decent analysis

slate.msn.com/id/2094145
track this site | 6 links


The Bush Legacy of Failure: Budget
Gloom, State by State 11/17


The Bush Legacy of Failure: Budget
Gloom, State by State 11/17
11/17/2003 08:09 AM
and discovers most state capitals preparing .. David Broder

washingtonpost.com/wp-dyn/articles/A43076-2003Nov14.html
track this site | 4 links


Secretary of State Shelley received
dubious donations / S.F. nonprofit that
got big state grant brokered by
politician is linked to sources who gave
$100,000 to his campaign


Secretary of State Shelley received
dubious donations / S.F. nonprofit that
got big state grant brokered by
politician is linked to sources who gave
$100,000 to his campaign
08/09/2004 02:31 AM
Secretary of State Shelley received dubious donations / S.F. nonprofit that got big state grant brokered by politician is linked to sources who gave $100,000 to his campaign .. crooked Democrat .. pay-to-play

sfgate.com/cgi-bin/article.cgi?file=/c/a/2004/08/08/MNG3 L84PD51.DTL
track this site | 3 links


Madeleine Begun Kane, Humor Columnist,
State of Disunion Crossword Puzzle, in
honor of George W. Bush's 2003 State of
the Union Address


Madeleine Begun Kane, Humor Columnist,
State of Disunion Crossword Puzzle, in
honor of George W. Bush's 2003 State of
the Union Address
01/22/2004 07:16 AM
State of Disunion crossword puzzle .. Mad cool SOTU crossword puzzle .. interactive cross word puzzle .. Madeleine Kane

madkane.com/crossword_sotu_speech.html
track this site | 8 links


Outburst Interrupts Mo. State of State
(AP)


Outburst Interrupts Mo. State of State
(AP)
01/22/2004 10:23 AM
AP - For several minutes, state Rep. Rod Jetton sat stewing in his prestigious back-row seat of the House chamber as Gov. Bob Holden repeatedly criticized Republican lawmakers for cuts in aid to public schools.

Pataki's State of the State On The
Internet


Pataki's State of the State On The
Internet
01/06/2004 01:17 PM
1010Wins Jan 6 2004 12:04PM ET

Feedster Powers RSS and Blog Search
Results for Eurekster - News Search
Expands the Scope of Search Engine
Powered by Social Networking Technology


Feedster Powers RSS and Blog Search
Results for Eurekster - News Search
Expands the Scope of Search Engine
Powered by Social Networking Technology
09/16/2004 03:28 AM
Feedster, Inc., the first company to utilize RSS feeds and weblog content to enhance broad web search, today announced that it will power RSS and blog search results for Eurekster, the first and only Internet search engine powered by social networking technology. By integrating Feedster’s news search technology and RSS feeds, Eurekster now provides its users and subscribers with an expanded search solution containing new sources of information and data beyond traditional Web search. [PRWEB Sep 16, 2004]

How aid is being distributed


How aid is being distributed 01/05/2005 01:58 PM

distributed ssh


distributed ssh 02/12/2004 10:14 PM
Just went open source, baby

Distributed DNS


Distributed DNS 05/03/2004 12:27 PM
Distributed DNS (DDNS) Prototype Release

C-Search Announces the Release of
C-Search and C-Search for Domino.Doc
R1.1 – Search Multiple Domino Databases
across Multiple Servers Simultaneously


C-Search Announces the Release of
C-Search and C-Search for Domino.Doc
R1.1 – Search Multiple Domino Databases
across Multiple Servers Simultaneously
04/16/2005 01:58 AM
C-Search today announced the release of C-Search and C-Search for Domino.Doc R1.1. - C-Search brings for the first time web crawling techniques to the Domino domain allowing organizations to build a fast and lightweight index of quality materials. Unlike web crawlers however, C-Search has built in design and location awareness to ensure users are presented with meaningful results and to guarantee that users are always routed to the nearest instance of information from the search results. [PRWEB Apr 16, 2005]

Distributed Backups?


Distributed Backups? 09/10/2004 04:47 PM
Having lost way too many hard-drives in the last couple years, I've become pretty focused on backup systems, and (judging from a few conversations here at DEMOmobile) it's a subject that a lot of people are interested in. Bob Cringely's latest column is another one of his "big idea for a company" suggestions that he simply tosses out and hopes someone builds: a peer-to-peer distributed backup system. The idea is pretty simple. You download some backup software which encrypts the data you want to backup, breaks it up into little chunks and moves it out over a peer-to-peer network. The amount of data you can backup is limited by the amount you agree to store yourself. In Cringely's plan, this whole thing should cost $3.95/month. Of course, you'd need to distribute many copies of the various pieces to make sure that there aren't chunks missing -- which will also mean that many people will need to be in the system before it's really all that reliable. Obviously, some people will freak out about chunks of their data (even if they are encrypted) sitting on random hard drives out there). In the meantime, it appears Cringely doesn't use Google, because a quick search on the topic suggests at least some people are already working on this type of technology.

Distributed FTP Daemon 1.1.4


Distributed FTP Daemon 1.1.4 07/13/2004 12:21 AM
A distributed FTP daemon that uses a cluster of slaves for file transfers.

Distributed audiobook for Down and Out


Distributed audiobook for Down and Out 04/09/2004 04:04 PM
Jill Smith has begun a distributed audiobook project for my novel Down and Out in the Magic Kingdom, whose new, liberal Creative Commons license allows for exactly this kind of mishegas (see the distributed audiobook project for Lessig's Free Culture for an example of how well this can work). She's recorded a reading of the prologue and posted it to the Internet Archive's public submission area, where open-licensed material is hosted for free.

I'm immensely gratified by this -- audiobooks are my favorite nontextual medium for storytelling and I can't fall asleep at night without one. I would love for others to take Jill's lead and finish it out. Link (Thanks Jill!)

Distributed FTP Daemon 1.1.2


Distributed FTP Daemon 1.1.2 06/02/2004 10:59 PM
A distributed FTP daemon that uses a cluster of slaves for file transfers.

Distributed Chat 1.0


Distributed Chat 1.0 04/19/2004 01:37 PM
Distributed chat using SSL encryption.

Distributed John 0.9.8


Distributed John 0.9.8 11/10/2003 11:33 PM
Parallel password cracking with John The Ripper.

Distributed-Process-0.10


Distributed-Process-0.10 03/24/2005 09:00 AM

Distributed BEAGLE 0.8


Distributed BEAGLE 0.8 06/02/2004 01:07 AM
A distributed evolutionary computation system.

Distributed Business


Distributed Business 06/24/2005 09:09 PM
Notes from the opening session on the second day of Supernova 2005. First, a perspective from John Seely Brown on Innovation Ecologies: long tails, swarms and path dependencies. Curious that the last two days that the ideas discussed will...

Distributed SIP Analyzer


Distributed SIP Analyzer 05/19/2004 01:38 AM
0.2.1

Distributed FTP Daemon 1.0


Distributed FTP Daemon 1.0 02/10/2004 06:37 PM
A distributed FTP daemon that uses a cluster of slaves for file transfers.

Distributed Realtime Simulation


Distributed Realtime Simulation 01/26/2004 05:22 AM
First file releases

DAWS (Distributed Ada Web Server)


DAWS (Distributed Ada Web Server) 03/21/2003 03:31 AM
DAWS pre-release

Distributed Checksum Clearinghouse
1.2.29


Distributed Checksum Clearinghouse
1.2.29
01/27/2004 05:20 PM
A distributed spam filter.

Ray Ozzie and distributed fat clients


Ray Ozzie and distributed fat clients 06/25/2004 04:01 AM

RayOzzie.JPG
Groove has a few wins under their belt in the school of "simple and local." Each example highlighted the power of having arich, smart client - which didn't necessarily need some round tripping http server thingie as it's smarts. These sexy sucess stories really elucidate for me - the future of RIAs.

I got to sing opera and make sure that the digital ID panel didn'tdisgress into yet another discussion of "what is identity?"

I did get the FOAFnet meme and story out - and also got to hear danah boyd discuss the difference between multiple identities (which she claims fragments the user's sceanario) - as opposed to facets of one's life - which presents a comprehensive simgle approach to multiple aspects of your life.

I actually think she's right theoretically - but I'm afraid that people need a metaphor like "multiple identities" - to hang their hat on.


Cooperative, distributed reporting


Cooperative, distributed reporting 10/29/2003 12:10 AM
Tonight's bout of insomnia gave me the opportunity to participate in something very cool. People from SpyMac, MacRumors, MacNN, MacTeens, MacCentral, and Mac-TV came together on IRC in just a few minutes before the Apple Expo keynote, with the intent to share information with the entire community. As information came in from various sources, it was redistributed through four different IRC channels and three websites (four, if you count the KevTV hoax) to a waiting community of listeners. The immediacy of the flow of information was eerie to watch, even as a blogger; something would be posted in one channel, a few seconds later it'd be in three, then both websites and all the channels would have it. In the span of sixty seconds every unique droplet of relevant information was spread to every listener by just a few speakers....

Distributed Checksum Clearinghouse
1.2.47


Distributed Checksum Clearinghouse
1.2.47
05/02/2004 10:00 AM
A distributed spam filter.

Distributed trojans (not that kind)


Distributed trojans (not that kind) 12/08/2003 03:36 PM
Peer-to-peer networks are the next big thing for virus writers, as profit becomes the first and foremost motivation for malware writers.

Distributed Computing 'Advances'


Distributed Computing 'Advances' 12/22/2003 12:37 PM
Slashdot Dec 22 2003 11:25AM ET
Grok Description matches for The state of distributed search
GrokA matches for The state of distributed search

The state of distributed search

The following phrases have been identified by the grok system as matching this entry:

















Also check out:


Grok

Ipod Porn on the
Rise

Brief Abstract of
Wikipedia's
Mesothelioma Cancer
page

Get first aid
instructions in your
cell phone

IE is crap
JSPWiki gains
podcasting support

JPump
larp.fi
At Least 5 Dead at
Japan Nuke Plant
(Reuters)

Car Bomb Blast Kills
Seven People in Iraq
(AP)

'Text tax' sparks
first cyber-protest
in Philippines (AFP)

KPN doubles profits
on reduced costs and
debt charge, i-mode
takes off (AFP)

When the customer is
always wrong

Dilbert for 09 Aug
2004

Property prices soar
in Wales

Football: Man Utd
rues crisis

Fake goods tempting
young adults

Accident at Japan
nuclear plant

Iraq tribunal head
fears for life

Samsung VGA Display
Destined For
Smartphones

Frost & Sullivan's
UPS Awards Press
Release

Discretix Launches
CryptoFlash™
Embedded Security
for Flash-based
Storage Devices

Iraq Suicide Bomber
Kills Six, Wounds 17
(Reuters)

Men Want TiVo™ More
libnids 1.19
Open Business
Accounting/Inventory
2.1.0

Time-lapse dcs1000w
1.01

CRM114 Discriminator
20040808

Stabilizer 0.2.2
lcdmod 1.0.2
phpMyAdmin 2.6.0-rc1
(Development)

TraceProto 1.0.0
New worm uses Yahoo
to spread

Microsoft and Vue
Extend Free Retake
Promotion in U.S.

Danny O'Brien's
Oblomovka

JustOneMinute:
Swimming To Cambodia

airpwn - platform
for injection of
application layer
data on an 802.11b
network

Secretary of State
Shelley received
dubious donations /
S.F. nonprofit that
got big state grant
brokered by
politician is linked
to sources who gave
$100,000 to his
campaign

his review of
Nicholson Baker's
new book

BBC NEWS | Health |
Prozac 'found in
drinking water'

Crush Kerry - Dems
Plan Assault on Vets

Visual FoxPro 9.0
Beta Component
Refresh

Update for Microsoft
Windows Server 2003:
KB823728New Headline

Group Policy
Settings Reference
for Windows Server
2003

Office 2003 Tool:
FabriKam – The
Microsoft Office
System Solutions
Learning Platform

Update for Windows
2000 (KB842933)

Credit Suisse First
Boston: Longhorn
Slip Can Make
Microsoft Linux
Fodder

'Text tax' sparks
cyber-protest in
Philippines

Dubai eGovernment
signs MoU to boost
MAF services

www.SaveOnCommunicat
ions.com launches
new VOIP Service for
Canada

Contec Innovations
Highlighted at Monte
Jade Technology
Mission in Asia; MOU
Signing Ceremony
with HKWDC

Cable Telephone
Subscriptions to
Grow to 11.5 Million
by 2010

I've been using
partition magic 7
for a year... and
its jus

Hey Guys get geared
up, But the Official
Copy of DOOM III.
Its worth the Game.
Say NO TO PIRACY

The Good One
A program used
primarily to create,

what is grok?