[ILUG] Personal web indexer

[Kenn Humborg]

> On Tue, Mar 21, 2000 at 06:36:35PM -0000, Kenn Humborg mentioned:
> > > Can a user-space prog wait on any port (over 1024)? and thus
> > > be a proxy so none of the admins would need to help implement this
> > Yes.  That's exactly what I had in mind.
> 
>  In that case, it would rock. To make it extra cool, though it would have
> to keep a log of what you are reading, and then index each & every page,
> with htDig or something when the machine isn't in use. Have a nice web
> front end running to do the search. Then, you could bookmark it right
> beside Alta Vista. 

That's what I meant.  This little proxy would take over the role
of the spider/crawler in a standard search engine setup.  Except 
this time the "spider" is driven by the user's browsing, rather 
than by following links.

I'd imagine that modern machines would have no trouble indexing
pages at the speed a normal user reads.

And, for added coolness, when you install this indexer for the
first time, it would prime the index by trawling through your
browser cache.

Later,
Kenn