http://ayricalikdunyasi.com/image/twit.php?vzmtkb1531zwxkrg ********************************* dj51den at aol.com Dennis Roberson There's no reason a search engine can't keep up with the whole Web except for lack of will. Also, note that HTTP/1.1 cacheing headers will provide incredibly helpful info to spiders on how often they should refresh. (Since, for instance, all the posts in the FoRK archive should have a refresh setting of one year, while the current archive's index should be refreshed hourly) -- Dan Kohn -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://listserver.themacintoshguy.com/pipermail/g4/attachments/20140228/e1e40292/attachment.htm>