Brent Simmons has been reminiscing about blog search engines and writing down some ideas for how one could be made today. Something he wrote sparked a memory.Instead of having it crawl blogs, I’d have it download and index RSS feeds. This should be cheaper than crawling pages, and it ensures that it skips indexing page junk (navigation and so on).
👓 On blog search engines | Colin Devroe
Published by
