Would really like like to be able to search DU posts locally.

I've completed a project not related to politics which uses some simple open-source software to index about 60,000 message threads (where each thread, not message, has its own HTML file).

Seeing this in action is pretty incredible because after indexing it just takes a few seconds to run some of the most insane searches to get the information I'm looking for. Really, really helpful for tracking down information.

So this morning I was drinking coffee and frankly gloating at just how successful my little project had been and I get the twinge of pain associated with realizing that while my own little project is fun, and has nothing to do with politics, the ability to search a massive amount of political data like this, locally, for a place like DU would actually be useful to Americans in a very real, grand, sense.

There, I said it. Actually useful to promoting Democracy in America.

It doesn't have to include hidden threads or PM's or any of that stuff- if just the Bush Years were available- my God, Skinner, the level of real information about not only what went on but what's currently going on...it would just be an incredible resource.

Just putting that thought out there.

We are hoping to someday make it better. I'll let Elad know that you might have a relatively simple solution.