Democratic Underground Latest Greatest Lobby Journals Search Options Help Login
Google

Interesting site - scans RSS feeds for top stories & images (10X10)

Printer-friendly format Printer-friendly format
Printer-friendly format Email this thread to a friend
Printer-friendly format Bookmark this thread
This topic is archived.
Home » Discuss » Archives » General Discussion (01/01/06 through 01/22/2007) Donate to DU
 
Webster Green Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Mar-11-06 08:30 PM
Original message
Interesting site - scans RSS feeds for top stories & images (10X10)
I was looking at sites that won Webby Awards in 2005, and found this one. No doubt there are other news/political junkies here that might appreciate this...

Process:

Every hour, 10x10 scans the RSS feeds of several leading international news sources, and performs an elaborate process of weighted linguistic analysis on the text contained in their top news stories. After this process, conclusions are automatically drawn about the hour's most important words. The top 100 words are chosen, along with 100 corresponding images, culled from the source news stories. At the end of each day, month, and year, 10x10 looks back through its archives to conclude the top 100 words for the given time period. In this way, a constantly evolving record of our world is formed, based on prominent world events, without any human input.

http://tenbyten.org/index.html
Printer Friendly | Permalink |  | Top
bluerum Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Mar-11-06 08:44 PM
Response to Original message
1. Any automated analysis like this needs to be considered with
a healthy skepticism. I find it fascinating but when writes the rules one has an impact on the outcome.

How many times does the word "the" appear on the front page of a newspaper?

I know that any "intelligent designer" would eliminate this word from the search of 100 top words - but what other words are excluded - and what words are allowed to be included - and how do they make those linguistic decisions? What are the weighting rules? Or am I missing something obvious in linguistic studies of this type?

"
In this way, a constantly evolving record of our world is formed, based on prominent world events, without any human input.
"

Its kind of like writing voting machine software.

:wtf:
Printer Friendly | Permalink |  | Top
 
boobooday Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Mar-11-06 08:48 PM
Response to Original message
2. That is WAY cool
Thanks for posting it!

Printer Friendly | Permalink |  | Top
 
rpgamerd00d Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Mar-11-06 08:53 PM
Response to Original message
3. The site is corrupt. Its not filtering enough.
It has "Slobodon" ranked separately from "Milosovic", separately from "Milosovics" (plural).

Its mostly crap (fox, un, al, died), or the obvious (Iraq, President, Bush, Hamas)

They have a long way to go with their "neural net", so to speak.
Printer Friendly | Permalink |  | Top
 
DU AdBot (1000+ posts) Click to send private message to this author Click to view 
this author's profile Click to add 
this author to your buddy list Click to add 
this author to your Ignore list Sun May 05th 2024, 03:54 PM
Response to Original message
Advertisements [?]
 Top

Home » Discuss » Archives » General Discussion (01/01/06 through 01/22/2007) Donate to DU

Powered by DCForum+ Version 1.1 Copyright 1997-2002 DCScripts.com
Software has been extensively modified by the DU administrators


Important Notices: By participating on this discussion board, visitors agree to abide by the rules outlined on our Rules page. Messages posted on the Democratic Underground Discussion Forums are the opinions of the individuals who post them, and do not necessarily represent the opinions of Democratic Underground, LLC.

Home  |  Discussion Forums  |  Journals |  Store  |  Donate

About DU  |  Contact Us  |  Privacy Policy

Got a message for Democratic Underground? Click here to send us a message.

© 2001 - 2011 Democratic Underground, LLC