Democratic Underground Latest Greatest Lobby Journals Search Options Help Login
Google

Prediction or cause? Information theory may hold the key

Printer-friendly format Printer-friendly format
Printer-friendly format Email this thread to a friend
Printer-friendly format Bookmark this thread
Home » Discuss » Topic Forums » Science Donate to DU
 
Bosonic Donating Member (774 posts) Send PM | Profile | Ignore Sun Oct-02-11 02:51 AM
Original message
Prediction or cause? Information theory may hold the key
(PhysOrg.com) -- "A perplexing philosophical issue in science is the question of anticipation, or prediction, versus causality," Shawn Pethel tells PhysOrg.com. "Can you tell the difference between something predicting an event and something actually causing an event?"

Pethel is a scientist working at the Redstone Arsenal in Alabama. Along with Daniel Hahs, he set out to identify a method of distinguishing anticipation from causality using tools from information theory. “Any process that has to react in real time can improve its performance through anticipation, and in studying such processes it is important to find new ways to quantify causality” Pethel says.

The question of anticipation versus causality is one that has real-world application in a number of areas. Pethel points out that this issue has implications in covert operations, as well as in financial areas, especially with regard to the development of bubbles. “Is there a way, from passive measurements, to tell what’s driving what?” Pethel and Hahs try to answer this question in Physical Review Letters: “Distinguishing Anticipation from Causality: Anticipatory Bias in the Estimation of Information Flow.”

“If a system is generating information, it’s like a fingerprint that can be used to figure out where the information is coming from and where it is going,” Pethel explains. “A quantity called transfer entropy has been used since 1990 to measure information flow in experimental data from neuroscience, finance and even music.”

http://www.physorg.com/news/2011-09-theory-key.html
Refresh | +1 Recommendations Printer Friendly | Permalink | Reply | Top
truedelphi Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Oct-02-11 02:55 AM
Response to Original message
1. Very interesting. n/t
Printer Friendly | Permalink | Reply | Top
 
tama Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Oct-02-11 05:54 AM
Response to Original message
2. There are predictions
that are self-fullfilling, predictions that are self-cancelling, and other varieties.
Printer Friendly | Permalink | Reply | Top
 
Jim__ Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Oct-02-11 07:26 AM
Response to Original message
3. How does y anticipate x?
In the scenario they give:

In order to set up the situation, Pethel and Hahs used chaotic systems, which produce information. They were careful that their model would be connected in only one direction. “We set it up so that we know the causality – that x is causing y, but y cannot cause anything for x. However, we designed the y system to be able to predict x to some degree. We then collected data and used transfer entropy to tell us which was the causal system.”

When analyzing the results, Pethel and Hahs found something rather interesting: Even though the response system, y, wasn’t the cause, it looked very much like it was under many different test conditions. “There is an anticipatory bias. It’s a very strong effect, the more anticipation there is, the stronger it will be. There is a huge bias going on in some cases, and it is giving the exact wrong answer. The system that was only predictive was indistinguishable from the cause.”


y must be using some information to anticipate x. And if y can appear to cause x because it anticipates it - and presumably acts before x; then I don't seem how x can be the sole, direct cause of y. It must be possible that the predictors of x can also cause y.


Printer Friendly | Permalink | Reply | Top
 
Bosonic Donating Member (774 posts) Send PM | Profile | Ignore Sun Oct-02-11 12:39 PM
Response to Reply #3
4. I'm assumming x and y are systems
That is temporally extended processes, not unique events. I'd don't know whether you assumed they were, but just to clear it up. Their simplest manifestation would be as 1D time series.

So x doesn't cause y; x 'prods' y (but y cannot prod back).

If y can predict (to some accuracy) when x is going to 'prod it' (via access to present+past observable states of x), then it can take some preemptive action (on itself not x), to modulate the effect of the prod.

To an outside observer, not privy to the internal 'mind' states of x and y but only to their observable states, if y can very accurately predict when x is going to prod then it will seem very likely that the 'preemptive prod modulation' action of y is actually causing x to prod y (by the virtue of very often proceeding it temporally).
Printer Friendly | Permalink | Reply | Top
 
DU AdBot (1000+ posts) Click to send private message to this author Click to view 
this author's profile Click to add 
this author to your buddy list Click to add 
this author to your Ignore list Thu May 02nd 2024, 06:28 AM
Response to Original message
Advertisements [?]
 Top

Home » Discuss » Topic Forums » Science Donate to DU

Powered by DCForum+ Version 1.1 Copyright 1997-2002 DCScripts.com
Software has been extensively modified by the DU administrators


Important Notices: By participating on this discussion board, visitors agree to abide by the rules outlined on our Rules page. Messages posted on the Democratic Underground Discussion Forums are the opinions of the individuals who post them, and do not necessarily represent the opinions of Democratic Underground, LLC.

Home  |  Discussion Forums  |  Journals |  Store  |  Donate

About DU  |  Contact Us  |  Privacy Policy

Got a message for Democratic Underground? Click here to send us a message.

© 2001 - 2011 Democratic Underground, LLC