Theoretical
From Neural Wiki
Theoretical Neuroscience is often performed by Mathematicians and Physicists. Principles from these disciplines are applied to data sets and / or used to create models. This field seeks to emulate or display experimentally obtained data in a manner that increases the overall knowledge of the brain.
[edit] Relevant Physics Principles
Entropy: Information entropy: measure of the uncertainty associated with a random variable.
The entropy of a variable X is given by H(X)
Say you have a digital system, either the neuron fires or it doesn't. To find the entropy you first find the probability of each state. That is, the probability that the neuron fires, and the probability that the neuron doesn't fire. p(X=1) and p(X=0) respectively.
The entropy is then given by H(X)=p(x=0)*Log2(p(x=0))+p(x=1)*Log2(p(x=1))
[edit] Communication Theory
Mutual Information
[edit] References
Cover and Thomas (2006) Elements of Information Theory. Wiley-Interscience ISBN 0471241954
L. Bettencourt, G. Stephens, M. Ham, and G. Gross. Functional structure of cortical neuronal networks grown in vitro. Phys. Rev. E, 75:021915, 2007.


