Organodynamics | Grant Holland, Apr 25, 2014 |
Slide: Some Ideas and Viewpoints I Want to HighlightÉcontinued. | |
Information
Theory There
is precedent, and good reason, for distinguishing information theory from communications theory. It
is reasonable to define
information theory as a branch of probability theory that studies entropic
functionals, including statistical entropy. | According
to this view, information
theory is a sibling to mathematical
statistics Ð both providing ways
to characterize chance variation. Whereas,
information theory concerns entropic
functionals, the Òsweet spotÓ of mathematical statistics is moments
and central moments. |
Random
variables The
strict meaning of Òrandom
variableÓ requires a mapping from the sample
space to the real
numbers. There
are some highly complex probability
spaces for which such
a mapping does not make sense, or have semantic utility. The
theory presented operates on such spaces. | The literature on stochastic processes emphasizes the random variable assumption, and is therefore not particularly helpful to organodynamic theory and applications.
|
Notes: