New Foundations for Information Theory - David Ellerman

Blick ins Buch

New Foundations for Information Theory (eBook)

Logical Entropy and Shannon Entropy

David Ellerman (Autor)

eBook Download: PDF

2021 | 1. Auflage
XIII, 113 Seiten
Springer-Verlag
978-3-030-86552-8 (ISBN)

Lese- und Medienproben

Ebook-Leseprobe (PDF)

This monograph offers a new foundation for information theory that is based on the notion of information-as-distinctions, being directly measured by logical entropy, and on the re-quantification as Shannon entropy, which is the fundamental concept for the theory of coding and communications.

Information is based on distinctions, differences, distinguishability, and diversity. Information sets are defined that express the distinctions made by a partition, e.g., the inverse-image of a random variable so they represent the pre-probability notion of information. Then logical entropy is a probability measure on the information sets, the probability that on two independent trials, a distinction or 'dit' of the partition will be obtained.

The formula for logical entropy is a new derivation of an old formula that goes back to the early twentieth century and has been re-derived many times in different contexts. As a probability measure, all the compound notions of joint, conditional, and mutual logical entropy are immediate. The Shannon entropy (which is not defined as a measure in the sense of measure theory) and its compound notions are then derived from a non-linear dit-to-bit transform that re-quantifies the distinctions of a random variable in terms of bits-so the Shannon entropy is the average number of binary distinctions or bits necessary to make all the distinctions of the random variable. And, using a linearization method, all the set concepts in this logical information theory naturally extend to vector spaces in general-and to Hilbert spaces in particular-for quantum logical information theory which provides the natural measure of the distinctions made in quantum measurement.

Relatively short but dense in content, this work can be a reference to researchers and graduate students doing investigations in information theory, maximum entropy methods in physics, engineering, and statistics, and to all those with a special interest in a new approach to quantum information theory.

David Ellerman is an Associate Researcher at the Faculty of Social Sciences, University of Ljubljana, Slovenia. In 2003 he retired to academia after 10 years at the World Bank where he was the economic advisor and speech-writer for the Chief Economist Joseph Stiglitz. In his prior university teaching, Ellerman taught over a twenty-year period in the Boston area in five disciplines: economics, mathematics, computer science, operations research, and accounting. He was educated at Massachusetts Institute of Technology (USA), and at Boston University where he has two Master's degrees, one in Philosophy and one in Economics, and a doctorate in Mathematics. Ellerman has published eight books and many articles in scholarly journals in economics, logic, mathematics, physics, philosophy, and law.

Erscheint lt. Verlag	30.10.2021
Reihe/Serie	SpringerBriefs in Philosophy
Zusatzinfo	XIII, 113 p. 24 illus.
Sprache	englisch
Themenwelt	Geisteswissenschaften ► Philosophie
Schlagworte	cross-entropies • Entropy • hamming distance • index of mutability • indifference principle • Information Theory • logical entropy • logical probability • logical quantum information theory • mathematical theory of communications • partition logic • Shannon Entropy • theory of coding
ISBN-10	3-030-86552-5 / 3030865525
ISBN-13	978-3-030-86552-8 / 9783030865528

Haben Sie eine Frage zum Produkt?

PDF (Wasserzeichen)
Größe: 2,2 MB

DRM: Digitales Wasserzeichen
Dieses eBook enthält ein digitales Wasserzeichen und ist damit für Sie personalisiert. Bei einer missbräuchlichen Weitergabe des eBooks an Dritte ist eine Rückverfolgung an die Quelle möglich.

Dateiformat: PDF (Portable Document Format)
Mit einem festen Seitenlayout eignet sich die PDF besonders für Fachbücher mit Spalten, Tabellen und Abbildungen. Eine PDF kann auf fast allen Geräten angezeigt werden, ist aber für kleine Displays (Smartphone, eReader) nur eingeschränkt geeignet.

Systemvoraussetzungen:
PC/Mac: Mit einem PC oder Mac können Sie dieses eBook lesen. Sie benötigen dafür einen PDF-Viewer - z.B. den Adobe Reader oder Adobe Digital Editions.
eReader: Dieses eBook kann mit (fast) allen eBook-Readern gelesen werden. Mit dem amazon-Kindle ist es aber nicht kompatibel.
Smartphone/Tablet: Egal ob Apple oder Android, dieses eBook können Sie lesen. Sie benötigen dafür einen PDF-Viewer - z.B. die kostenlose Adobe Digital Editions-App.

Buying eBooks from abroad
For tax law reasons we can sell eBooks just within Germany and Switzerland. Regrettably we cannot fulfill eBook-orders from other countries.

Print-Ausgabe

Buch | Softcover

69,54 €