Information Theory

Arieh Ben-Naim is a professor emeritus at the Department of Physical Chemistry, at the Hebrew University of Jerusalem, Israel. Born in Jerusalem, Israel. Studied and worked for his PhD at the Hebrew University of Jerusalem. Post-Doctoral research in Stony-Brook University, NY, and Bell-Telephone Laboratories, NJ. Most of his research work was focused on the theory of water, aqueous solutions, solvation thermodynamics, and the role of water in biochemical processes. He is the author of over 200 articles and 35 books. Recently the author dedicated his time explaining and clarifying to the general public the most mysterious concept in physics: Entropy. He has published over 20 books and articles on Entropy and the Second Law, the most popular of which is “Entropy Demystified,” first published in 2006. He has written three books on Information Theory and its relation to Entropy and the Second Law. He had visited many universities around the world, where he lectured on all the topics of his research and interest.Claude Dufour, born in Brussels in 1950, took an early interest in heat engines. His thesis on the irreversibility of dense gases at MONS University highlighted the link between the subadditivity of entropy and its tendency to increase. From 1982 to 2009, he taught physics and mathematics. One of his proudest achievements has been to enable the weakest students to succeed while maintaining a high standard, thanks to accessible explanations and the requirement of sustained hard work. Retired since 2009, his goal is to publish the main results of his doctoral research in simple terms. His application of information theory not only to entropy but also to correlations provides a simple and innovative explanation of the second law of thermodynamics.

• Introduction.- Information Theory and the Living System.- Applications of Information Theory to Psychology.- Entropy in art.- Consistent Definition of Correlations and Multivariate Mutual Information.- An intuitive consideration of irreversible phenomena.- Use of mutual information in linguistics, cryptography, and steganography.- Communication system.