University of Hawaii

Electrical Engineering

Bregman Divergences and Their Basic Properties

Date: 2016-01-21           Add to Google Calendar
Time: 1030am-1130am
Location: Holmes Hall 389
Speaker: Peter Harremoësk Associate Professor, Copenhagen Business College, Denmark

In this lecture we shall see how problems in decision theory and convex optimization naturally lead to the study of Bregman divergences. The basic properties of Bregman divergences will be explored. We shall see that a Bregman divergence that satisfies a certain sufficiency condition must be proportional to information divergence (Kullback-Leibler divergence).

Lecture Series on Bregman Divergences
Bregman divergences are used to quantify how much one probability measure deviates from another probability measure. Bregman divergences was defined already in 1967 but for many years the importance of this class of divergences was not recognized. Recently it has found a number of applications in apparently separated research areas, and new results pinpoint how and why certain concepts and methods appear in both information theory, statistics, physics and finance.

Peter Harremoës is Associate Professor at Copenhagen Business College, Denmark since 2009. His main research interests are related to the use of information theory in statistics, probability theory and physics. In particular he has contributed to the use of information theoretic method for deriving inequalities and convergence theorems in probability. Other active research areas are Bayesian networks, lattice theory, and quantum information theory.
Peter Harremoës(M’00) received the B.Sc. degree in mathematics in 1984, the Exam. Art. degree in archaeology in 1985, and the M.Sc. degree in mathematics in 1988, all from the University of Copenhagen, Copenhagen, Denmark, and the Ph.D. degree in natural sciences in 1993 from Roskilde University, Denmark. From 1993 to 1998, he worked as a mountaineer. From 1998 to 2000, he held various teaching positions in mathematics. From 2001 to 2006, he was Postdoctoral Fellow with the University of Copenhagen, with a longer visit at Zentrum für Interdisziplinäre Forschung, Bielefeld, Germany, 2003. From 2006 to 2009, he was affiliated with the Centrum Wiskunde & Informatica, Amsterdam, The Netherlands, under the European Pascal Network of Excellence. Dr. Harremoës was Editor-in-Chief of the journal Entropy 2007-2011.