Properties of Shannon and Rényi entropies of the Poisson distribution as the functions of intensity parameter
Articles
Volodymyr Braiman
Taras Shevchenko National University of Kyiv
Anatoliy Malyarenko
Mälardalen University
Yuliya Mishura
Taras Shevchenko National University of Kyiv
Yevheniia Anastasiia Rudyk
Published 2024-07-01
https://doi.org/10.15388/namc.2024.29.35560
PDF

Keywords

Shannon entropy
Rényi entropy
Poisson distribution
Karamata’s inequality

How to Cite

Braiman, V. (2024) “Properties of Shannon and Rényi entropies of the Poisson distribution as the functions of intensity parameter”, Nonlinear Analysis: Modelling and Control, 29(4), pp. 802–815. doi:10.15388/namc.2024.29.35560.

Abstract

We consider two types of entropy, namely, Shannon and Rényi entropies of the Poisson distribution, and establish their properties as the functions of intensity parameter. More precisely, we prove that both entropies increase with intensity. While for Shannon entropy the proof is comparatively simple, for Rényi entropy, which depends on additional parameter α > 0, we can characterize it as nontrivial. The proof is based on application of Karamata’s inequality to the terms of Poisson distribution.

PDF
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Downloads

Download data is not yet available.