Search engine for discovering works of Art, research articles, and books related to Art and Culture
Javascript must be enabled to continue!
Conditional Rényi Entropy and the Relationships between Rényi Capacities
View through CrossRef
The analogues of Arimoto’s definition of conditional Rényi entropy and Rényi mutual information are explored for abstract alphabets. These quantities, although dependent on the reference measure, have some useful properties similar to those known in the discrete setting. In addition to laying out some such basic properties and the relations to Rényi divergences, the relationships between the families of mutual informations defined by Sibson, Augustin-Csiszár, and Lapidoth-Pfister, as well as the corresponding capacities, are explored.
Title: Conditional Rényi Entropy and the Relationships between Rényi Capacities
Description:
The analogues of Arimoto’s definition of conditional Rényi entropy and Rényi mutual information are explored for abstract alphabets.
These quantities, although dependent on the reference measure, have some useful properties similar to those known in the discrete setting.
In addition to laying out some such basic properties and the relations to Rényi divergences, the relationships between the families of mutual informations defined by Sibson, Augustin-Csiszár, and Lapidoth-Pfister, as well as the corresponding capacities, are explored.
Related Results
Rényi Cross-Entropy Measures for Common Distributions and Processes with Memory
Rényi Cross-Entropy Measures for Common Distributions and Processes with Memory
Two Rényi-type generalizations of the Shannon cross-entropy, the Rényi cross-entropy and the Natural Rényi cross-entropy, were recently used as loss functions for the improved desi...
Explaining the entropy concept and entropy components
Explaining the entropy concept and entropy components
Total entropy of a
thermodynamic system consists of two components: thermal entropy due to energy,
and residual entropy due to molecular orientation. In this article, a three-ste...
A Generalized Measure of Cumulative Residual Entropy
A Generalized Measure of Cumulative Residual Entropy
In this work, we introduce a generalized measure of cumulative residual entropy and study its properties. We show that several existing measures of entropy, such as cumulative resi...
Conditional Domain Adaptation with α-Rényi Entropy Regularization and Noise-Aware Label Weighting
Conditional Domain Adaptation with α-Rényi Entropy Regularization and Noise-Aware Label Weighting
Domain adaptation is a key approach to ensure that artificial intelligence models maintain reliable performance when facing distributional shifts between training (source) and test...
Renyi entropy and conditional Renyi entropy of partitions of algebraic structures
Renyi entropy and conditional Renyi entropy of partitions of algebraic structures
The present paper is devoted to the study of Renyi entropy in algebraic structures. We define Renyi entropy of order q and its conditional version for a partition of an algebraic ...
Introducing ‘Intimate Civility’: Towards a New Concept for 21st-Century Relationships
Introducing ‘Intimate Civility’: Towards a New Concept for 21st-Century Relationships
Fig. 1: Photo by Miguel Orós, from unsplash.comFeminism has stalled at the bedroom door. In the post-#metoo era, more than ever, we need intimate civil rights in our relationships ...
Conditional Tsallis Entropy
Conditional Tsallis Entropy
Abstract
In this paper, the conditional Tsallis entropy is defined on the basis of the conditional Renyi entropy. Regarding the fact that Renyi entropy is the monotonically inc...
Multiscale multifractal multiproperty analysis of financial time series based on Rényi entropy
Multiscale multifractal multiproperty analysis of financial time series based on Rényi entropy
This paper introduces a multiscale multifractal multiproperty analysis based on Rényi entropy (3MPAR) method to analyze short-range and long-range characteristics of financial time...