ENTROPY RELATIONSHIPS FOR DATA SEQUENCE HISTOGRAMS

A quantized probability distribution is defined for a sequence of digital data produced by a Bernoulli source. From it, both a grouped distribution and a histogram are obtained. Their entropies are considered, and relationships between them are derived. Some applications are described, and a commentary about microscopic uncertainty versus macroscopic information is presented, with a related entropic modulation factor.