Toggle Navigation
CSoI
Center for Science of Information
About
Overview
Mission
Participants
Organizational Chart
Strategic Plan
Annual Report
Reimbursement Forms
Contact Us
Related Links
Research
Overview
Communication Thrust
Knowledge Thrust
Life Sciences Thrust
RCR Ethics Training
Education
Overview
Courses & Modules
Research Teams
Seminars
Workshops
Outreach
Diversity
Overview
Channels Program
Explore Diversity
Knowledge Transfer
Overview
Information for Industry Partners
International Partnerships
News and Events
Center News
Newsletter
Calendar
Resources
Articles
Courses & Modules
K-12 Resources
Video
Books
Journal Papers
Presentation Slides
Posters
Theses
More
News and Events
Resources
About
Research
Education
Diversity
Knowledge Transfer
News and Events
Resources
Articles
Courses & Modules
K-12 Resources
Video
Books
Journal Papers
Presentation Slides
Posters
Theses
Kullback–Leibler divergence
Related Resources
Journal Papers:
Mutual Information, Relative Entropy, and Estimation in the Poisson Channel
Journal Papers:
Relative entropy at the output of a capacity-achieving code
Journal Papers:
Mismatched Estimation and Relative Entropy
Journal Papers:
Convex Relative Entropy Decay in Markov Chains
Journal Papers:
Upper Bounds on the Relative Entropy and Renyi Divergence as a Function of Total variation Distance for Finite Alphabets
Journal Papers:
Mutual Information, Relative Entropy and Estimation Error in Semi-Martingale Channels
See Also
Distribution (mathematics)
Entropy
machine learning
Mathematics
Neuroscience
Probability
Statistics
From Wikipedia
Provided by Wikipedia under
Creative Commons Attribution CC-BY-SA 4.0