GATE EC 2022 — Question 29

Information TheoryEntropyMSQ1 markMedium

Let \(H(X)\) denote the entropy of a discrete random variable \(X\) taking \(K\) possible distinct real values. Which of the following statements is/are necessarily true?
  1. A
    \(H(X) \le \log_2 K\) bits
  2. B
    \(H(X) \le H(2X)\)
  3. C
    \(H(X) \le H(X^2)\)
  4. D
    \(H(X) \le H(2^X)\)
Practise the full 2022 paper
Challenge a friend: WhatsApp Telegram
From RENYXERAWhat rank do your marks get?GATE score, likely All-India Rank and qualifying marks for your category.
Practise more on EntropyTimed, in the real exam interface · free to start

A GATE question every morning

One real past-paper question every morning for your branch, answer hidden until you tap. Free on Telegram.

Join
Stuck? Ask in the student group