Information Theory and Elements of Digital Communication (CSCT2208)
Computer Science - COS
Semester: Resit
Level: 200
Year: 2015
SCHOOL: H.T.T.T.C DEPARTEMENT: CS LECTURER: Dr. DADA Jean-Pierre
COURSE CODE: CSC127 COURSE TITLE: Theory of information system
OPTION: FCS 100 DATE: september, 2015 HALL: TIME: 1:30 hr NATURE: Resit
Instructions:…… NA…………..
Exercise 1:
1. Define the following expressions:
• Information theory
• Chanel
• Receiver
2. Give the role of the following cables:
• Ethernet cable
• Optical cable
Exercise 2:
1. Give the formula to be used to calculate the joint entropy of two random variables X and Y
2. Let (X,Y) be two random variables having the following joint point distribution:
Calculate the joint entropy using the formula given before.
REPUBLIC OF CAMEROON
Peace – Work – Fatherland
***********
THE UNIVERSITY OF BAMENDA
***********
HIGHER TECHNICAL TEACHER TRAINING
COLLEGE (H.T.T.T.C.) BAMBILI
***********
DIRECTORATE OF STUDIES
**********
P.O.BOX 39 BAMBILI
REPUBLIQUE DU CAMEROON
Paix – Travail - Patrie
***********
UNIVERSITE DE BAMENDA
***********
ECOLE NORMALE SUPERIEURE D’ENSEIGNEMENT
TECHNIQUE
***********
DIRECTION DES ETUDES
**********
Tél: 33 05 10 69
www.schoolfaqs.net
Exercise 2: Let us consider a random variable X with two possible states such as:
𝑿 =
{
𝟎 𝒘𝒊𝒕𝒉 𝒕𝒉𝒆 𝒑𝒓𝒐𝒃𝒂𝒃𝒊𝒍𝒊𝒕𝒚 𝑸
𝟏 𝒘𝒊𝒕𝒉 𝒕𝒉𝒆 𝒑𝒓𝒐𝒃𝒂𝒃𝒊𝒍𝒊𝒕𝒚 𝒑
where 𝑄 unknown real number and 0 ≤ 𝑝 < 1
1. Give the relation between 𝑄 and 𝑝
2. Give the value of the entropy H(X) where 𝑝 = 1/2
3. Give the diagram representing H(p) versus p
www.schoolfaqs.net
