Computers and Technology

Mckenna Ray

20 April, 05:22

Develop a Matlab program that allows you to plot the entropy of a source with variable output probabilities. We wish to observe that the maximum source entropy does indeed occur when the source outputs are equally likely. Start with a simple two-output source [s1; s2] with respective probabilities [a; 1-a] and plot the entropy as a function of the parameter a. Then consider more complex cases such as a three output source [s1; s2; s3] with respective probabilities [a; b; 1 - a - b]. Be creative with the manner in which the results are displayed.