Lab 10

Hartley and Shannon both have different ways of measuring uncertainty. Hartley's measure refers to the amount of uncertainty associated with a set of alternatives. This is measured by the amount of information needed to remove the uncertainty. It refers to the information revealed after we know the outcome. This is given by the Hartley function which is H(A):=logb(׀A׀) where if the log base is 2, then the uncertainty is measured in bits. If is it the natural logarithm, then the unit is
nat. Shannon entropy, on the other hand, is the average amount of uncertainty associated with a set of weighted alternatives measured by the average amount of information needed to remove the uncertainty. The main difference is that shannon entropy refers to averages with a random variable. Shannon entropy shows the average amount of infomation that the recipient is missing when they do not know the value of a random variable, whereas Hartley is how much information needed to remove the uncertainty.

Flowchart

Lab 9

I learned a lot in this lab about making calculations using Excel. The lab forced me to calculate things on my own before using the computer. It was much easier using the computer's data analysis tool. This shows how advanced technology is becomming and how helpful it can be. Data analysis is very helpful in transforming data with the aim of extracting useful information. This includes statistical analysis and curve fitting. It is very useful in finding patterns in data. This can be used in many real life examples. There are relationships between many variables. Some real life examples that we discussed in class are years of schooling vs. level of income, high-school vs college gpa, and inflation rate vs prime lending rate. There are also different types of relationships such as direct and inverse linear. Scattter diagrams around linear relationships help show whether a diagram is more accurate estimator of x and y or a less accurate estimate. Comparing the data you have collected to the linear model in the diagram can account differences between actual values and an estimated value. Overall, this lab taught me a lot about analyzing information and i found it very useful.