Monday, 23 May 2011

Chaos of Information

Hello readers,

I know its been a while since have posted anything on here. I have been, for the lack of a better term, preoccupied. If you didn't know, I am currently located on a different parallel than my last posts. But this is besides the point. Today's topic is Shannon entropy, based from information theory.

I have had the pleasure of reading Robert J. Sawyer's book, Wake. It is a great science fiction book. If you have chance to read it, do yourself a favour and do it! In the book they talk about this phenomenon and so I decided to look into further.

As some of you may know, entropy is the the measurement in chaos or disorder. This could be either from the arrangement of molecules or other areas in which can have disorder (there isn't a standard for the chaos on your desk). There can even be dis order observed in the tossing of a coin!

A fair coin has one side heads and one side tails. If we exclude the probability of the coin to land on it's side (neither heads or tails) then the probability of the coin landing on either side is 50%, that is, there is a 50% chance of heads and 50% chance of tails. This can be broken down to a binary system, a system of 1'sand 0's. In this example, the entropy is zero, since everything is fair, there is no disorder, everything is predictable. 

As we all know, our computers transmit data via the binary system, everything you see and hear are the results of many 1's and 0's. So, Claude Shannon (1916 - 2001) proposed a theory of communication. Entropy is used as a tool to predict the next event in a chain. For example, predicting the next letter in the alphabet in a word (think Wheel of fortune with half the letters already filled in). Entropy is set at 1 - 1.5 bits per letter. That is, there is some randomness, though English follows some rules, such as 'u' comes after 'q' on most occasions, or the letter is 'e' is the most popular letter. When we look at entire words the entropy increases between 10 and 11 bits per word. That is, the predictability of the next word is significantly less than predicting the next letter in a series of letters.

This plays into information theory well because we as humans are always looking for ways to maximize space. We seem to do well, what with our chat rooms. We have broken common phrases down quite a bit. We often say ttyl (talk to you later) or brb (be right back), thus sending smaller messages. But this theory says that you cannot compress all messages. Some messages must either stay the same or get bigger in order to convey it's meaning. For example, when I have to write an essay for a liberal art course, I start off with an outline of what I will want to write about. There is no way I can compress it due to word count qualifications. Thus, not all information can be compress and must be further expanded upon.

So that is Shannon Entropy. If you want to see the predictability for yourself, you just need to read a book. Before you turn the page, predict the next word. You'll be surprised how often you are right or wrong!

Thursday, 20 January 2011

Identity Crisis

*Note the writer does not fully believe in the topics of Astrology. This piece is just to clear up a few misconceptions of the news.*

If you haven't heard, last week something has happened. For all you horoscope followers, you already know. To everyone else this might shock you. The news is that your astrological Sun Sign could have changed! Scary isn't it? Are you going through an identity crisis? Don't worry, you don't have to.

Let's take a step back. You should be asking, why would my Sun Sign change? What has changed in order for my sign to change? The brief and simple answer is that there was another constellation which has prominence. But the answer is slightly more complex than you think.

As you all know the Earth has poles (Santa lives in the North Pole). There are 2 poles in actuality. There is the true magnetic north pole and the absolute positional north pole (inhabited by St. Nicholas). The magnetic North was determined to be in Ellesmere Island in 2005, progressing towards Russia 65 kilometres per year. Thus, it is still in Canada's great white north! Anyways, because of these poles, we can think of the Earth as a top, but slightly on an angle. This causes another circular motion that we do not usually think of for the Earth (besides it's daily rotation, and annual revolution around the Sun). This tilt cause our position relative to the Sun to change over the last 3000 years, when the original 12 Sun Signs were "read" in the sky. Since then another constellation, Ophiucus, has been spotted in the sky and was deemed important enough to become another Sun Sign.

So, does this change your horoscope? Not really. There are claims that this new Sun Sign will only "affect" those born in 2009 and onwards. Thus, if you are able to read this the same year of the posting, then you are the same sign as before.