100 likes | 217 Views
A B it about Bits. Shouldn’t “information theory” be studied in the philosophy department?. Communication. Digital Representation of Data. Secret Sauce. Ingredients: Data Compression Error correction Encryption. Morse Code. Data Compression. Error Correction.
E N D
A Bit about Bits Shouldn’t “information theory” be studied in the philosophy department?
Secret Sauce • Ingredients: • Data Compression • Error correction • Encryption
Error Correction Insert four bits of information: abcd. Choose e, f, and g so that each circle sums to an even number. The new sequence is abcdefg. a b c d
Encryption • Use “secret key” to hide information. • Pair each bit of information with a bit of secret key. • If the secret key bit is ‘1,’ flip the information bit. Otherwise leave it alone. Example: Message: 010110 Secret Key: 110011 Result: 100101
Information Theory • How far can we push these magic tricks? • Entropy, entropy, entropy • Other topics: • Learning • Sensing • Recognizing patterns.