small experiment comparing entropy of files 11-9-13

2014-08-29

++ small experiment comparing entropy of files 11-9-13

I found a program that convert any file into binary here:
Binary Viewer
http://www.softpedia.com/get/Programming/Other-Programming-Files/PX-Binary-Viewer.shtml

I then created some text files with 10,000 random numbers, compressed these files into a zip, and obtained the binary string representing the zip file. I also compressed my dissertation into a zip file and obtained the binary string representing the zip file. I then calculated the entropy of these strings.


Files for random numbers
C:\Users\kurtw_000\Documents\kurt\storage\CIM Research Folder\DR\2013\11-9-13\random number files

Files for "dissertation for binary string entropy analysis"
"C:\Users\kurtw_000\Documents\kurt\storage\CIM Research Folder\DR\2013\11-9-13\dissertation for binary string entropy analysis"

The normalized entropy of my dissertation in binary was 0.999991057, and the entropy of 10,000 random numbers in binary was 0.999764949. I think that in order to detect "order" in my dissertation I would have to represent in something other than binary. Therefore, instead of calculating the number of 1s and 0s, I would count the number of english letters or something like that.



See also