Gold in one unlikely place

People tell us there are gold nuggets hidden in data talking of data mining. People occasionally stumble upon inheritances they never knew of containing gold (especially relatives from African royalty). But who would have thought there was gold to be found in sewage: http://www.cnn.com/video/#/video/tech/2009/02/22/lah.japan.gold.poop.cnn.

The Numbers on Consumer Spending from Mint.com

Here is a look according to the anonymous users of Mint.com that report on spending, savings accounts and more. Check it out.

Creative Hackers

Check out this road sign from Texas ("Zombies Ahead").

Economists clueless on macreconimic issues?

I recently read a post here that stated basically that economists start talking about the psychology of the people but don't understand psychology and that at the macro level economists are pretty much clueless. Take a look at the article. It is a good read as well as many of the comments.

One of the major problems with economics is that it is really difficult to test macro level theories. How do you run a randomized experiment on some theory at the national or global level? You don't. No politician will let you use his/her people as guinea pigs. We don't want to be guinea pigs. Yet we have learned that good data is much more reliable than intuition and gut feel (see these slides and this book).

The only way to understand macroeconomics reliably is with experimentation (like all other good sciences) and that is near impossible at the macro level.

Virtual CloneDrive

If anyone has to install some software from ISO files they downloaded may I recommend Virtual CloneDrive. I had to install SAS to my computer for a class which required at least 11 ISO files to be burned to disk. Luckily with the Virtual CloneDrive I could install from my hard drive without burning one disk and the CD images were read faster than if they were in a real CD drive. Smooth and painless!

Educational TV can be educational

I am of the belief that just because something says that it is healthy does not mean it is. For example, "low fat" to me means "less bad" rather than actually being "good". I originally was of the same opinion on educational TV. TV is brain rot for children (which is sometimes worth the quiet it brings). However, there have been two cartoons on PBS that have changed my view: Super Why and Sid the Science Kid.

Our daughter rarely seemed to be that interested in learning letters from mother and father, but once she started to watch Super Why she really started to pick up on all of the letter understanding the show brought. She had the alphabet down after just a couple weeks of watching the show once in a day. Entertaining education really worked for her.

Sid the Science Kid is the latest show that actually teaches our daughter something. She has learned about washing your hands to remove germs, what "melting" means, and what seeds are good for. I am a real fan of this show.

Google's Ranking Algorithm In Review

Google started on the basis of a ranking algorithm called PageRank (discussed in previous posts here and here). Of course there is so much more to the secret sauce for these search engines now. We just don't know what they are using.

Anyway, there was a recent paper published that collected traffic going into and out of the servers at Indiana U. Using this traffic they were able to disprove 3 major assumptions underlying PageRank. PageRank assumes

• a user is equally likely to follow any link on a page.

Actually, links are very unevenly followed. Some links carry huge amounts of traffic and others rarely see a click. (Think of how you browse a web page. Aren't there links that never look interesting like "Report A Bug" on espn.go.com?)

• the probability of "teleporting" (or going directly) to any web page is equal to any other web page.

Actually the chance of starting to surf from any page is very skewed. Some pages are very popular destinations without following links. How many of us have favorite sites that we visit through bookmarks or typing the URL every day. We do not randomly type in URLs.

• the probability of "teleporting" from any web page is equal across all web pages.

This was more difficult to disprove from their data. However, some sites are more likely to be stopping points in browsing and others are a bridge to more information.

The bottom line is that the links of the web are not that good at determining what actual paths people follow while browsing. However, this is the basis of major search engines that link structure determines popularity. The redeeming quality of search engines from this paper though is that they lead people to less popular sites, or sites we would not otherwise find out about and thus spread the wealth of clicks around (which is in conflict with what I had previously said in my first post on Google bias).