Once you go beyond Yahoo and Google you may have a chance to find more than the easy to locate 20% of internet information. Thats right, only 20%, one of a possible five web or internet items are found by big search engines. So 80% is still out there waiting. Talk about an 80/20 rule! That is like panning for gold assuming there is no gold in the rocks on both sides of the stream.
So how to find that dark matter on the web?
For an overview of emerging Web search in late 2009, wander over to Marcus Zillman's essay on Deep Web Research on the ever interesting llrx site. Chris Sherman and Gary Price coined the phrase Invisible Web back in 2001 to describe information that could not be found on the web.
Nine years later, Zillman outlines the tools that are being developed to enlarge our ability to find that invisible information. Now if only my library's use of Websense software would allow me unfettered access to listen to Zillman, I might be able to recommend "Deep Web - Exploring the Secrets of the Hiddden Internet by Marcus P. Zillman, M.S., A.M.H.A., - 23 minutes - Internet/Technology Channel"
http://www.planetearthradio.com/technology.htm But since the omniscient Websence doesn't want my pc to access Zillman's voicefile, let's just say it is itself part of the invisible web.
Bibliorati says for the highly motivated -- willing to go above and beyond the basic search -- some exotic tools for the toolbox.
