63 A Look at Information Congestion - Information Theory (Information Research)
Description
This article is from the Information Research FAQ, by David Novak david@spireproject.com with numerous contributions by others.
63 A Look at Information Congestion - Information Theory (Information Research)
Finding information on the internet is a skill. Finding information on
the commercial information sphere is also a skill. There is a great
degree of overlap. The awareness of the general public as measured by
use of commercial resources is very limited. This is further seen from
the simple use of search engines & the abundance of simple web search.
To hammer this point in, let's take a momentary look at search engines.
Most searches end in 1000's of results: here are the first 10. Do you
really think the first 10 or 20 or 100 sites listed are particularly
better than the next? No - you have a random selection of resources. A
selection generated by computer based on the most simple of criterion.
(We should also mention how some search engines sell placement in
search results).
Remarkably, the search engine is the much-vaulted entryway to the world
of information!?! Clearly search engines will not dramatically improve
the informative value of the net - not by themselves.
Multiplication of Information
One complication of poor information organization is an inflation of
information overlapping nuggets. Information on the internet is so
difficult to locate we have almost a continual need for more
publishing. Information must exist in numerous locations to reach an
intended audience. Promotion of the simplest nature - recognition for
the best for a given topic - becomes exceedingly difficult. Only when
20 sites publish or report a given fact does it become accessible.
Curiously, this is the state of affairs in the wider community.
Promotion is an expensive specialty. Numerous copies, distributors and
references are required to generate any kind of significant awareness.
Why should the internet be different?
Actually, why should the internet be the same? Definitive like the US
Census Bureau have no need to duplicate this information; to have
alternative presentation sites. Yet such sites appear the exception.
Consider a search for the best resources for patent research, we are
greeted with 954 websites (Altavista search for "patent research"
Jan-19-2001). Presumably, most of these sites discuss patent research -
Right? There is no technical or theoretical need for such confusion. I
wonder if such duplication may be more of an affliction than natural
tendency.
Justification:
It is relatively difficult to earn money from publishing improved
information, or organizing information already on the internet. Given
the intense interest in this technology, a collection of models have
emerged. A brief tour of these models will highlight the financial
limitations to improving the internet as an informative resource.
- - - Working for fame (but not payment)
This model works well in open source software programming, and some of
this ethic certainly extends to publishing information.
Simple altruism/complete lack of justification
School students and internet novices in particular may not need to
justify anything. Unfortunately, such work is usually neither
consistent nor persistent.
- - - Commercial promotion
Promotional funds can be used to publish information. Most promotion is
short-sighted, limited to presenting market information (like product
information), but in time government and associations will fund
publishing in-house information for purely promotional reasons.
- - - Invested commercial businesses
There are certain commercial opportunities to earn money through banner
advertising and sponsorship.
Direct payment for improved information (perhaps with digital money),
direct payment to authors (Theseus model, royalty systems), and direct
state sponsorship need not be necessary to fundamentally improve the
internet as an information resource. Academic peer-reviewed journals do
not pay for articles. Commercial periodicals are supported by
advertising, and the token subscription costs of magazines usually just
covers distribution costs. Fame motivates many efforts, not just
online, and we do not feel the need to habitually justify everything we
do.
In no small way, as more people become adept at publishing quickly,
important information will move on the net faster. Similarly,
information will also gradually become better organized. Economic
models will not improve the informative value of the internet like
direct payment. Most current limitations have economic solutions.
Unfortunately, my reasoned opinion is no economic system will arrive in
time to make a difference.
Conclusion
We know something of how information gets published, and how many
important documents do not reach the internet. We have described how
information is organized on the internet and how limited editorial
vetting and organization have given rise to certain traits which give
rise to the traits like superficial indexing, information duplication,
and a need for research skills.
Financial rewards and financial tools are unlikely to solve these
difficulties. We can only hope for a gradual growing out of our current
difficulties. We will have more of the same for several years to come.
It is simply the nature of the internet (as currently constructed).
For you, a greater understanding of the internet will assist you to
judge the worth, likely source and likely venues of the information you
seek. The same is true in the larger world... database, book & article.
Each has different traits and qualities, reinforced over time. Your
understanding of these traits and qualities in part defines your skill
as a researcher.
As to the future of the internet, on the positive side, there are
certain qualities to internet communication that make it uniquely
valuable. Internet communication is inexpensive, relatively rapid, and
increasingly accessible. On the negative side, the internet is badly
vetted, potentially very time consuming, and up against very well
entrenched systems that have been running for either decades or
millenniums (considering databases or books). Elements like a promised
but functionally absent digital money, and the lack of a meaningful way
to recoup the costs of vetting online information, make matters worse.
Despite this, despite ALL the teething and fundamental difficulties,
the internet is sufficiently superior to ensure considerable continued
effort to improve the informative value of the net.
Continue to:
My Books
