Zitku - the new search engine
Zitku is a search engine. It uses data from the world’s two largest community edited projects DMOZ and wikipedia.
DMOZ is the world’s largest human edited directory of websites. Wikipedia is the worlds largest human edited encyclopedia. Zitku combines the resources of these two data repositories to create accurate and spam free search results.
In addition to the two repositories, Zitku does have its own set of software infrastructure to support crawling, storage, compression and search of the “entire internet”. Yes you read it correctly, Zitku is designed to store multiple “copies” of the entire publicly accessible internet.
Zitku employs several bots to perform the tedious tasks of storing the internet. The crawler visits every webpage on the internet and then stores them in an ever expanding distributed filesystem.
Each stored page is parsed for keywords and readable content which is then sorted and important sections are put into a highly compressed search repository. When a user performs a search the results are produced from this repository.
The search engine currently in its alpha stages of development is inventing methods to perform large scale data processing with minimal hardware requirements.