Larbin is a web crawler (also called (web) robot, spider, scooter...). It is intended to fetch a large number of web pages to fill the database of a search engine. With a network fast enough, Larbin should be able to fetch more than 100 millions pages on a standard PC.
Larbin is (just) a web crawler, NOT an indexer. You have to write some code yourself in order to save pages or index them in a database.
致力于搜索引擎的算法研究和改善以及网页信息与信息的提取，提出了网页信噪比的概念并努力推广搜索引擎技术的平民化