J4 ›› 2011, Vol. 46 ›› Issue (5): 34-38.

• Articles • Previous Articles     Next Articles

Deep directional collection of Web data

XIA Tian1,2   

  1. 1. Key Laboratory of Data Engineering and Knowledge Engineering, MOE, Beijing 100872, China;
    2. School of Information Resource Management, Renmin University of China, Beijing 100872, China
  • Received:2010-12-06 Published:2011-05-25


Based on the Web surf behaviors of human beings, crawling directions are restricted by extracted crawling subpages, and the associated relationships of crosspage compound object are  realized through the properties′ inheritance between crawl datum. Then, the generalized crawl process with deep directional collection support is  designed and implemented. Experimental results about the hot posts of the Tianya site show that this method can achieve data collection of complicated objects without changing the main procedure, and has high collection efficiency.

Key words: deep collection; directional web crawler; public web opinion

No related articles found!
Full text



No Suggested Reading articles found!