Abstract:

In order to achieve  real-time and efficient access to the data of Twitter,two different methods based on Twitter List API and Lookup API were presented after analyzing the shortcomings of  traditional collection methods. By classifying users, this method can precisely  control the frequency of calling API. A series of experiments on over 260,000 users and over 6 million messages were carried out, and the results show that the combination of the two methods can be efficiently  used to collect Twitter data in real-time.

Key words: Twitter; List API; Lookup API; data collection