2014年12月17日 星期三

Crawl TMall or Taobao Sales Record

1. Use QTP as crawler
    1.1 grab a specific TABLE tag
    1.2 do necessary pagination then perform 1.1 again
    1.3 export stream as a local text file

2. Have a parser by using C#
    2.1 parser text file
    2.2 create data in staging data in database
    2.3 only import latest records


Useful QTP resource
1. http://motevich.blogspot.tw/2008/11/4-ways-to-get-count-objects-in-qtp.html
2. http://qtpcodes.blogspot.tw/2012/01/more-xpath-for-web-objects.html
 

沒有留言:

張貼留言