用python写的一个网页测试工具

曾经终败给现在 2022-05-15 06:18 179阅读 0赞

### [   ][Link 1] ###

分类： [ python][python] 2007-04-11 18:53  1865人阅读 [评论][Link 2](0) 收藏 [举报][Link 3]

写了一个测试网站的脚本，用多线程跑的，每个线程每秒去取一次网页，因为这个脚本用到了线程啊，time，ulrlib这些东西，也许对其他人会有用，贴出来吧。

另外一个原因是，通过这个脚本，发现python的效率真的不错，无论是开发效率还是执行效率。之前完全没用过python的thread和time，一边看python programing，一边写，也就一个小时的功夫，看上去效果还不错。

代码如下：

--------------------

\#!/usr/local/bin/python  
\#FileName = test\_Web.py

\#get from db  
\#[http://192.168.1.74/spaces/posts/postdetail.aspx?id=][http_192.168.1.74_spaces_posts_postdetail.aspx_id]  
\#put into db  
\#[http://192.168.1.74/admin/space/post/post\_add.aspx?fid=0&um=300372&v=\_\_VERSION\_\_&title=0&content=hahaasdfasdf][http_192.168.1.74_admin_space_post_post_add.aspx_fid_0_um_300372_v_VERSION_title_0_content_hahaasdfasdf]

import thread, time, urllib

id\_index = 100000  
id\_count = 20000  
id\_max = id\_index+id\_count  
i\_cnt = 0  
time\_begin = time.time()  
bStop = False

def openurl():  
 sock = urllib.urlopen("[http://192.168.1.74/admin/space/post/post\_add.aspx?fid=0&um=300372&v=\_\_VERSION\_\_&title=0&content=hahaasdfasdf][http_192.168.1.74_admin_space_post_post_add.aspx_fid_0_um_300372_v_VERSION_title_0_content_hahaasdfasdf]")  
 htmlSource = sock.read()  
 \#print htmlSource  
 sock.close()   
   
def opengeturl(id):  
 strUrl = "[http://192.168.1.74/spaces/posts/postdetail.aspx?id=%d][http_192.168.1.74_spaces_posts_postdetail.aspx_id_d]" % id  
 print strUrl  
 sock = urllib.urlopen(strUrl)  
 htmlSource = sock.read()  
 \#print htmlSource  
 sock.close()

def child( myID ):        \# this function runs in threads  
 while( True ):  
  global id\_index  
  global id\_max  
  global id\_count  
  global time\_begin  
  global bStop  
  global i\_cnt  
    
  if( i\_cnt > id\_count ):  
   now = time.time()  
   i\_handle\_time = now - time\_begin  
   if( bStop == False ):  
    print "%d rows cost %f second" % ( id\_count, i\_handle\_time )  
   bStop = True  
   break  
  \#id\_index = id\_index + 1  
  i\_cnt = i\_cnt + 1  
  print "\[%d\] ==> %d" % (myID, id\_index)  
  opengeturl(id\_index)  
  time.sleep(1)

for i in range( 500 ):       \# spawn 3 threads  
 thread.start\_new( child, (i,) )  
   
time.sleep(1000000)  
print 'Main thread exiting.'        \# don't exit too early

[Link 1]: http://blog.csdn.net/kunp/article/details/1561094
[python]: http://blog.csdn.net/kunp/article/category/292658
[Link 2]: http://blog.csdn.net/kunp/article/details/1561094#comments
[Link 3]: http://blog.csdn.net/kunp/article/details/1561094#report
[http_192.168.1.74_spaces_posts_postdetail.aspx_id]: http://192.168.1.74/spaces/posts/postdetail.aspx?id=
[http_192.168.1.74_admin_space_post_post_add.aspx_fid_0_um_300372_v_VERSION_title_0_content_hahaasdfasdf]: http://192.168.1.74/admin/space/post/post_add.aspx?fid=0&um=300372&v=__VERSION__&title=0&content=hahaasdfasdf
[http_192.168.1.74_spaces_posts_postdetail.aspx_id_d]: http://192.168.1.74/spaces/posts/postdetail.aspx?id=%d