shell练习题-统计日志

以你之姓@ 2022-05-22 01:37 138阅读 0赞

1.要求：

<table> 
 <tbody> 
 <tr> 
 <td>统计出/test目录下，每天生成的日志文件的每个IP的访问量有多少？ 将访问量存放到/test1下的文件中，并将大于七天的日志文件与存放访问量的文件删除。 （日志格式例：2018-06-1-access-log.txt） （存放的文件格式例：2018-06-1-log.txt） 日志内容：[root@liang test]# head -5 2018-06-12-access-log.txt&nbsp; 115.239.212.7 - - [11/May/2016:13:50:01 -0400] "GET /assets/css/common.css HTTP/1.1" 200 11308 "http://www.1daoyun.com/course/prolist/1" "Baidu-YunGuanCe-ScanBot(ce.baidu.com)" "10.214.61.39, 10.195.51.33, 127.0.0.1" 115.239.212.7 - - [11/May/2016:13:50:01 -0400] "GET /assets/css/theme-colors.css HTTP/1.1" 200 9256 "http://www.1daoyun.com/course/prolist/1" "Baidu-YunGuanCe-ScanBot(ce.baidu.com)" "10.214.61.39, 10.195.50.33, 127.0.0.1" 180.97.106.36 - - [11/May/2016:13:50:01 -0400] "GET /assets/plugins/bootstrap/fonts/glyphicons-halflings-regular.ttf HTTP/1.0" 200 45404 "http://www.1daoyun.com/course/prolist/1" "Baidu-YunGuanCe-ScanBot(ce.baidu.com)" "-" 180.97.106.36 - - [11/May/2016:13:50:02 -0400] "GET /course/explore HTTP/1.0" 404 0 "-" "Baidu-YunGuanCe-ScanBot(ce.baidu.com)" "-" 180.97.106.36 - - [11/May/2016:13:50:03 -0400] "GET /assets/plugins/bootstrap/fonts/glyphicons-halflings-regular.ttf HTTP/1.0" 200 45404 "-" "Baidu-YunGuanCe-ScanBot(ce.baidu.com)" "-" </td> 
 </tr> 
 </tbody> 
</table>

**2.模拟环境：**

<table> 
 <tbody> 
 <tr> 
 <td>1.不知道博客怎么上传文件，所以不提供日志文件，可以在网上搜索，然后修改日志文件名字为当天的时间（2018-06-12-access-log.txt），并移动到/test目录下 2.再生成十一个文件，进行测试。（这些文件都是空的）[root@liang test]# for i in `seq 1 11`;do touch 2018-06-${i}-access-log.txt;done&nbsp; [root@liang test]# ll total 11264 -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-1-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-2-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-3-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-4-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-5-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-6-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-7-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-8-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-9-access-log.txt-rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-10-access-log.txt -rw-r--r--. 1 root root &nbsp; &nbsp; &nbsp; &nbsp;0 Jun 12 08:07 2018-06-11-access-log.txt -rw-r--r--. 1 root root 11526717 Jun 12 08:21 2018-06-12-access-log.txt</td> 
 </tr> 
 </tbody> 
</table>

**3.脚本答案:**

<table> 
 <tbody> 
 <tr> 
 <td>[root@liang 2018-06-12]# cat account.sh&nbsp; #!/bin/bash Date=`date +%F` File=/test/${Date}-access-log.txt if [ -f "$File" ];then &nbsp; &nbsp; &nbsp; &nbsp; /usr/bin/awk '{print $1}' ${File} |sort|uniq -c|sort -nr &gt;/test1/${Date}-log.txt else &nbsp; &nbsp; &nbsp; &nbsp; echo "Error:No $File file " fi find /test -type f -mtime +7|xargs rm -f find /test1 -type f -mtime +7|xargs rm -f</td> 
 </tr> 
 </tbody> 
</table>

**4.定时任务**

<table> 
 <tbody> 
 <tr> 
 <td>[root@liang 2018-06-12]# crontab -l #count log ip traffic 00 00 * * * /usr/bin/bash /scritp/2018-06-12/account.sh</td> 
 </tr> 
 </tbody> 
</table>

**5.uniq与sort命令**

<table> 
 <tbody> 
 <tr> 
 <td>#sort---排序，-n 按数值排序，-r 倒叙排序，-u 去掉重复行，-k1 指定列数1.#uniq---去除连续的重复行，一般与sort配合使用，-c 在每列的旁边显示该行重复出现的次数。 1.例：[root@liang test]# cat a&nbsp; aa aa aa bb cc dd ee bb cc2.去除连续的重复行[root@liang test]# uniq a aa&nbsp;（三行连续的aa,会有两行被去掉） bb cc dd ee bb cc3.显示该行重复出现的次数[root@liang test]# uniq -c a &nbsp; &nbsp; &nbsp; 3 aa &nbsp; &nbsp; &nbsp; 1 bb &nbsp; &nbsp; &nbsp; 1 cc &nbsp; &nbsp; &nbsp; 1 dd &nbsp; &nbsp; &nbsp; 1 ee &nbsp; &nbsp; &nbsp; 1 bb &nbsp; &nbsp; &nbsp; 1 cc 4.统计次数 [root@liang test]# uniq -c a|sort -ur &nbsp; &nbsp; &nbsp; 3 aa &nbsp; &nbsp; &nbsp; 1 ee &nbsp; &nbsp; &nbsp; 1 dd &nbsp; &nbsp; &nbsp; 1 cc &nbsp; &nbsp; &nbsp; 1 bb</td> 
 </tr> 
 </tbody> 
</table>