spark 案例

说明

读取tomcat日志文件,完成下面功能:

  • 统计10个访问量最高的 ip,只统计 /show_xxx.html 网址
  • 统计10个访问量最高的 网址,只统计 /show_xxx.html 网址

日志文件:

49.74.3.207 - - [14/Jun/2021:00:01:12 +0800] "GET /show_1EF4h7aLPSFB.html HTTP/1.1" 200 17300
121.226.148.220 - - [14/Jun/2021:00:01:14 +0800] "GET /show_1C7cGrpMhQ2.html HTTP/1.1" 200 21979
117.95.183.206 - - [14/Jun/2021:00:02:41 +0800] "GET /show_1EF1cWTFezUR.html HTTP/1.1" 200 15432
157.55.39.186 - - [14/Jun/2021:00:03:58 +0800] "GET /show_1EF5fipw0O0n.html HTTP/1.1" 200 20482
203.208.60.42 - - [14/Jun/2021:00:04:12 +0800] "GET /show_1IX51xrrA8z.html HTTP/1.1" 200 16986
203.208.60.29 - - [14/Jun/2021:00:04:14 +0800] "POST /ajaxApi/addViewNum HTTP/1.1" 200 40
203.208.60.114 - - [14/Jun/2021:00:04:48 +0800] "GET /show_1EF3uYu8CMSP.html HTTP/1.1" 200 20777
49.87.13.200 - - [14/Jun/2021:00:06:03 +0800] "GET /show_1EF2Pg2sje3N.html HTTP/1.1" 200 29320
49.87.13.200 - - [14/Jun/2021:00:06:04 +0800] "GET /ghost/css/bootstrap.min.css HTTP/1.1" 200 117305
49.87.13.200 - - [14/Jun/2021:00:06:04 +0800] "GET /ghost/css/font-awesome.min.css HTTP/1.1" 200 23739
49.87.13.200 - - [14/Jun/2021:00:06:04 +0800] "GET /ghost/css/magnific-popup.min.css HTTP/1.1" 200 5913
49.87.13.200 - - [14/Jun/2021:00:06:04 +0800] "GET /ghost/css/screen.css?v=1 HTTP/1.1" 200 17496
49.87.13.200 - - [14/Jun/2021:00:06:04 +0800] "GET /editor.md/css/editormd.preview.min.css HTTP/1.1" 200 44903

原文出处:/show_1IX4Ql4U8n9q.html