uwsgi日志慢请求分析器：uwsgi-sloth

安装

uwsgi-sloth完全使用python编写，你可以直接使用pip来安装它：

# 安装pypi的稳定版本
$ pip install uwsgi-sloth

# 安装github上的最新版
$ pip install -e git+https://github.com/piglei/uwsgi-sloth#egg=uwsgi-sloth

生成一份静态报表文件

安装完成后，你可以使用 uwsgi-sloth analyze 命令来分析你的uwsgi日志文件。

# Generate a report
$ uwsgi-sloth analyze -f uwsgi_access.log --output=report.html

# Specify threshold for request process time
$ uwsgi-sloth analyze -f uwsgi_access.log --output=report.html --min-msecs=400

查看更多: uwsgi-sloth analyze

实时报表

我们还提供了一个更强大的功能：实时日志报表，这个配置起来比上一个要稍微麻烦一些。

首先，通过 uwsgi-sloth echo_conf 命令创建一个默认的配置文件:

uwsgi-sloth echo_conf > /data/uwsgi_sloth/myblog.conf

默认的配置文件看起来是这样的，每一个选项描述写在了注释里：

# A sample uwsgi-sloth config file

# uwsgi log path, only support default log format
uwsgi_log_path = '/your_uwsgi_logs/web.log'

# All HTML files and data files will store here, must have read/write permissions
data_dir = '/you_data/uwsgi-sloth/'

# Minimal msecs for detect slow requests, default to 200
# min_msecs = 200

# Domain for your website, best given
domain = 'http://www.yourwebsite.com/'

# Custom url regular expressions file
# url_file = '/your_custom_url_file_path'

在修改了最重要的 uwsgi_log_path 和 data_dir 两个参数之后，你便可以通过 uwsgi-sloth start -c /data/uwsgi_sloth/myblog.conf 命令来启动uwsgi-sloth的worker了，如果 一切都正常的话，你会看到这样的输出：

[2014-06-26 01:32:56,851] uwsgi_sloth INFO: Start from last savepoint, last_log_datetime: 2014-06-26 09:32:04
[2014-06-26 01:32:58,859] uwsgi_sloth INFO: Rendering HTML file /data/uwsgi_sloth/myblog/html/latest_5mins.html...
... ...

如果你的日志文件比较庞大，第一次启动可能会花上比较长的时间。

$ cat /etc/nginx/sites-enabled/sloth_myblog.conf
server {

    listen   80;
    server_name  uwsgi-sloth.zlovezl.cn;

    location / {
        root /data/uwsgi_sloth/myblog/html/;
        index "latest_5mins.html";
    }
}

uwsgi-sloth analyze

可用参数

usage: uwsgi-sloth analyze [-h] -f FILEPATH [--output OUTPUT]
                           [--min-msecs MIN_MSECS] [--domain DOMAIN]
                           [--url-file URL_FILE]

optional arguments:
  -h, --help            show this help message and exit
  -f FILEPATH, --filepath FILEPATH
                        Path of uwsgi log file
  --output OUTPUT       HTML report file path
  --min-msecs MIN_MSECS
                        Request serve time lower than this value will not be
                        counted, default: 200
  --domain DOMAIN       Make url in report become a hyper-link by settings a
                        domain
  --url-file URL_FILE   Customized url rules in regular expression

$ cat url_rules
# A valid url_rules file are seperated regular expressions
^club/(?P<place>\w+)/(?P<year>\d+)/(?P<issue>\d+)/signup/$
^club/signup/success/$
^club/checkin/success/$

$ uwsgi-sloth analyze -f uwsgi_access.log --output=report.html --url-file=url_rules

uwsgi-sloth echo_conf

打印一个默认的配置文件

uwsgi-sloth start

启动实时报表的worker

$ uwsgi-sloth start -h
usage: uwsgi-sloth start [-h] -c CONFIG

optional arguments:
  -h, --help            show this help message and exit
  -c CONFIG, --config CONFIG
                        uwsgi-sloth config file, use "uwsgi-sloth echo_conf"
                        for a default one