artur-graniszewski/ZEUS-for-PHP

View on GitHub
docs/book/http-benchmark-example.md

Summary

Maintainability
Test Coverage
# Prerequisites

The tests below assume that ZEUS is installed on top of the Apigility application (see "Integration with Apigility" section for details).

Also, make sure that Apache Benchmark tool is installed. 

# Static files test

## Throughput test

Open another terminal instance (ZEUS should be running in the first terminal)

We will test performance of 16 concurrent OPTIONS requests (the `-c 16 -i` switches) using the keep-alive connections (`-k` switch).

Command:
```
user@host:/var/www/zf-apigility-skeleton$ ab -n 50000 -c 16 -k -i http://127.0.0.1:7070/apigility-ui/img/ag-hero.png
```

Output (on the _Intel Core i7_ processor):
```
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 127.0.0.1 (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Completed 50000 requests
Finished 50000 requests


Server Software:
Server Hostname:        127.0.0.1
Server Port:            7070

Document Path:          /apigility-ui/img/ag-hero.png
Document Length:        0 bytes

Concurrency Level:      16
Time taken for tests:   20.134 seconds
Complete requests:      500000
Failed requests:        0
Keep-Alive requests:    495061
Total transferred:      69420976 bytes
HTML transferred:       0 bytes
Requests per second:    24833.87 [#/sec] (mean)
Time per request:       0.644 [ms] (mean)
Time per request:       0.040 [ms] (mean, across all concurrent requests)
Transfer rate:          3367.17 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       2
Processing:     0    1   0.8      1      34
Waiting:        0    1   0.8      1      34
Total:          0    1   0.8      1      34

Percentage of the requests served within a certain time (ms)
  50%      1
  66%      1
  75%      1
  80%      1
  90%      1
  95%      1
  98%      2
  99%      3
 100%     34 (longest request)
```

In this test, ZEUS Web Server served over **24833** requests per second.

## Bandwidth test

First, we will create a 1MB static file in `public` directory of the Zend Framework 3 application.

Command:
```
user@host:/var/www/zf-apigility-skeleton$ dd if=/dev/zero of=public/test.file.txt bs=1 count=1 seek=1048575
```

Now, we lets test the performance of 16 concurrent GET requests (the `-c 16` switches) using the keep-alive connections (`-k` switch) on a newly generated static file.

Command:
```
user@host:/var/www/zf-apigility-skeleton$ ab -n 50000 -c 16 -k http://127.0.0.1:7070/test.file.txt
```

Output (on the _Intel Core i7_ processor with a _7200RPM HDD_):
```
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 127.0.0.1 (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Completed 50000 requests
Finished 50000 requests


Server Software:
Server Hostname:        127.0.0.1
Server Port:            7070

Document Path:          /test.file.txt
Document Length:        1048576 bytes

Concurrency Level:      16
Time taken for tests:   16.564 seconds
Complete requests:      50000
Failed requests:        0
Keep-Alive requests:    49514
Total transferred:      52435892224 bytes
HTML transferred:       52428800000 bytes
Requests per second:    3018.60 [#/sec] (mean)
Time per request:       5.300 [ms] (mean)
Time per request:       0.331 [ms] (mean, across all concurrent requests)
Transfer rate:          3091460.25 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       1
Processing:     1    5  10.8      2      63
Waiting:        0    0   0.9      0      33
Total:          1    5  10.8      2      63

Percentage of the requests served within a certain time (ms)
  50%      2
  66%      2
  75%      3
  80%      3
  90%      6
  95%     40
  98%     43
  99%     44
 100%     63 (longest request)
```

In this test setup, ZEUS Web Server sent *50* gigabytes of data, achieving a speed of around **3** gigabytes, or **24152** megabits (23 Gbits) per second.

# Athletic tests

ZEUS comes equipped with scripts for benchmarking its HTTP Service using the Athletic framework; these tests can be found in the `benchmarks/Http` directory.

To execute the benchmarks the following command must be issued:

```
user@host:/var/www/zf-apigility-skeleton/vendor/zeus-server/zf3-server$ ../../bin/athletic -p benchmarks/Http
```

Output (on the _Intel Core i7_ processor):
```
ZeusBench\Http\HttpMessageBenchmark
    Method Name                    Iterations    Average Time      Ops/second
    ----------------------------  ------------  --------------    -------------
    getLargeRequest             : [5,000     ] [0.0001098786354] [9,100.95030]
    getMediumRequest            : [5,000     ] [0.0000641846657] [15,580.04532]
    getSmallRequest             : [5,000     ] [0.0000386142731] [25,897.15979]
    getDeflatedLargeRequest     : [5,000     ] [0.0002602560997] [3,842.36912]
    getDeflatedMediumRequest    : [5,000     ] [0.0000912987709] [10,953.04997]
    getDeflatedSmallRequest     : [5,000     ] [0.0000598844528] [16,698.82504]
    optionsLargeRequest         : [5,000     ] [0.0002242991447] [4,458.33176]
    optionsMediumRequest        : [5,000     ] [0.0001087976933] [9,191.37134]
    optionsSmallRequest         : [5,000     ] [0.0000359425068] [27,822.21078]
    optionsDeflatedLargeRequest : [5,000     ] [0.0000737112522] [13,566.44976]
    optionsDeflatedMediumRequest: [5,000     ] [0.0000518120289] [19,300.53738]
    optionsDeflatedSmallRequest : [5,000     ] [0.0000584757328] [17,101.11104]
```