[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
[cosmos-dev] Performance Tests : QA update #1
|
Title: Performance Tests : QA update #1
Hi,
QA has performed some load testing using ‘Apache JMeter’ tool (open source application) on COSMOS i9 components
and here are the results of them with load samples of 10, 50,100,150 and 200 users simulation.
Test Environment:
- COSMOS i9 Components running on Linux (remote machine)
- Apache JMeter tool running on Windows XP, test execution using SOAP requests for all COSMOS components
Observations:
- Log reports generation is taking longer time than any other requests
- For some of the requests, it’s throwing – “Internal Server Error”
- Unable to simulate higher load samples with remote machine (>200 users), as most of the requests are
Test Results:
a) Management Domain
Label #Samples Average Min Max Std Dev Error % Throughput / sec KB/Sec Avg Bytes
SOAP/XML-RPC Request 10 494 471 520 14.092906 0 7.08215297 10.554068 1526
SOAP/XML-RPC Request 50 779 470 3495 740.660273 0 12.1477162 18.102944 1526
SOAP/XML-RPC Request 100 742 471 3515 680.803882 0 22.2866057 33.212266 1526
SOAP/XML-RPC Request 150 797 480 4306 718.451263 0.00666667 28.2592313 42.156113 1527.56667
SOAP/XML-RPC Request 200 918 470 3746 936.16286 0.03 44.2771751 66.353282 1534.555
b) Data Broker
Label #Samples Average Min Max Std Dev Error % Throughput / sec KB/Sec Avg Bytes
SOAP/XML-RPC Request 50 1961 561 3775 940.0106 0 11.7481203 51.44392 4484
SOAP/XML-RPC Request 100 2176 511 5027 1249.839 0 19.3124759 84.56752 4484
SOAP/XML-RPC Request 150 2589 520 6349 1585.648 0 23.5886146 103.3083 4484.69333
SOAP/XML-RPC Request 200 3379 531 8853 1959.169 0 22.2890895 97.60183 4484
c) SML MDR (Sample CMDBf Query Execution)
Label #Samples Average Min Max Std. Dev. Error % Throughput / sec KB/sec Avg. Bytes
SOAP/XML-RPC Request 10 1265 551 4227 1074.661 0 2.02922078 8.699491 4390
SOAP/XML-RPC Request 50 1725 530 10045 2093.932 0 4.90918017 21.04619 4390
SOAP/XML-RPC Request 100 833 480 3755 607.3807 0 20.8029956 89.18472 4390
SOAP/XML-RPC Request 150 1040 511 4126 885.0082 0 34.5065562 147.9334 4390
SOAP/XML-RPC Request 200 1293 561 4707 996.3588 0.01 34.6140533 147.5056 4363.71
d) Example MDR (Sample CMDBf Query Execution)
Label #Samples Average Min Max Std. Dev. Error % Throughput /sec KB/sec Avg. Bytes
SOAP/XML-RPC Request 10 861 511 3726 955.295038 0 2.19925225 7.82195 3642
SOAP/XML-RPC Request 50 874 491 4316 808.021782 0 9.90687537 35.2352 3642
SOAP/XML-RPC Request 100 993 500 4486 825.294205 0 21.6637782 77.05027 3642
SOAP/XML-RPC Request 150 1548 480 12799 1733.62155 0.066 11.0375276 39.14449 3631.60667
SOAP/XML-RPC Request 200 1334 521 9554 1350.17049 0.015 20.3376042 71.77317 3613.785
e) Statistical Data Manager (Reports)
Label #Samples Average Min Max Std. Dev. Error % Throughput / sec KB/sec Avg. Bytes
SOAP/XML-RPC Request 10 633 520 791 112.9765 0 6.40204866 113.1612 18100
SOAP/XML-RPC Request 50 1527 511 4647 1214.629 0 9.51112802 168.1166 18100
SOAP/XML-RPC Request 100 1966 560 14601 1736.601 0 6.64407681 115.2747 17766.4
SOAP/XML-RPC Request 150 2668 581 10976 2210.611 0 12.8899201 206.8429 16432
SOAP/XML-RPC Request 200 3089 610 11016 2024.09 0.05 17.8635227 276.4992 15849.905
f) Logging Data Manager (Reports)
Label #Samples Average Min Max Std. Dev. Error % Throughput /sec KB/sec Avg. Bytes
SOAP/XML-RPC Request 10 30034 23393 36042 3859.116 0 0.270679948 173.6536 656943
SOAP/XML-RPC Request 50 42465 7901 53647 7769 0 0.92084423 578.9759 643834.58
Thanks,
Srinivas