From:
cosmos-dev-bounces@xxxxxxxxxxx [mailto:cosmos-dev-bounces@xxxxxxxxxxx] On Behalf Of Doma, Srinivas Reddy
Sent: 12 March 2008 12:22
To: Cosmos Dev
Cc: Bathini, Raghuveer; Adivishnu,
Kishore
Subject: [cosmos-dev] Performance
Tests : QA update #1
Hi,
QA has performed some load testing using ‘Apache
JMeter’ tool (open source application) on COSMOS
i9 components
and here are the results of
them with load samples
of 10, 50,100,150 and 200
users simulation.
Test Environment:
- COSMOS
i9 Components running on Linux (remote machine)
- Apache
JMeter tool running on Windows XP, test execution using SOAP requests for all COSMOS components
Observations:
- Log
reports generation is taking longer
time than any other requests
- For
some of the requests, it’s throwing – “Internal Server Error”
- Unable
to simulate higher load samples with
remote machine (>200 users), as most
of the requests are
taking longer time and throwing timeouts or ‘internal
server errors’
Test Results:
a) Management
Domain
Label #Samples Average Min Max Std Dev Error % Throughput
/ sec
KB/Sec Avg
Bytes
SOAP/XML-RPC Request 10 494 471 520 14.092906 0 7.08215297 10.554068 1526
SOAP/XML-RPC Request 50 779 470 3495
740.660273 0 12.1477162 18.102944 1526
SOAP/XML-RPC Request 100 742 471 3515
680.803882 0 22.2866057 33.212266 1526
SOAP/XML-RPC Request 150 797 480 4306
718.451263 0.00666667 28.2592313 42.156113 1527.56667
SOAP/XML-RPC Request 200 918 470 3746
936.16286 0.03
44.2771751 66.353282 1534.555
b) Data
Broker
Label #Samples Average Min Max Std Dev Error % Throughput
/ sec KB/Sec Avg
Bytes
SOAP/XML-RPC Request 50 1961
561 3775 940.0106 0 11.7481203 51.44392 4484
SOAP/XML-RPC Request 100 2176
511 5027 1249.839 0 19.3124759 84.56752 4484
SOAP/XML-RPC Request 150 2589
520 6349 1585.648 0 23.5886146 103.3083 4484.69333
SOAP/XML-RPC Request 200 3379
531 8853 1959.169 0 22.2890895 97.60183 4484
c) SML
MDR (Sample CMDBf Query Execution)
Label #Samples Average
Min Max Std.
Dev. Error % Throughput
/ sec KB/sec Avg.
Bytes
SOAP/XML-RPC Request 10 1265
551 4227 1074.661 0 2.02922078 8.699491 4390
SOAP/XML-RPC Request 50 1725
530 10045 2093.932 0 4.90918017 21.04619 4390
SOAP/XML-RPC Request 100 833 480 3755
607.3807 0 20.8029956 89.18472 4390
SOAP/XML-RPC Request 150 1040
511 4126 885.0082 0 34.5065562 147.9334 4390
SOAP/XML-RPC Request 200 1293
561 4707 996.3588 0.01
34.6140533 147.5056 4363.71
d) Example
MDR (Sample CMDBf Query Execution)
Label #Samples Average
Min Max Std.
Dev. Error % Throughput
/sec KB/sec Avg.
Bytes
SOAP/XML-RPC Request 10 861 511 3726
955.295038 0 2.19925225 7.82195 3642
SOAP/XML-RPC Request 50 874 491 4316
808.021782 0 9.90687537 35.2352 3642
SOAP/XML-RPC Request 100 993 500 4486
825.294205 0 21.6637782 77.05027 3642
SOAP/XML-RPC Request 150 1548
480 12799 1733.62155 0.066 11.0375276 39.14449 3631.60667
SOAP/XML-RPC Request 200 1334
521 9554 1350.17049 0.015 20.3376042 71.77317 3613.785
e) Statistical
Data Manager (Reports)
Label #Samples Average
Min Max Std.
Dev. Error % Throughput
/ sec KB/sec Avg.
Bytes
SOAP/XML-RPC Request 10 633 520 791 112.9765 0 6.40204866 113.1612 18100
SOAP/XML-RPC Request 50 1527
511 4647 1214.629 0 9.51112802 168.1166 18100
SOAP/XML-RPC Request 100 1966
560 14601 1736.601 0 6.64407681 115.2747 17766.4
SOAP/XML-RPC Request 150 2668
581 10976 2210.611 0 12.8899201 206.8429 16432
SOAP/XML-RPC Request 200 3089
610 11016 2024.09 0.05 17.8635227 276.4992 15849.905
f) Logging
Data Manager (Reports)
Label #Samples Average
Min Max Std.
Dev. Error % Throughput
/sec KB/sec Avg.
Bytes
SOAP/XML-RPC Request 10 30034 23393 36042 3859.116 0 0.270679948 173.6536 656943
SOAP/XML-RPC Request 50 42465 7901 53647 7769 0 0.92084423 578.9759 643834.58
Thanks,
Srinivas