| Re: [hono-dev] [Hono-Scalability]: Hono-Jmeter plugin testing challenges |
|
Hi Siva, 1 and 2)
The test should run and the receiver should receive all sender messages (at least if you give him more time). This should be true, if
you selected the “Wait for credits” in the sender (as it is in the default) test case? If they would be discarded by Hono it would be visible in Grafana. Are there errors in the JMeter logs? 3)
I do not really understand what you mean here? What do want to archive? 4) The idea to send (max) 300 messages in one JMeter sample is because with sending only one message, there is a lot of time in the sample
management of JMeter. I agree that it would be nice to configure this (maybe you could create an issue?) But this 300 has nothing to do with the initial 250 link capacity. This 250 credits are given initially from the dispatch router intermediary. The following
capacity exchange is done with own frames after they are under a certain limit. But the message flow and credit handling is complex and I would need to dive deeper in it to be sure.
The handling with number of devices from the test is not necessarily exactly the same if you compare it with an adapter. The test opens
a connection and a link for each thread (=sender, =device). At e.g. our adapters all devices would be handled over the same connection. But I do not think this will end in very different numbers, for the moment. In our default configuration the dispatch router is configured to multiplex/fanout to all consumers. In this configuration all consumers
need to get the message – so I would expect the the dispatch router to be the bottle neck if you have more consumers.
For the telemetry test it might be also a good idea to reconfigure the router to balance to the receivers (and use more of them) – if
not, the single receiver might always be the bottle neck. Mit freundlichen Grüßen / Best regards Marc Pellmann Bosch Software Innovations GmbH INST/ECS4 Schöneberger Ufer 89-91 10785 Berlin GERMANY Registered office: Berlin, Register court: Amtsgericht Charlottenburg, HRB 148411 B Executives: Dr. Ing. Rainer Kallenbach, Michael Hahn From: hono-dev-bounces@xxxxxxxxxxx [mailto:hono-dev-bounces@xxxxxxxxxxx]
On Behalf Of Katru, Siva Prasad Hi; I’m trying to perform hono scalability studies using hono-jmeter plugin.
I would like to simulate the following situations for better understanding of the Hono scalability ·
Latency test: Generate a constant throughput and measure the latency, CPU and RAM usage ·
Telemetry test: Generate a constant throughput with multiple hono senders and a single receiver - measure the CPU & RAM usage ·
Fan-out test: Multiple hono consumers are consuming incoming telemetry from a single sender – measure the CPU & RAM usage
I have started exploring the provided hono-jmeter testcase i.e.,
hono_jmeter_runtime.jmx. I’m able to execute the testcase successfully with 1 hono sender and 1 hono receiver by configuring with respective ports and certificates. I understand that sender is waiting till the receiver is available and sending a batch
of 300 messages (hardcoded in the source code) at one go and the message sending continues till the test execution time (honoTestRuntime) is over. In an attempt to create the constant throughput for longer durations (minimum 10min), I have carried out the below tests with different input parameters.
In this regards, I have the following questions
1.
How to create constant throughput? In principle, it should be proportional to the no. of hono devices (when talking about sender throughput).
But, I have not observed the same.
2.
Although receiver is started before the sender, why is receiver unable to receive the messages (even with increased receiver lag time)? How
to capture these metrics? Neither the Jmeter Summary report nor the Grafana UI displaying the missing messages.
3.
It would be nice if there is a provision to define the periodicity for the messages to be sent.
4.
I observed that there’s a credit of 250 messages per telemetry link. Whereas the default sender is sending batch of 300 messages, to avoid
the confusion I tweaked the MAX_MESSAGES_PER_BATCH_SEND value from 300 to 250. Also, I assume this limit of 250 credits will limit the honoDevice sending rate to be below 250 messages/sec i.e., max throughput per telemetry link is 250. Is this number 250 defined
based on design? Appreciate your inputs on this issue. Best Siva
|
