Re: [sumo-user] NETCONVERT freezes on very large networks

[Jakob Erdmann <namdre.sumo@xxxxxxxxx>]

I find these values quite surprising since the running time for node removal should be linear in the removed nodes when there are no traffic lights and quite low compared to all the other computations that are going on.

can you please report

- the number of nodes removed (verbose output should say: Removing empty nodes and geometry nodes. X nodes removed)

- the number of junctions in either network (verbose output lists them in the node type statistics)

- the final network size when removing/not removing nodes.

regards,

Jakob

Am Mo., 1. März 2021 um 11:51 Uhr schrieb Sasan Amini <aminissn@xxxxxxxxx>:

I tried some variations, you can see the times below. It got generally faster after I rebooted my computer. --geometry.remove is by far the most influential factor:

On Wed, Feb 24, 2021 at 5:16 PM Jakob Erdmann <namdre.sumo@xxxxxxxxx> wrote:

I still suspect a bug rather than a "simple" algorithm-to-slow problem. To rule out one piece of slow-algorithm in the context of geometry.remove, can you try running with option --tls.discard-loaded?

Am Mi., 24. Feb. 2021 um 16:28 Uhr schrieb Sasan Amini <aminissn@xxxxxxxxx>:

I didn't measure the time in my script, but it wasn't more than 5 minutes. and the network is entire Germany's road network from OSM down to "highway.secondary".

On Wed, Feb 24, 2021 at 4:26 PM Jakob Erdmann <namdre.sumo@xxxxxxxxx> wrote:

How long does it run without --geometry.remove?

Am Mi., 24. Feb. 2021 um 16:24 Uhr schrieb Sasan Amini <aminissn@xxxxxxxxx>:

True. It ended after >36 hours. I am using version 1.7.0 actually. 

On Tue, Feb 23, 2021 at 10:36 PM Michael Behrisch <oss@xxxxxxxxxxx> wrote:

Hi,
if it occurs only with the latest nightly build but not with 1.8 it
might as well be https://github.com/eclipse/sumo/issues/8270. It does
not freeze it just takes very long, I also noticed that with the Berlin
network.

Best regards,
Michael

Am 19.02.21 um 07:48 schrieb Jakob Erdmann:
> My guess would be that this isn't about size but somewhere in that big
> network is a piece of input which triggers a bug. You could try to split
> your input in half and convert each individually to check this hypothesis.
>
> regards,
> Jakob
>
>
> Am Do., 18. Feb. 2021 um 21:34 Uhr schrieb Sasan Amini
> <aminissn@xxxxxxxxx <mailto:aminissn@xxxxxxxxx>>:
>
>     Dear all,
>
>     I am trying to convert a very large OSM file to a SUMO network using
>     NETCONVERT. When I set --geometry.remove, the processes freezes when
>     trying to remove empty nodes and never ends. Is this a memory issue
>     or somehow NETCONVERT doesn't like to remove that many nodes? btw, I
>     have 40GB of RAM and 12 CPU cores and without --geometry.remove I
>     get the network in less than 5 minutes.
>
>     Thanks,
>     Sasan
>     image.png
>     _______________________________________________
>     sumo-user mailing list
>     sumo-user@xxxxxxxxxxx <mailto:sumo-user@xxxxxxxxxxx>
>     To unsubscribe from this list, visit
>     https://www.eclipse.org/mailman/listinfo/sumo-user
>     <https://www.eclipse.org/mailman/listinfo/sumo-user>
>
>
> _______________________________________________
> sumo-user mailing list
> sumo-user@xxxxxxxxxxx
> To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/sumo-user
>

_______________________________________________
sumo-user mailing list
sumo-user@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/sumo-user

_______________________________________________
sumo-user mailing list
sumo-user@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/sumo-user

_______________________________________________
sumo-user mailing list
sumo-user@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/sumo-user

_______________________________________________
sumo-user mailing list
sumo-user@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/sumo-user

_______________________________________________
sumo-user mailing list
sumo-user@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/sumo-user

_______________________________________________
sumo-user mailing list
sumo-user@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/sumo-user