Sa mt copy - #1453
Conversation
Signed-off-by: Gautier Bureau <gautier.bureau@rte-france.com>
|
@gautierbureau I tested this PR against main on the same setup as #1442:
8 threadsMain vs
|
| Main | COPY + SLICE |
|---|---|
![]() |
![]() |
| 1125 s | 1047 s (-7%) |
Main vs NETWORK_PER_THREAD_MODE=COPY
CONTINGENCY_PARTITIONING_MODE=ROUND_ROBIN
| Main | COPY + ROUND_ROBIN |
|---|---|
![]() |
![]() |
| 1125 s | 828 s (-36%) |
64 threads
Main vs NETWORK_PER_THREAD_MODE=COPY
CONTINGENCY_PARTITIONING_MODE=SLICE
| Main | COPY + SLICE |
|---|---|
![]() |
![]() |
| 321 s | 353 s (+10%) |
Main vs NETWORK_PER_THREAD_MODE=COPY
CONTINGENCY_PARTITIONING_MODE=ROUND_ROBIN
| Main | COPY + ROUND_ROBIN |
|---|---|
![]() |
![]() |
| 321 s | 271 s (-15%) |
The COPY optimization only does not show significant improvements (in my use case, it's even a regression for the 64 threads case depending on the contingency slicing I guess).
COPY + ROUND_ROBIN has an important impact on results, thread utilization is significantly more balanced, with workers finishing at nearly the same time. I think that we can improve a bit the 64 threads results, it looks like some threads are not fully used between 50 and 100s of calculation (?). It might be something to look after
I observed a memory use jump in the 64 threads case (+30%) but I didn't look at it in details and it might not be confirmed but it's something to check I think. Maybe just a JVM behavior.
Note: after a quick look it looks like the slow down between 50 and 100s of calculation is due to calculating a batch of non-converging contingencies.






Please check if the PR fulfills these requirements
Does this PR already have an issue describing the problem?
Close issue #1442
What kind of change does this PR introduce?
What is the current behavior?
What is the new behavior (if this is a feature change)?
Does this PR introduce a breaking change or deprecate an API?
If yes, please check if the following requirements are fulfilled
What changes might users need to make in their application due to this PR? (migration steps)
Other information: