[Performance] Question about performance of Deepep v2, the role of the prefer-overlap-with-compute parameter

[shenhongqian]

I would like to ask, what are the execution commands for the performance of the two machines shown in the figure below, and do they need to include --prefer-overlap-with-compute 1 ?

I am not aligned with the official performance data in my local environment, and the following are the test results.
[1]python tests/elastic/test_ep.py --num-processes 8 --allow-hybrid-mode 1 --num-sms 12 --reuse-elastic-buffer --num-topk 8 --num-tokens 8192 --prefer-overlap-with-compute 1 --num-qps 65

[2]python tests/elastic/test_ep.py --num-processes 8 --allow-hybrid-mode 1 --num-sms 12 --reuse-elastic-buffer --num-topk 8 --num-tokens 8192 --prefer-overlap-with-compute 0 --num-qps 65

[shenhongqian]

Can you help me take a look at this issue? Thank you @sphish @LyricZhao

[alpha-baby]

maybe you could try SMs == 16 , and will Improve the performance of combine

[kzlxd]

@shenhongqian --prefer-overlap-with-compute 1 is necessary