Skip to content

Burst support#15

Open
mbertuletti wants to merge 20 commits into
masterfrom
burst_support
Open

Burst support#15
mbertuletti wants to merge 20 commits into
masterfrom
burst_support

Conversation

@mbertuletti

Copy link
Copy Markdown

This PR adds burst support to the variable latency interconnect.

In systems where multiple interconnects are instantiated hierarchically, the arbitration across multiple initiators at the boundary between hierarchies causes a bottleneck in the request-per-cycle injected into the interconnect. The burst functionality solves the problem. We provide:

  • A burst_req_grouper module, that groups a parallel valid request in a burst request,
  • A burst_cutter module, that issues two bursts when the parallel request crosses the boundary between hierarchies and targets different arbitrators,
  • A burst_manager module, that receives a burst request and translates it into a parallel request,
  • A burst_rsp_grouper module, that increases the bandwidth of the response channel to send multiple words from a parallel response with the same resp_valid, thus reducing congestion to the arbiters also on the response path.

More details on the burst protocol applied to a system with hierarchical crossbars and wide memory requests initiators are in the following publication:

TCDM Burst Access: Breaking the Bandwidth Barrier in Shared-L1 RVV Clusters Beyond 1000 FPUs

@misc{shen2025tcdmburstaccessbreaking,
      title={TCDM Burst Access: Breaking the Bandwidth Barrier in Shared-L1 RVV Clusters Beyond 1000 FPUs}, 
      author={Diyou Shen and Yichao Zhang and Marco Bertuletti and Luca Benini},
      year={2025},
      eprint={2501.14370},
      archivePrefix={arXiv},
      primaryClass={cs.AR},
      url={https://arxiv.org/abs/2501.14370}, 
}

This paper is available on arXiv:2501.14370 [cs.AR].

Comment thread rtl/variable_latency_interconnect/variable_latency_interconnect.sv Outdated
Comment thread rtl/variable_latency_interconnect/variable_latency_interconnect.sv Outdated
Comment thread rtl/variable_latency_interconnect/burst_manager.sv Outdated
Comment thread rtl/variable_latency_interconnect/burst_rsp_grouper.sv Outdated
Comment thread rtl/variable_latency_interconnect/variable_latency_interconnect.sv Outdated
@mbertuletti mbertuletti requested a review from DiyouS June 5, 2025 06:25
Comment thread rtl/variable_latency_interconnect/variable_latency_interconnect.sv Outdated
@mbertuletti mbertuletti force-pushed the burst_support branch 2 times, most recently from a76e1a7 to 486a10b Compare September 10, 2025 14:11
@mbertuletti mbertuletti force-pushed the burst_support branch 2 times, most recently from 1837b50 to 1598ff7 Compare September 24, 2025 14:14
@mbertuletti mbertuletti marked this pull request as ready for review June 17, 2026 11:41
@mbertuletti mbertuletti requested a review from Paolo309 June 17, 2026 11:41
@mbertuletti mbertuletti requested a review from DiyouS June 22, 2026 15:34

@DiyouS DiyouS left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

parameter int unsigned NumOutLog2 = (NumOut > 32'd1) ? unsigned'($clog2(NumOut)) : 32'd1,
// Burst response type can be overwritten for DataWidth > 32b
// This can happen when the DataWidth includes transaction metadata
parameter type burst_resp_t = burst_pkg::burst_gresp_t

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MemPool relies on this line to override burst_resp_t with its own definition, which is slightly different from the default burst_pkg::burst_gresp_t. Removing it therefore seems to break the current MemPool interface.

Was the intention to update MemPool’s side of the interface as part of this change too?

MemPool's definition of the struct: https://github.com/pulp-platform/mempool/blob/b4bd2b1ff61b0fdce1a0321306a99dbf3fcf44d4/hardware/src/mempool_tile.sv#L506-L518

MemPool's burst_resp_t override: https://github.com/pulp-platform/mempool/blob/b4bd2b1ff61b0fdce1a0321306a99dbf3fcf44d4/hardware/src/mempool_tile.sv#L541

@mbertuletti mbertuletti Jun 23, 2026

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants