Skip to content

support float4 for embedding#424

Open
jiangxiaobin96 wants to merge 1 commit into
xlite-dev:mainfrom
jiangxiaobin96:feat/embedding_float4
Open

support float4 for embedding#424
jiangxiaobin96 wants to merge 1 commit into
xlite-dev:mainfrom
jiangxiaobin96:feat/embedding_float4

Conversation

@jiangxiaobin96

@jiangxiaobin96 jiangxiaobin96 commented May 25, 2026

Copy link
Copy Markdown

embedding_f32x4_float4_kernel中直接用float4的写法会比embedding_f32x4_kernel依次读写性能更好一点

Signed-off-by: jiangxiaobin96 <401236678@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant