Skip to content

[ICS] The benchmark result with google_gemma-4-E4B-it-Q4_K_M.gguf model on NPU is not satisfactory #238

Description

@haarika-madaka

While testing llama-bench with google_gemma-4-E4B-it-Q4_K_M.gguf model on CPU, GPU and NPU.
The benchmark results on NPU is too low when running tg128 test.

We are able to reproduce the behavior on LNL
./build/ReleaseOV/bin/llama-bench -m ~/models/google_gemma-4-E4B-it-Q4_K_M.gguf

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    Status
    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions