WARNING: THIS SITE IS A MIRROR OF GITHUB.COM / IT CANNOT LOGIN OR REGISTER ACCOUNTS / THE CONTENTS ARE PROVIDED AS-IS / THIS SITE ASSUMES NO RESPONSIBILITY FOR ANY DISPLAYED CONTENT OR LINKS / IF YOU FOUND SOMETHING MAY NOT GOOD FOR EVERYONE, CONTACT ADMIN AT ilovescratch@foxmail.com
Skip to content

Conversation

@qti-vaiskv
Copy link
Contributor

@qti-vaiskv qti-vaiskv commented Dec 5, 2025

Adds support for SME1 int4 GEMM and GEMMV kernels.

@qti-vaiskv qti-vaiskv marked this pull request as draft December 5, 2025 07:34
@qti-vaiskv qti-vaiskv changed the title SME1 support for int4 GEMM kernels SME1 support for int4 GEMM and GEMMV kernels Dec 5, 2025
Copy link
Collaborator

@dsharlet dsharlet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like this is adding a new dependency, a fork of KleidiAI? https://github.com/qualcomm/kleidiai

We can't have two versions of the same library in our repo. I'm surprised it works at all.

Is it even necessary? https://github.com/qualcomm/kleidiai doesn't appear to have any commits that aren't in the upstream repo.

@qti-vaiskv
Copy link
Contributor Author

qti-vaiskv commented Dec 5, 2025

There are few missing SME1 kernels especially the int4 datatypes in the parent Kleidiai. We have added support for these kernels in Qualcomm's fork of Kleidiai.

We are maintaining this repo to account for these missing kernels and there will not be any duplicate definitions of the functions that are already part of Kleidiai.

https://github.com/qualcomm/kleidiai/commits/kleidiai-qmx-xnnpack/

Note: In this PR we have added only the cmake support. We will add the bazel support as well in this same PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants