Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions packages.yml
Original file line number Diff line number Diff line change
Expand Up @@ -797,3 +797,5 @@ packages:
js: "n/a"
downloads: 188
downloads_updated_at: '2026-06-15T00:31:43.789982+00:00'
- name: langchain-aneforge
repo: sbryngelson/langchain-aneforge
35 changes: 35 additions & 0 deletions src/oss/python/integrations/providers/aneforge.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
---
title: "ANEForge"
description: "Run LangChain embeddings on the Apple Neural Engine via ANEForge."
---

[`langchain-aneforge`](https://github.com/sbryngelson/langchain-aneforge) runs a
sentence-embedding model on the Apple Neural Engine through
[ANEForge](https://github.com/sbryngelson/ANEForge), with no CoreML. It runs on
Apple Silicon macOS.

## Installation and setup

<CodeGroup>
```bash pip
pip install langchain-aneforge
```

```bash uv
uv add langchain-aneforge
```
</CodeGroup>

## Embeddings

`ANEEmbeddings` is a `langchain_core.embeddings.Embeddings` that encodes on the
Neural Engine. The pooling mode and normalize flag are read from each model's
sentence-transformers config, so mean-pooled (MiniLM, E5) and cls-pooled (BGE, GTE)
models both produce correct vectors.

```python
from langchain_aneforge import ANEEmbeddings

embeddings = ANEEmbeddings(model="sentence-transformers/all-MiniLM-L6-v2")
vector = embeddings.embed_query("the Apple Neural Engine runs networks at low power")
```
Loading