Pinned Loading

1. coreml-llm-cli coreml-llm-cli Public

   CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.

   Swift 71 4

2. CoreMLInspect CoreMLInspect Public

   See the device (CPU/GPU/ANE) and estimated cost for every layer in your CoreML model.

   Swift 18 2

3. more-ane-transformers more-ane-transformers Public

   Run transformers (incl. LLMs) on the Apple Neural Engine.

   Python 55 2

4. token-recycling token-recycling Public

   Unofficial implementation of Token Recycling self-speculative decoding method.

   Python 1