Repolode
投稿する
cactus-compute

cactus-compute/needle

A tiny on-device foundation model for tool calling, structured extraction, embeddings and speech-to-text on phones, wearables, robots and microcontrollers.

GitHub で見る公式サイト
スター
14,099
フォーク
1,091
未解決の Issue
4
最終コミット
12 時間前

これは何？

Needle is a small foundation model for automation on constrained hardware. The full model is an 8 to 29 MB binary, and it is built to pick the right functions from a list you expose, fill their arguments from what a user said, and return an empty list instead of guessing when no tool fits. It also extracts typed fields from messy text against a schema you declare, and returns a vector for a sentence so an app can search or route locally.

The Python package exposes a decorator-based API: a function's signature defines argument types, its docstring becomes the tool description, and a run call executes the matched function and returns its results. Each response includes the function calls, reasoning and a confidence score. Whistle, a companion speech-to-text model in a 16.9 MB file, shares the same runtime, so audio can go in and tool calls come out in one call. Whistle transcribes English, German, French, Spanish, Italian, Dutch and Polish.

Needle supports local fine-tuning with LoRA adapters, plus a hosted fine-tuning path, and ships prebuilt engines for multiple platform folders, a C API, browser and WASI targets. A community-maintained npm package, cactus-needle, runs it in Node.js and browsers.

主な機能

  • 01Selects tool calls and fills their arguments from user requests, returning an empty list when no tool applies.
  • 02Extracts typed fields from text according to a declared schema, with output guaranteed to parse.
  • 03Returns text embeddings for local search, matching and routing.
  • 04Transcribes speech with Whistle, including word timestamps, keyword biasing and live streaming.
  • 05Provides a Python decorator API that runs matched functions and returns their results.
  • 06Supports local LoRA fine-tuning and hosted fine-tuning across model depths.

ユースケース

  • Voice or text assistants on phones that trigger app actions locally.
  • Smart home and wearable devices that map spoken commands to device functions.
  • Extracting invoices, bookings or forms from messy text on an offline device.
  • Local speech-to-text on an always-on microphone paired with a wake word or voice activity detector.

トピック

#edge-ai#on-device-ai#tool-calling#function-calling#tinyml#speech-to-text#embeddings#cactus#foundation-model#llm

よくある質問

needle とは？
A tiny on-device foundation model for tool calling, structured extraction, embeddings and speech-to-text on phones, wearables, robots and microcontrollers. Needle is a small foundation model for automation on constrained hardware. The full model is an 8 to 29 MB binary, and it is built to pick the right functions from a list you expose, fill their arguments from what a user said, and return an empty list instead of guessing when no tool fits. It also extracts typed fields from messy text against a schema you declare, and returns a vector for a sentence so an app can search or route locally.
needle は無料で使えますか？ライセンスは？
needle は Apache-2.0 ライセンスのオープンソースです。商用製品で使う前にライセンス条件を確認してください。
needle は今もメンテナンスされていますか？
活発にメンテナンス中。needle の最終コミットは 2026年10月18日 です。
needle は何に使えますか？
Voice or text assistants on phones that trigger app actions locally. Smart home and wearable devices that map spoken commands to device functions. Extracting invoices, bookings or forms from messy text on an offline device. Local speech-to-text on an always-on microphone paired with a wake word or voice activity detector.
needle はどこで入手できますか？
ソースコードとインストール手順は GitHub にあります：https://github.com/cactus-compute/needle

概要はプロジェクトの README をもとに AI が生成しています。GitHub の数値は毎日更新されます。

関連プロジェクト