flutter_onnxruntime_genai 0.1.1 copy "flutter_onnxruntime_genai: ^0.1.1" to clipboard
flutter_onnxruntime_genai: ^0.1.1 copied to clipboard

Published 5 days ago • Latest: 0.4.1
[unknown platforms]
→

Metadata

A Flutter FFI plugin wrapping Microsoft ONNX Runtime GenAI C-API for on-device multimodal inference on Android and iOS devices.

More...

0.1.1 #

  • Include prebuilt stripped native libraries for Android and iOS.
  • Reduced package size for pub.dev compatibility.
  • Updated documentation.

0.1.0 #

  • Initial experimental release.
  • Support for ONNX Runtime GenAI C-API.
  • Multimodal inference support (Text + Image) for models like Phi-3.5 Vision.
  • Support for Android (with 16KB page alignment) and iOS.
  • Async induction via background isolates.
  • Token-by-token streaming output.

← Metadata

1
likes
0
points
215
downloads

Publisher

unverified uploader

Weekly Downloads

Metadata

A Flutter FFI plugin wrapping Microsoft ONNX Runtime GenAI C-API for on-device multimodal inference on Android and iOS devices.

Repository (GitHub)
View/report issues

Topics

#onnx #ai #genai #onnxruntime #onnxruntime-genai

License

unknown (license)

Dependencies

ffi, flutter

More

Packages that depend on flutter_onnxruntime_genai

Packages that implement flutter_onnxruntime_genai

Back