llamafu 0.1.0 copy "llamafu: ^0.1.0" to clipboard
llamafu: ^0.1.0 copied to clipboard

Published 36 days ago
SDKFlutter
PlatformAndroidiOS
→

Metadata

A Flutter package for running language models on device with support for completion, instruct mode, tool calling, streaming, constrained generation, LoRA, and multi-modal inputs (images, audio).

More...

0.1.0 #

  • Initial public release
  • Text generation with streaming support
  • Chat completions with conversation history
  • Vision/multimodal support (images, audio) with LLaVA, Qwen2-VL
  • Tool calling / function calling
  • Structured JSON output with schema validation
  • Grammar-constrained generation (GBNF)
  • LoRA adapter loading and hot-swapping
  • Embeddings generation
  • Cross-platform: Android (API 21+) and iOS (12.0+)
  • Comprehensive documentation and examples

0.0.1 #

  • Initial development release
  • Basic text completion functionality
  • Android and iOS support
  • FFI bindings for Dart
  • Multi-modal support (images, audio)
  • LoRA adapter support
  • Constrained generation with GBNF grammars
  • Streaming output support
  • Comprehensive API documentation
  • Example application demonstrating all features
  • Unit tests for core functionality

← Metadata

0
likes
120
points
40
downloads

Publisher

unverified uploader

Weekly Downloads

Metadata

A Flutter package for running language models on device with support for completion, instruct mode, tool calling, streaming, constrained generation, LoRA, and multi-modal inputs (images, audio).

Topics

#ai #llm #llama #on-device #machine-learning

Documentation

API reference

License

MIT (license)

Dependencies

ffi, flutter

More

Packages that depend on llamafu

Packages that implement llamafu

Back