mlx_localllm 0.1.0
mlx_localllm: ^0.1.0 copied to clipboard
A high-performance local LLM plugin for macOS using Apple's MLX framework.
0.1.0 #
- Initial release.
- Support for local LLM inference on macOS (Apple Silicon).
- Native MLX framework integration.
- Robust model downloader with mirror support.
- Progress reporting and download cancellation.
- Model management (isDownloaded, deleteModel with error feedback).