modelBytesHint property

int? modelBytesHint
final

Web/WebGPU only: approximate model size in bytes, used to decide whether to load the mem64 core up front (instead of waiting for an out-of-memory failure and retrying). null when unknown. Native llama.cpp and LiteRT-LM reject a non-null value.

Implementation

final int? modelBytesHint;