modelBytesHint property
Web/WebGPU only: approximate model size in bytes, used to decide whether
to load the mem64 core up front (instead of waiting for an out-of-memory
failure and retrying). null when unknown. Native llama.cpp and
LiteRT-LM reject a non-null value.
Implementation
final int? modelBytesHint;