EmbeddingTokenizerFile.fromSource constructor

EmbeddingTokenizerFile.fromSource(
  1. ModelSource source, {
  2. required String modelId,
})

Creates EmbeddingTokenizerFile from ModelSource, namespaced by modelId (the owning EmbeddingModelSpec's own model-file basename, without extension) — this is what keeps embeddinggemma's and Gecko's tokenizers distinct even though both are literally named sentencepiece.model.

Implementation

factory EmbeddingTokenizerFile.fromSource(
  ModelSource source, {
  required String modelId,
}) {
  final basename = InferenceModelFile._extractFilenameFromSource(source);
  final filename = FileNameUtils.namespaced(modelId, basename);
  return EmbeddingTokenizerFile(source: source, filename: filename);
}