generate abstract method

Stream<List<int>> generate(
  1. int contextHandle,
  2. String prompt,
  3. GenerationParams params, {
  4. List<LlamaContentPart>? parts,
})

Generates a stream of token bytes for a given prompt and context.

Implementation

Stream<List<int>> generate(
  int contextHandle,
  String prompt,
  GenerationParams params, {
  List<LlamaContentPart>? parts,
});