Interface LlamaCppCallOptions

interface LlamaCppCallOptions {
maxTokens?: number;
onToken?: ((tokens: number[]) => void);
}

Hierarchy (view full)

Toolkit
- LlamaCppCallOptions

Index

Properties

maxTokens? onToken?

Properties

`Optional`maxTokens

maxTokens?: number

The maximum number of tokens the response should contain.

`Optional`onToken

onToken?: ((tokens: number[]) => void)

A function called when matching the provided token array