The GradientLLM class is used to interact with Gradient AI inference Endpoint models. This requires your Gradient AI Access Token which is autoloaded if not specified.

Hierarchy (view full)

Constructors

Properties

model: any
modelSlug: string = "llama2-7b-chat"
adapterId?: string
gradientAccessKey?: string
inferenceParameters?: Record<string, unknown>
workspaceId?: string

Methods