ai.local

ai.local

Explicit context-managed local model engines.

Classes

Name	Description
TransformersEngine	Own a Transformers model, tokenizer, PEFT adapters, and device resources.

TransformersEngine

ai.local.TransformersEngine(
    model,
    *,
    adapters=None,
    device_map='auto',
    quantization_config=None,
    revision=None,
)

Own a Transformers model, tokenizer, PEFT adapters, and device resources.