flyte.extras

Flyte extras package. This package provides various utilities that make it possible to build highly customized workflows.

ContainerTask: Execute arbitrary pre-containerized applications, without needing the flyte-sdk to be installed. This extra uses flyte copilot system to inject inputs and slurp outputs from the container run.
DynamicBatcher / TokenBatcher: Maximize resource utilization by batching work from many concurrent producers through a single async processing function. DynamicBatcher is the general-purpose base; TokenBatcher is a convenience subclass for token-budgeted LLM inference with reusable containers.
Sleep: Route a task to the backend core-sleep plugin, which executes in leaseworker with no task pod.
Shell: Wrap a CLI tool packaged in a container image. Designed as the foundation for bio module libraries (bedtools, samtools, bcftools, GATK, etc.) and any other case where a user wants to call a pre-built binary in a published container with typed inputs and outputs.

Directory

Classes

Class	Description
`BatchStats`	Monitoring statistics exposed by `DynamicBatcher.stats`.
`ContainerTask`	This is an intermediate class that represents Flyte Tasks that run a container at execution time.
`DynamicBatcher`	Batches records from many concurrent producers and runs them through.
`Prompt`	Simple prompt record with built-in token estimation.
`Sleep`	Route a task to the backend `core-sleep` plugin.
`SleepTask`
`TokenBatcher`	Token-aware batcher for LLM inference workloads.

Protocols

Protocol	Description
`CostEstimator`	Protocol for records that can estimate their own processing cost.
`TokenEstimator`	Protocol for records that can estimate their own token count.

Methods

Method	Description
`serialize()`	Translate a single task to its wire TaskSpec, offline and code-agnostic.
`serialize_env()`	Serialize every task in an environment.

Methods

serialize()

        
    
def serialize(
    task: TaskTemplate,
    ctx: Optional[SerializationContext] = None,
) -> task_definition_pb2.TaskSpec

Translate a single task to its wire TaskSpec, offline and code-agnostic.

Reuses the same translate_task_to_wire primitive the run/deploy path uses (see _Runner._build_task_spec_from_template), but without a client, image cache, or code bundle, so the spec can be produced ahead of time. Pass a SerializationContext to override the defaults.

Parameter	Type	Description
`task`	`TaskTemplate`
`ctx`	`Optional[SerializationContext]`

serialize_env()

        
    
def serialize_env(
    env: TaskEnvironment,
    ctx: Optional[SerializationContext] = None,
) -> List[task_definition_pb2.TaskSpec]

Serialize every task in an environment.

Parameter	Type	Description
`env`	`TaskEnvironment`
`ctx`	`Optional[SerializationContext]`