Skip to content

Schedule

samudra.utils.schedule

CosineSchedulerConfig

Bases: BaseModel

Cosine scheduler; see pytorch CosineAnnealingLR.

CosineWithTailSchedulerConfig

Bases: BaseModel

Cosine scheduler which goes to tail_lr for the last tail_epochs.

CosineWithWarmupConfig

Bases: BaseModel

Cosine scheduler which goes from warmup_lr to the default lr for the first warmup_epochs.