Scheduler.ConfigΒΆ

Component: Scheduler

class Scheduler.Config

Bases: ConfigBase

Parameters for the learning rate schedulers.

All Attributes (including base classes)

type: SchedulerType = <SchedulerType.NONE: 'none'>
step_size: int = 30
gamma: float = 0.1
T_max: int = 1000
eta_min: float = 0
patience: int = 5
threshold: float = 0.0001
threshold_is_absolute: bool = False
cooldown: int = 0
cut_frac: float = 0.1
ratio: int = 32
non_pretrained_param_groups: int = 2
lm_lr_multiplier: float = 1.0
lm_use_per_layer_lr: bool = False
lm_gradual_unfreezing: bool = True

Default JSON

{
    "type": "none",
    "step_size": 30,
    "gamma": 0.1,
    "T_max": 1000,
    "eta_min": 0,
    "patience": 5,
    "threshold": 0.0001,
    "threshold_is_absolute": false,
    "cooldown": 0,
    "cut_frac": 0.1,
    "ratio": 32,
    "non_pretrained_param_groups": 2,
    "lm_lr_multiplier": 1.0,
    "lm_use_per_layer_lr": false,
    "lm_gradual_unfreezing": true
}