combined_flat_anneal {fastai}

Combined_flat_anneal

Description

Create a schedule with constant learning rate 'start_lr' for 'pct' proportion of the training, and a 'curve_type' learning rate (till 'end_lr') for remaining portion of training.

Usage

combined_flat_anneal(pct, start_lr, end_lr = 0, curve_type = "linear")

Arguments

pct

Proportion of training with a constant learning rate.

start_lr

Desired starting learning rate, used for beginnning pct of training.

end_lr

Desired end learning rate, training will conclude at this learning rate.

curve_type

Curve type for learning rate annealing. Options are 'linear', 'cosine', and 'exponential'.