bs_find {fastai}

Bs_find

Description

Launch a mock training to find a good batch size to minimize training time.

Usage

bs_find(
  object,
  lr,
  num_it = NULL,
  n_batch = 5,
  simulate_multi_gpus = TRUE,
  show_plot = TRUE
)

Arguments

object

model/learner

lr

learning rate

num_it

number of iterations

n_batch

number of batches

simulate_multi_gpus

simulate on multi gpus or not

show_plot

show plot or not

Details

However, it may not be a good batch size to minimize the validation loss. A good batch size is where the Simple Noise Scale converge ignoring the small growing trend with the number of iterations if exists. The optimal batch size is about an order the magnitud where Simple Noise scale converge. Typically, the optimal batch size in image classification problems will be 2-3 times lower where