{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# TanhLRScheduler"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"In this tutorial we are going to be looking at the `TanhLRScheduler` in the `timm` library in little more detail with all the supporting hyperparameters. "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"
"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {},
"outputs": [],
"source": [
"#hide\n",
"%load_ext autoreload\n",
"%autoreload 2"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [],
"source": [
"from timm.scheduler.tanh_lr import TanhLRScheduler\n",
"from nbdev.showdoc import show_doc"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {},
"outputs": [
{
"data": {
"text/markdown": [
"
class TanhLRScheduler[source]TanhLRScheduler(**`optimizer`**:`Optimizer`, **`t_initial`**:`int`, **`lb`**:`float`=*`-6.0`*, **`ub`**:`float`=*`4.0`*, **`t_mul`**:`float`=*`1.0`*, **`lr_min`**:`float`=*`0.0`*, **`decay_rate`**:`float`=*`1.0`*, **`warmup_t`**=*`0`*, **`warmup_lr_init`**=*`0`*, **`warmup_prefix`**=*`False`*, **`cycle_limit`**=*`0`*, **`t_in_epochs`**=*`True`*, **`noise_range_t`**=*`None`*, **`noise_pct`**=*`0.67`*, **`noise_std`**=*`1.0`*, **`noise_seed`**=*`42`*, **`initialize`**=*`True`*) :: `Scheduler`\n",
"\n",
"Hyberbolic-Tangent decay with restarts.\n",
"This is described in the paper https://arxiv.org/abs/1806.01593"
],
"text/plain": [
"