Python
latest
Background
Gradient Accumulation
Examples
Gradient Clipping
Batch Normalization
Distributed training
Hugging Face
Mixed Precision
Frequently Asked Questions
macOS compatibility
Model format
TensorFlow >= 2.11 legacy
PyTorch
TensorFlow 1.x compatibility
API Documentation
Gradient Accumulation Wrappers
Custom Layers
General Utilities
Python
Index
Edit on GitHub
Index
A
|
B
|
C
|
F
|
G
|
I
|
L
|
O
|
R
|
S
|
T
|
U
A
AccumBatchNormalization (class in gradient_accumulator)
adaptive_clip_grad() (in module gradient_accumulator)
apply_accu_gradients() (gradient_accumulator.GradientAccumulateModel method)
apply_gradients() (gradient_accumulator.GradientAccumulateOptimizer method)
B
build() (gradient_accumulator.AccumBatchNormalization method)
C
call() (gradient_accumulator.AccumBatchNormalization method)
compute_norm() (in module gradient_accumulator)
F
from_config() (gradient_accumulator.GradientAccumulateOptimizer class method)
G
get_config() (gradient_accumulator.AccumBatchNormalization method)
(gradient_accumulator.GradientAccumulateOptimizer method)
get_moving_average() (gradient_accumulator.AccumBatchNormalization method)
GradientAccumulateModel (class in gradient_accumulator)
GradientAccumulateOptimizer (class in gradient_accumulator)
gradients (gradient_accumulator.GradientAccumulateOptimizer property)
I
iterations (gradient_accumulator.GradientAccumulateOptimizer property)
L
learning_rate (gradient_accumulator.GradientAccumulateOptimizer property)
O
optimizer (gradient_accumulator.GradientAccumulateOptimizer property)
R
reinit_grad_accum() (gradient_accumulator.GradientAccumulateModel method)
reset() (gradient_accumulator.GradientAccumulateOptimizer method)
reset_accum() (gradient_accumulator.AccumBatchNormalization method)
S
step (gradient_accumulator.GradientAccumulateOptimizer property)
T
train_step() (gradient_accumulator.GradientAccumulateModel method)
trainable (gradient_accumulator.AccumBatchNormalization property)
U
unitwise_norm() (in module gradient_accumulator)
update_variables() (gradient_accumulator.AccumBatchNormalization method)
Read the Docs
v: latest
Versions
latest
stable
Downloads
On Read the Docs
Project Home
Builds