Gradient Accumulation Wrappers
==============================

.. currentmodule:: gradient_accumulator

.. autosummary::

    GradientAccumulateModel
    GradientAccumulateOptimizer


GradientAccumulateModel
~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: GradientAccumulateModel
    :members:


GradientAccumulateOptimizer
~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: GradientAccumulateOptimizer
    :members:


Custom Layers
=============

.. currentmodule:: gradient_accumulator

AccumBatchNormalization
~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: AccumBatchNormalization
    :members:


General Utilities
=================

.. currentmodule:: gradient_accumulator

Adaptive Gradient Clipping
~~~~~~~~~~~~~~~~~~~~~~~~~~

.. autofunction:: compute_norm
.. autofunction:: unitwise_norm
.. autofunction:: adaptive_clip_grad