########################
Enot distributed package
########################

enot.distributed package contains distributed training utilities. If you use
distributed training with ENOT framework, it is recommended to use this
package's functional.


**************
Initialization
**************

.. autofunction:: enot.distributed.enot_init_process_group

.. autofunction:: enot.distributed.init_torch


****************************
Common distributed utilities
****************************

.. autofunction:: enot.distributed.get_world_size

.. autofunction:: enot.distributed.get_local_rank

.. autofunction:: enot.distributed.is_dist

.. autofunction:: enot.distributed.is_master

.. autofunction:: enot.distributed.is_local_master

.. autofunction:: enot.distributed.master_only

.. autofunction:: enot.distributed.dist_only


*********************
Model synchronization
*********************

.. autofunction:: enot.distributed.sync_model