xnn.common.distributed
======================

.. automodule:: xnn.common.distributed

   
   
   

   
   
   .. rubric:: Functions

   .. autosummary::
      :toctree:
   
      all_gather_cat
      all_reduce_sum
      barrier
      destroy_process_group
      init_process_group
      is_distributed
      is_main
      merge_dicts
      rank
      shard_indices
      world_size