deepfold.distributed.model\_parallel
====================================

.. automodule:: deepfold.distributed.model_parallel

   
   .. rubric:: Functions

   .. autosummary::
   
      all_to_all
      broadcast
      broadcast_on_model_parallel_region
      col_to_row
      copy_to_model_parallel_reigon
      disable
      enable
      gather
      gather_from_model_parallel_region
      group
      group_rank
      initialize
      is_enabled
      is_initialized
      rank
      reduce
      reduce_from_model_parallel_region
      row_to_col
      scatter
      scatter_to_model_parallel_region
      size
      transpose_on_model_parallel_region
   
   .. rubric:: Classes

   .. autosummary::
   
      Disable
      Enable