dragon.distributed

Functions

all_reduce(…) : Reduce the input across all nodes in a group.

broadcast(…) : Broadcast the input from root node in a group.

is_initialized(…) : Whether the distributed environment has initialized.

init(…) : Initialize the distributed environment.

get_backend(…) : Return the backend of given process group.

get_group(…) : Return the current default process group.

get_rank(…) : Return the rank of current process.

get_world_size(…) : Return the world size of environment.

new_group(…) : Create a new communication group.