voiage.parallel.distributed
Distributed and cluster-oriented execution helpers for HPC-style CPU workloads.
Classes
Section titled “Classes”- ClusterExecutionConfig Describe a CPU cluster or distributed execution topology.
Functions
Section titled “Functions”- partition_workload Split an item range into balanced slices.
- distributed_map Execute work across a CPU pool or a caller-supplied distributed executor.
- distributed_reduce Map distributed work and reduce it deterministically.
- distributed_chunk_map Execute chunk-oriented work in input order across local or distributed CPU workers.
- partition_counts Return balanced counts for a workload partition.
- chunked_numpy_partition Partition a 1D numpy array into balanced views for distributed CPU work.