Trait dslab_mr::dag::Shuffle

source · 
pub trait Shuffle {
    // Required method
    fn shuffle(
        &self,
        input: &[DataItem],
        dfs: &DistributedFileSystem,
        output_tasks: usize
    ) -> Vec<Vec<DataItem>>;
}
Expand description

Trait which represents shuffle edge.

Required Methods§

source

fn shuffle( &self, input: &[DataItem], dfs: &DistributedFileSystem, output_tasks: usize ) -> Vec<Vec<DataItem>>

Gets input data for a stage and returns vector of size output_tasks with all input split into output_tasks parts.

Implementors§