DGather {DSL}

Gather Distributed Data

Description

Retrieves "DList" data distributed as chunks.

Usage

DGather( x, keys = FALSE, n = -1L, names = TRUE )

Arguments

x

a "DList" object.

keys

logical; should only keys be retrieved from chunks? Default: FALSE, i.e., only values are retrieved.

n

an integer specifying the number of chunks to be read.

names

logical; should the return value be a named list? Default: TRUE.

Details

DGather() is similar to an MPI_GATHER (see http://www.mpi-forum.org/docs/mpi-3.1/mpi31-report/node103.htm#Node103) where: “[...] each process (root process included) sends the contents of its send buffer to the root process. The root process receives the messages and stores them in rank order.” For "DList" objects DGather() will gather data contained in chunks possibly distributed on a cluster of workstations and store it in a (possibly named) list. Note that depending of the size of the data, the resulting list may not fit into memory.

Value

A (named) list.

Examples

dl <- DList( line1 = "This is the first line.",
             line2 = "Now, the second line." )
DGather( dl )
## retrieve keys
unlist(DGather( dl, keys = TRUE, names = FALSE ))
## remove DList and garbage collect it
rm( dl )
gc()