# Package org.apache.sysds.runtime.controlprogram.paramserv.dp

package org.apache.sysds.runtime.controlprogram.paramserv.dp

Related Packages
Package
Description
org.apache.sysds.runtime.controlprogram.paramserv
org.apache.sysds.runtime.controlprogram.paramserv.homomorphicEncryption
org.apache.sysds.runtime.controlprogram.paramserv.rpc
Classes
Class
Description
BalanceToAvgFederatedScheme
Balance to Avg Federated scheme When the parameter server runs in federated mode it cannot pull in the data which is already on the workers.
DataPartitionerSparkAggregator
DataPartitionerSparkMapper
DataPartitionFederatedScheme
DataPartitionFederatedScheme.BalanceMetrics
DataPartitionFederatedScheme.Result
DataPartitionLocalScheme
DataPartitionSparkScheme
DCLocalScheme
Disjoint_Contiguous data partitioner: for each worker, use a right indexing operation X[beg:end,] to obtain contiguous, non-overlapping partitions of rows.
DCSparkScheme
Spark Disjoint_Contiguous data partitioner:
DRLocalScheme
Data partitioner Disjoint_Random: for each worker, use a permutation multiply P[beg:end,] %*% X, where P is constructed for example with P=table(seq(1,nrow(X)),sample(nrow(X), nrow(X))), i.e., sampling without replacement to ensure disjointness.
DRRLocalScheme
Disjoint_Round_Robin data partitioner: for each worker, use a permutation multiply or simpler a removeEmpty such as removeEmpty (target=X, margin=rows, select=(seq(1,nrow(X))%%k)==id)
DRRSparkScheme
Spark Disjoint_Round_Robin data partitioner:
DRSparkScheme
Spark data partitioner Disjoint_Random: For the current row block, find all the shifted place for each row (WorkerID => (row block ID, matrix)
FederatedDataPartitioner
KeepDataOnWorkerFederatedScheme
Keep Data on Worker Federated scheme When the parameter server runs in federated mode it cannot pull in the data which is already on the workers.
LocalDataPartitioner
ORLocalScheme
Data partitioner Overlap_Reshuffle: for each worker, use a new permutation multiply P %*% X, where P is constructed for example with P=table(seq(1,nrow(X),sample(nrow(X), nrow(X))))
ORSparkScheme
Spark data partitioner Overlap_Reshuffle:
ReplicateToMaxFederatedScheme
Replicate to Max Federated scheme When the parameter server runs in federated mode it cannot pull in the data which is already on the workers.
ShuffleFederatedScheme
Shuffle Federated scheme When the parameter server runs in federated mode it cannot pull in the data which is already on the workers.
SparkDataPartitioner
SubsampleToMinFederatedScheme
Subsample to Min Federated scheme When the parameter server runs in federated mode it cannot pull in the data which is already on the workers.