SVM
BASE:
Mlib: RDD-Based
CATEGORY:
Classification/Regression
SUBCATEGORY:
Linear
PYSPARK NAME:
SVMWithSGD
INPUT:
LabeledPoint, weights, intercept, iterations
Logistic Regression
BASE:
MLlib: RDD-Based
CATEGORY:
Classification/Regression
SUBCATEGORY:
Linear
PYSPARK NAME:
LogisticRegressionWithLBFGS / LogisticRegressionWithSGD
INPUT:
LabeledPoint, weights, intercept, iterations
Linear Regression
BASE:
MLlib: RDD-Based
CATEGORY:
Classification/Regression
SUBCATEGORY:
Linear
PYSPARK NAME:
LinearRegressionWithSGD
INPUT:
LabeledPoint, initialWeights, regParam, regType
Ridge Regression
BASE:
MLlib: RDD-Based
CATEGORY:
Classification/Regression
SUBCATEGORY:
Linear
PYSPARK NAME:
RidgeRegressionWithSGD
INPUT:
LabeledPoint, initialWeights, regParam, regType
Lasso Regression
BASE:
MLlib: RDD-Based
CATEGORY:
Classification/Regression
SUBCATEGORY:
Linear
PYSPARK NAME:
LassoWithSGD
INPUT:
LabeledPoint, initialWeights, regParam, regType
Isotonic Regression
BASE:
MLlib: RDD-Based
CATEGORY:
Classification/Regression
SUBCATEGORY:
Linear
PYSPARK NAME:
IsotonicRegressionModel
INPUT:
boundaries(LabeledPoint), predictions, isotonic
Linear regression on streaming data
BASE:
MLlib: RDD-Based
CATEGORY:
Classification/Regression
SUBCATEGORY:
Linear
PYSPARK NAME:
StreamingLinearRegressionWithSGDINPUT:
LabeledPoint, stepSize, numIterations, miniBatchFraction, convergenceTol*
Alternating least squares (ALS)
BASE:
MLlib: RDD-Based
CATEGORY:
Collaborative filtering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
ALS
INPUT:
Ratings, rank, nonnegative
KMeans
BASE:
MLlib: RDD-Based
CATEGORY:
Clustering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
KMeans
INPUT:
RDD, k, maxIterations, epsilon
Gaussian Mixture
BASE:
MLlib: RDD-Based
CATEGORY:
Clustering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
GaussianMixture
INPUT:
RDD, k, convergenceTol
Power iteration clustering (PIC)
BASE:
MLlib: RDD-Based
CATEGORY:
Clustering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
PowerIterationClustering
INPUT:
RDD, k
Latent Dirichlet allocation (LDA)
BASE:
MLlib: RDD-Based
CATEGORY:
Clustering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
LDA
INPUT:
RDD, k, docConcentration, topicConcentration, checkpointInterval, optimizer
Naive Bayes
BASE:
MLlib: RDD-Based
CATEGORY:
Clustering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
NaiveBayesModel
INPUT:
LabeledPoint, pi, theta
Bisecting K-means
BASE:
MLlib: RDD-Based
CATEGORY:
Hierarchical clustering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
BisectingKMeans
INPUT:
RDD, k, minDivisibleClusterSize
Singular value
decomposition (SVD)
BASE:
MLlib: RDD-Based
CATEGORY:
Dimensionality reduction
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
RowMatrix.computeSVD
INPUT:
k, computeU, rCond
Streaming k-means
BASE:
MLlib: RDD-Based
CATEGORY:
Clustering
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
StreamingKMeans
INPUT:
LabeledPoint, k, decayFactor, timeUnit
Principal component
analysis (PCA)
BASE:
MLlib: RDD-Based
CATEGORY:
Dimensionality reduction
SUBCATEGORY:
Nonlinear
PYSPARK NAME:
RowMatrix.computePrincipalComponents
INPUT:
k
FP-growth
BASE:
MLlib: RDD-Based
CATEGORY:
Frequent Pattern Mining
SUBCATEGORY:
Data mining
PYSPARK NAME:
FPGrowth
INPUT:
RDD, minSupport, numPartitions
Prefix span
BASE:
MLlib: RDD-Based
CATEGORY:
Frequent Pattern Mining
SUBCATEGORY:
Data mining
PYSPARK NAME:
PrefixSpan
INPUT:
RDD, minSupport, maxPatternLength, maxLocalProjDBSize
Decision tree
BASE:
MLlib: RDD-Based
CATEGORY:
Classification / Regression
SUBCATEGORY:
Tree
PYSPARK NAME:
DecisionTreeModel
INPUT:
LabeledPoint, numClasses, categoricalFeaturesInfo, impurity, maxDepth, maxBins
Random forest
BASE:
MLlib: RDD-Based
CATEGORY:
Classification / Regression
SUBCATEGORY:
Tree
PYSPARK NAME:
RandomForestModel
INPUT:
LabeledPoint, numClasses, categoricalFeaturesInfo, numTrees, featureSubsetStrategy, impurity, maxDepth, maxBins
Gradient boost
BASE:
MLlib: RDD-Based
CATEGORY:
Classification / Regression
SUBCATEGORY:
Tree
PYSPARK NAME:
GradientBoostedTreesModel
INPUT:
LabeledPoint, categoricalFeaturesInfo, loss, numIterations, learningRate, maxDepth, maxBins
