The machine learning algorithm library running on Kunpeng processors is an acceleration library that provides a rich set of high-level tools for machine learning algorithms. It is based on the original APIs of Apache Spark 2.3.2, breeze 0.13.1 and xgboost 1.1.0. The acceleration library for greatly improves the computing power in big data scenarios.
The library provides eighteen machine learning algorithms: support vector machine (SVM), random forest classifier (RFC), gradient boosting decision tree (GBDT), decision tree (DT), K-means clustering, linear regression, logistic regression algorithm, principal component analysis (PCA), singular value decomposition (SVD), latent dirichlet allocation (LDA), prefix-projected pattern prowth (Prefix-Span), alternating least squares (ALS), K-nearest neighbors (KNN), Covariance, Density-based spatial clustering of applicaitons with noise (DBSCAN), Pearson, Spearman, and XGboost. You can find the latest documentation on the project web page. This README file contains only basic setup instructions. You can find the latest documentation, including a programming guide, on the project web page. This README file only contains basic setup instructions.
(1) Build the project under the "Spark-ml-algo-lib" directory:
mvn clean package
(2) Build XGBoost project under the "Spark-ml-algo-lib/ml-xgboost/jvm-packages" directory:
mvn clean package
(3) Obtain "boostkit-ml-core_2.11-1.3.0-spark2.3.2.jar" under the "Spark-ml-algo-lib/ml-core/target" directory.
Obtain "boostkit-ml-acc_2.11-1.3.0-spark2.3.2.jar" under the "Spark-ml-algo-lib/ml-accelerator/target" directory.
Obtain "boostkit-xgboost4j_2.11-1.3.0.jar" under the "Spark-ml-algo-lib/ml-xgboost/jvm-packages/boostkit-xgboost4j/target" directory.
Obtain "boostkit-xgboost4j-spark2.3.2_2.11-1.3.0.jar" under the "Spark-ml-algo-lib/ml-xgboost/jvm-packages/boostkit-xgboost4j-spark/target" directory.
Track the bugs and feature requests via GitHub issues.
For further assistance, send an email to [email protected].