Internals of kMeansTaim - 2023.2 English

This document describes the structure and execution of kMeansTrain, implemented as kMeansPredict function.

kMeansTrain fits new centers based native k-means using the existed samples and initial centers provied by user. In order to achieve to accelertion training, DV elements in a sample are input at the same time and used for computing distance with KU centers and updating centers. The static configures are set by template parameters and dynamic by arguments of the API in which dynamic ones should not greater than static ones.

There are Applicable conditions:

1.Dim*Kcluster should less than a fixed value. For example, Dim*Kcluster<=1024*1024 for centers with float stored in URAM and 1024*512 for double on U250.

2.KU and DV should be configured properly due to limitation to URAM. For example,KU*DV=128 when centers are stored in URAM on U250.

3.The dynamic confugures should close to static ones in order to void unuseful computing inside.

Benchmark

The below results are based on:

1. dataset from UCI;

   1. http://archive.ics.uci.edu/ml/datasets/NIPS+Conference+Papers+1987-2015
   2. http://archive.ics.uci.edu/ml/datasets/Human+Activity+Recognition+Using+Smartphones
   3. http://archive.ics.uci.edu/ml/datasets/US+Census+Data+%281990%29

2. all data as double are processed;
3. unroll factors DV=8 and KU=16;
4. results compared to Spark 2.4.4 and initial centers from Spark to ensure same input;
5. Spark 2.4.4 is deployed in a server which has 56 processers(Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz)