Definition
The K-means clustering algorithm is a popular unsupervised machine learning algorithm used to group a set of data into clusters. It works by iteratively assigning data points to the nearest cluster centroid and then recalculating the centroids based on the new assignments. This process is repeated until the centroids no longer change significantly or a maximum number of iterations is reached.
Implementation
This implementation of the K-means clustering algorithm groups the given data into k
clusters. No maximum number of iterations is set, so the algorithm will run until convergence is reached.
- As no initial centroids are provided, start by using the first
k
data points as the initialcentroids
, usingArray.prototype.slice()
. - Initialize the
distances
array to store the distances between each data point and each centroid, as well as theclasses
array to store the cluster assignments for each data point. - Use a
while
loop to repeat the assignment and update steps as long as there are changes in the previous iteration, as indicated by theitr
variable. - Calculate the Euclidean distance between each data point and centroid using
Math.hypot()
,Object.keys()
, andArray.prototype.map()
. - Use
Array.prototype.indexOf()
andMath.min()
to find the closest centroid for each data point. - Update the cluster assignments in the
classes
array and check if any changes were made. - Recalculate the centroids by summing the data points assigned to each cluster and dividing by the number of data points in each cluster, using
Array.from()
,Array.prototype.reduce()
,Number.parseFloat()
, andNumber.prototype.toFixed()
. - Repeat the process until convergence is reached.
const kMeans = (data, k = 1) => {
const centroids = data.slice(0, k);
const distances = Array.from({ length: data.length }, () =>
Array.from({ length: k }, () => 0)
);
const classes = Array.from({ length: data.length }, () => -1);
let itr = true;
while (itr) {
itr = false;
for (let d in data) {
for (let c = 0; c < k; c++) {
distances[d][c] = Math.hypot(
...Object.keys(data[0]).map(key => data[d][key] - centroids[c][key])
);
}
const m = distances[d].indexOf(Math.min(...distances[d]));
if (classes[d] !== m) itr = true;
classes[d] = m;
}
for (let c = 0; c < k; c++) {
centroids[c] = Array.from({ length: data[0].length }, () => 0);
const size = data.reduce((acc, _, d) => {
if (classes[d] === c) {
acc++;
for (let i in data[0]) centroids[c][i] += data[d][i];
}
return acc;
}, 0);
for (let i in data[0]) {
centroids[c][i] = Number.parseFloat(
Number(centroids[c][i] / size).toFixed(2)
);
}
}
}
return classes;
};
kMeans([[0, 0], [0, 1], [1, 3], [2, 0]], 2); // [0, 1, 1, 0]
Complexity
The time complexity of the K-means clustering algorithm is O(n * k * d * i)
, where n
is the number of data points, k
is the number of clusters, d
is the number of dimensions in the data, and i
is the number of iterations until convergence. The space complexity is O(n * k + n * d)
, where the first term represents the space used by the centroids and classes arrays, and the second term represents the space used by the distances array.