This algorithm from wikipedia should work. It only requires you to input the coordinates of the points that delimit each cell. Since Voronoi cells are guaranteed to be non-self-intersecting and convex, this should be enough. Transcoding a bit (StackOverflow doesn't do nice math)
The centroid of a non-self-intersecting closed polygon defined by
''n'' vertices (x0,y0),
(x1,y1), ...,
(xn−1,yn−1) is the
point (Cx, Cy), given by
Cx = 1/(6*A) * sum((x[i] + x[i+1]) * (x[i]*y[i+1] - x[i+1]*y[i])
Cy = 1/(6*A) * sum((y[i] + y[i+1]) * (x[i]*y[i+1] - x[i+1]*y[i])
With A the area, calculated as
A = 1/2 * sum(x[i]*y[i+1] - x[i+1]*y[i])
Where all those sum
represent Σ from i=0 to i=n-1