I have 4 sets of manually tagged data for 0 and 1, by 4 different people. I have to get the final labelled data in terms of 0 and 1 using the 4 sets of manually tagged data. I have calculated the degree of agreement between the users as A-B : 0.3276, A-C : 0.3263, A-D : 0.4917, B-C : 0.2896, B-D : 0.4052, C-D : 0.3540.
I do not know how to use this to calculate the final data as a single set. Please help.