how can i compute similarity degree scala spark

Asked Jun 26 '20 at 11:56

Active Jun 26 '20 at 11:57

Viewed 33 times

I'm working on a similarity computing function on an RDD containing protein names and their domains.

Actually i used the cartisian function to determine all possible pairs in my rdd, they look like

((**P29535**,IPR004839;IPR004838;IPR015424;IPR015422;IPR0154),(**A6MML6**,IPR034733;IPR000438;IPR029045;IPR0117))

(PS: its just an example, the resulting pairs that i found are millions..)

the words written in bold are the proteins names and the rest is their domains. can you please help me to determine the similarity degree between them based on their domains?

i would like to have a result such as:

*protein_name1* + "and" + *protein_name2* + "have a similiarity degree equals to:" + *similarity*

edited Jun 26 '20 at 11:57

zx8754

52,746
12
114
209

asked Jun 26 '20 at 11:56

amelie

is [this answer](https://stackoverflow.com/a/43922384/2129801) helpful? – werner Jun 28 '20 at 19:41
@werner sorry i didn't see any answer.. where is it? – amelie Jun 29 '20 at 19:43
I meant the link in my comment. Maybe this link can give you a hint? If not, just ignore my comment – werner Jun 29 '20 at 19:48
oh thank you but this is python not scala! – amelie Jun 29 '20 at 20:11

how can i compute similarity degree scala spark

0 Answers0