add additional row by index increasing for every line of row

Asked Mar 22 '19 at 22:19

Active Mar 23 '19 at 00:49

Viewed 22 times

ratings_test = test_data.map(lambda l: l.split()).map(lambda a : 
    Row(userId=int(a[0]),movieId=int(a[1]),index=i)).cache()

I want the index row to be increasing

edited Mar 23 '19 at 00:49

Sterling Archer

asked Mar 22 '19 at 22:19

vamsy vaddi

Possible duplicate of [Primary keys with Apache Spark](https://stackoverflow.com/questions/33102727/primary-keys-with-apache-spark) – user10938362 Mar 23 '19 at 01:48
Use the zipWithIndex method on the RDD – sramalingam24 Mar 23 '19 at 23:36

0 Answers0