Merge multiple Dataframes into one Dataframe in Spark

Asked Oct 11 '16 at 20:54

Active Oct 11 '16 at 21:02

Viewed 492 times

I have a scenario where I am getting columns from 10 sources and each in form of dataframes(i.e. df1,df2,df3 .... df10) with one row value.Each dataframes has different set of Columns nothing in common. I need to Merge the Dataframes without using JOIN.

For Example :

DataFrame (df1) {Columns : age}:

DataFrame (df2) {Columns : height}:

4.8

Resultant DataFrame (rdf) {Columns : age,height}:

2,3.2

edited Oct 11 '16 at 21:02

asked Oct 11 '16 at 20:54

Govind

You need a union. – OneCricketeer Oct 11 '16 at 21:06
2

http://stackoverflow.com/questions/32882529/how-to-zip-twoor-more-dataframe-in-spark – Raphael Roth Oct 12 '16 at 05:56

Merge multiple Dataframes into one Dataframe in Spark

0 Answers0