I am trying to merge two large dataframes (1 column, but a lot of rows in each), but I get a memory error when doing so. My attempt so far was to only merge the first 10,000 rows which works but is obviously not a viable solution:
df_merged = pd.merge(pd.DataFrame(df1.iloc[0:10000]),pd.DataFrame(df2.iloc[0:10000]),on = ['tickers','level_1'])
Can anyone suggest a solution to this problem?