Why does pandas remove duplicate data?

Asked Feb 17 '21 at 00:44

Active Feb 17 '21 at 00:58

Viewed 14 times

I pulled in some trade history from Binance and need to change the time column to a readable format. There are 203 columns and when running:

trades = client.get_my_trades(symbol='TRADINGPAIR')

trade_history = df(trades)

trade_history_time = trade_history['time']

final_time = []

for time in trade_history_time.unique():
    readable = datetime.fromtimestamp(int(time/1000))
    final_time.append(readable)

I now get readable times but now there is only 160 lines. What can I add to the code above so it keeps all dates in the column?

edited Feb 17 '21 at 00:58

John Conde

217,595
99
455
496

asked Feb 17 '21 at 00:44

besimon

Use `pd.to_datetime` to convert the date strings. – cs95 Feb 17 '21 at 01:00
Yes but the issue is columns are being removed. Will pd.to_datetime solve this? – besimon Feb 17 '21 at 02:16
Yes. You are iterating over `.unique()` instead of over the series. Doesn't look like all your dates are unique. – cs95 Feb 17 '21 at 02:36

Why does pandas remove duplicate data?

0 Answers0