remove timezone from timestamp column of pandas dataframe

Question

Data loaded with column as pandas date time:

df = pd.read_csv('test.csv', parse_dates=['timestamp'])
df


   user         timestamp           speed
0   2   2016-04-01 01:06:26+01:00   9.76
1   2   2016-04-01 01:06:26+01:00   5.27
2   2   2016-04-01 01:06:26+01:00   8.12
3   2   2016-04-01 01:07:53+01:00   8.81

I want to remove time zone information from timestamp column:


df['timestamp'].tz_convert(None)

TypeError: index is not a valid DatetimeIndex or PeriodIndex

Would this post help answer your problem? https://stackoverflow.com/questions/10944047/how-can-i-remove-a-pytz-timezone-from-a-datetime-object — Kim Hyun Bin, Sep 20 '22 at 11:40
that answer didn't work in my case. it demonstrated a single-column dataframe. — Amina Umar, Sep 20 '22 at 11:45

score 2 · Accepted Answer · answered Sep 20 '22 at 11:59

2

For this solution to work the column should be datetime

df['timestamp'].dt.tz_localize(None)

answered Sep 20 '22 at 11:59

Shubham Srivastava

1,190
14
28

score 1 · Answer 2 · answered Sep 20 '22 at 12:04

Given strings in your csv like "2016-04-01 01:06:26+01:00", I can think of the following options:

import pandas as pd

# will only work if *all* your timestamp contain "+hh:mm"
df = pd.read_csv('test.csv', parse_dates=['timestamp'])
df['timestamp'] = df.timestamp.dt.tz_localize(None)

print(df.timestamp.dtype)
datetime64[ns]

df = pd.read_csv('test.csv')
df['timestamp'] = pd.to_datetime(df.timestamp.str.split('+', expand=True)[0])

print(df.timestamp.dtype)
datetime64[ns]

df = pd.read_csv('test.csv', parse_dates=['timestamp'],
                 date_parser=lambda x: pd.to_datetime(x.split('+')[0]))

print(df.timestamp.dtype)
datetime64[ns]

remove timezone from timestamp column of pandas dataframe

2 Answers2