Pandas DatetimeIndex truncate error

Question

I have a pandas dataframe df:

Out[16]:
<class 'pandas.core.frame.DataFrame'>
DatetimeIndex: 269850 entries, 2012-12-19 16:15:36 to 2012-12-20 14:36:55
Data columns:
X1    269850  non-null values
X2      269848  non-null values
X3      269848  non-null values
dtypes: float64(2), object(1)

And I would like to slice the dataframe to return a four hour window of data from 2012-12-20 05:00:00 to 2012-12-20 09:00:00

When I try:

Slicedf = df.truncate(before='12/20/2012 05:00:00',after='12/20/2012 09:00:00')

The following error occurs:

KeyError: datetime.datetime(2012, 12, 20, 5, 0)

I have also tried (from Pandas DataFrame slicing by day/hour/minute):

from datetime import datetime
x=datetime(2012,12,20,5,0,0)
y=datetime(2012,12,20,9,0,0)
Slicedf = df.ix[x:y]

which returns the exact same error.

That's strange, could you update to 0.10.1? Does this also happen with `df1 = df.head()`? If so could you paste the contents of `df1.to_dict()`? (I tried with a dummy DataFrame early and it worked ok...) — Andy Hayden, Feb 01 '13 at 01:37
Currently with 0.10.0 `df1=df.head()` works fine. Will update pandas and try again. — Clayton, Feb 01 '13 at 10:39
Sorry I meant do `df1.truncate(..)` and `df1.ix[x:y]` work fine? — Andy Hayden, Feb 01 '13 at 15:47

score 5 · Answer 1 · answered Jul 26 '18 at 15:07

You might need to change it to:

df = df.sort_values() or df = df.sort_index() before the truncate function in order to fix the error in later versions of Pandas.

So your code would look like: df = df.sort_index().truncate(before='12/20/2012 05:00:00', after='12/20/2012 09:00:00')

sort was deprecated for DataFrames in favor of needing to use either sort_values or sort_index. You can find more details about each in the documentation here and here, respectively.

score 4 · Accepted Answer · answered Feb 06 '13 at 07:22

4

df was created by concatenating multiple dataframes together using the concat function.

df = df.sort() before truncation fixed the error.

answered Feb 06 '13 at 07:22

Clayton

1,525
5
19
35

Pandas DatetimeIndex truncate error

2 Answers2