Pandas add row to datetime indexed dataframe

user_14735411 0
Viewed 1781

I cannot find a solution for this problem. I would like to add future dates to a datetime indexed Pandas dataframe for model prediction purposes.

Here is where I am right now:

new_datetime = df2.index[-1:] # current end of datetime index
increment = '1 days' # string for increment - eventually will be in a for loop to add add'l days
new_datetime = new_datetime+pd.Timedelta(increment)

And this is where I am stuck. The append examples online only seem always seem to show examples with ignore_index=True , and in my case, I want to use the proper datetime indexing.

pandas row dataframe append datetime
3 Answers

Suppose you have this df:

                 date  value
0  2020-01-31 00:00:00      1
1  2020-02-01 00:00:00      2
2  2020-02-02 00:00:00      3

then an alternative for adding future days is

df.append(pd.DataFrame({'date': pd.date_range(start=df.date.iloc[-1], periods=6, freq='D', closed='right')}))

which returns

                 date  value
0  2020-01-31 00:00:00    1.0
1  2020-02-01 00:00:00    2.0
2  2020-02-02 00:00:00    3.0
0  2020-02-03 00:00:00    NaN
1  2020-02-04 00:00:00    NaN
2  2020-02-05 00:00:00    NaN
3  2020-02-06 00:00:00    NaN
4  2020-02-07 00:00:00    NaN

where the frequency is D (days) day and the period is 6 days.

user_53636860

I think I was making this more difficult than necessary because I was using a datetime index instead of the typical integer index. By leaving the 'date' field as a regular column instead of an index adding the rows is straightforward.

One thing I did do was add a reindex command so I did not end up with wonky duplicate index values:

df = df.append(pd.DataFrame({'date': pd.date_range(start=df.date.iloc[-1], periods=21, freq='D', closed='right')}))
df = df.reset_index() # resets index
user_147354110

i also needed this and i solve merging the code that you share with the code on this other response add to a dataframe as I go with datetime index and end out with the following code that work for me.

data=raw.copy()
new_datetime = data.index[-1:] # current end of datetime index
increment = '1 days' # string for increment - eventually will be in a for loop to add add'l days
new_datetime = new_datetime+pd.Timedelta(increment)
today_df = pd.DataFrame({'value': 301.124},index=new_datetime)
data = data.append(today_df)
data.tail()

here 'value' is the header of your own dataframe

user_106023060
Related