Multi dimensional input multi dimensional output rnn keras data preprocessing

I want to create a RNN model in Keras. In each time-step the input has 9 element and the output has 4 element.

input_size = (304414,9)
target_size = (304414,4)

How can I create a dataset of sliding windows over the time-series.