keras sparse_categorical_crossentropy loss function output shape didn't match

user_4902784 0
Viewed 7243

I have a dataset which has 3570 labels. When I use the sparse_categorical_crossentropy as the loss function, the output shape didn't match.

model = Sequential()
model.add(Dense(1024, input_dim=79, activation='relu'))
model.add(Dense(2048, activation='relu'))
model.add(Dense(3570, activation='sigmoid'))

model.compile(loss='sparse_categorical_crossentropy',
              optimizer='rmsprop',
              metrics=['accuracy'])
model.fit(x_train, y_train,
          epochs=10,
          batch_size=1,
          validation_data=(x_valid, y_valid))

and the output is ValueError: Error when checking model target: expected dense_42 to have shape (None, 1) but got array with shape (1055, 3570)

Then I fount this issue#2444 and used np.expand_dims(y, -1) to change the code. But there was still have error. 

model = Sequential()
model.add(Dense(1024, input_dim=79, activation='relu'))
model.add(Dense(2048, activation='relu'))
model.add(Dense(3570, activation='sigmoid'))

model.compile(loss='sparse_categorical_crossentropy',
              optimizer='rmsprop',
              metrics=['accuracy'])
model.fit(x_train, np.expand_dims(y_train, -1),
          epochs=10,
          batch_size=1,
          validation_data=(x_valid, np.expand_dims(y_valid, -1)))

the error ValueError: Error when checking model target: expected dense_45 to have 2 dimensions, but got array with shape (1055, 3570, 1)

How should I change the code?

loss-function keras python
2 Answers

loss='sparse_categorical_crossentropy' is not meant for one-hot encodings but for integer targets. You probably need a "Dense(..." as the output layer and use y_train directly.

user_99054700
Related