KeyError: Failed to format this callback filepath

Question

I am trying to obtain the validation accuracy and the choose to save the model having the best accuracy.But after the 1st epoch,it is showing the checkpoint error.

filepath="tumor_detection-{epoch:02d}-{val_acc:.2f}.hdf5"

# save the model with the best validation (development) accuracy till now
checkpoint = ModelCheckpoint(filepath, monitor='val_acc', verbose=1, save_best_only=True, mode='max')

%%time
model.fit(xtrain,ytrain,batch_size=32,epochs=30,validation_data=(xval,yval),callbacks=[checkpoint])```

It is then showing an error as follows:
Epoch 1/30
51/51 [==============================] - ETA: 0s - loss: 0.4651 - accuracy: 0.7725
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in _get_file_path(self, epoch, logs)
   1243         # placeholders can cause formatting to fail.
-> 1244         return self.filepath.format(epoch=epoch + 1, **logs)
   1245       except KeyError as e:

KeyError: 'val_acc'

During handling of the above exception, another exception occurred:

KeyError                                  Traceback (most recent call last)
9 frames
<decorator-gen-60> in time(self, line, cell, local_ns)

<timed eval> in <module>()

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in _get_file_path(self, epoch, logs)
   1245       except KeyError as e:
   1246         raise KeyError('Failed to format this callback filepath: "{}". '
-> 1247                        'Reason: {}'.format(self.filepath, e))
   1248     else:
   1249       # If this is multi-worker training, and this worker should not

KeyError: 'Failed to format this callback filepath: "tumor_detection-{epoch:02d}-{val_acc:.2f}.hdf5". Reason: \'val_acc\'

I think this is a bug for tensorflow, I assume your tf version is 2.2.0 or higher? — Jim Chen, May 18 '20 at 16:12
I have tensorflow version 2.3.0. How do I solve this problem? — mm_, Aug 27 '20 at 05:17

score 16 · Answer 1 · answered Sep 05 '20 at 05:32

16

Replace both

'val_acc'

in file_path and checkpoint with

'val_accuracy'

and it will work.

answered Sep 05 '20 at 05:32

Mojtaba Abdi Khassevan

457
7
14

score 2 · Answer 2 · answered Sep 16 '20 at 15:46

2

This is possibly a duplicate of this question.

I had the same problem when training with a smaller dataset, where the validation split for the training data was 0.

answered Sep 16 '20 at 15:46

universvm

353
2
11

score 1 · Answer 3 · answered Aug 27 '20 at 05:25

I added validation_split=0.1 and worked for me:

...
my_callbacks = [
    tf.keras.callbacks.EarlyStopping(patience=2),
    tf.keras.callbacks.ModelCheckpoint(filepath='model.{epoch:02d}-{val_loss:.2f}.h5'),
    tf.keras.callbacks.TensorBoard(log_dir='./logs'),
]

history = model.fit(X_train, y_train, validation_split=0.1, epochs=200, callbacks=my_callbacks)

score 0 · Answer 4 · answered May 23 '22 at 15:22

0

It works if you remove validation_steps from mode.fit(). It worked for me particularly, when training with small data sets.

answered May 23 '22 at 15:22

Anil

1

score -2 · Answer 5 · edited Aug 29 '20 at 07:36

-2

replace this

val_accuracy

with this

val_acc

I Try this and it works

edited Aug 29 '20 at 07:36

Dilan

2,610
7
23
33

answered Aug 28 '20 at 06:01

Ska

1
1

KeyError: Failed to format this callback filepath

5 Answers5

Linked