20

Tensorflow explains that models can be saved in three file formats: .ckpt or .hdf5 or .pb. There's a lot of documentation so it would be nice to get a simpler comparison of when to use which file format.

Here's my current understanding:

ckpt

From https://www.tensorflow.org/guide/checkpoint:

Checkpoints capture the exact value of all parameters (tf.Variable objects) used by a model. Checkpoints do not contain any description of the computation defined by the model and thus are typically only useful when source code that will use the saved parameter values is available.

So it seems like you should use cpkt for checkpointing during training when you know that your source code will be the same. Why is it recommended though over .pb and .hdf5? Does it save space? Does it include data that the other file formats do not?

pb

Also from https://www.tensorflow.org/guide/checkpoint:

The SavedModel format on the other hand includes a serialized description of the computation defined by the model in addition to the parameter values (checkpoint). Models in this format are independent of the source code that created the model. They are thus suitable for deployment via TensorFlow Serving, TensorFlow Lite, TensorFlow.js, or programs in other programming languages (the C, C++, Java, Go, Rust, C# etc. TensorFlow APIs).

The SavedModel format is .pb plus some metadata. So you should save in .pb when you are deploying a model?

hdf5

Use when saving the model weights (matrix of numbers) only?

skeller88
  • 4,276
  • 1
  • 32
  • 34

1 Answers1

20

It seems you already know some of the differences, but just to add.

.ckpt
This is mainly used for resuming the training and also to allow users to customize savepoints and load to (ie. Highest Accuracy, Latest Trained Model, etc).
And also to create different models from different training checkpoints.
This only saves the weights of the variables or the graph therefore as you indicated you need to have full architectures and functions used.

.pb (Protobuffer)
This is the TensorFlow file format which saves everything about the Model including custom objects, this is the recommended file format to ensure maximum portability when using and exporting to different platforms (ie. Tensorflow Lite, Tensorflow Serving, etc.).

.h5 (HD5F)
This is the suggested saving format of Native Keras, which also saves everything about the model but when used in TensorFlow 2.1.0 (import tensorflow.keras) it will not save the custom objects automatically and will require additional steps to be performed.

You could read more about it in this link.

TF_Support
  • 1,794
  • 1
  • 7
  • 16
  • I noticed that using `.h5` format results in smaller size of a checkpoint, compared with `.ckpt`. – Grwlf Apr 20 '20 at 20:12
  • Hi @grwlf, when you save in ```.h5``` it really depends on what you are saving, but this is mainly used for saving the whole model, as HD5F is a compressed file. But when using Tensorflow you might need to do extra steps to use the data, as the ```.ckpt``` and ```.pb``` file types are the ones completely Tensorflow supported. – TF_Support Apr 21 '20 at 01:50