As indicating in many TF docs, the graph begin to build only when we create the sess and execute the sess.run() method.
Just now, I tested that:
X = tf.placeholder(dtype=tf.float32, shape=[100,28,28,1])
W = tf.get_variable(...)
Y = tf.matmul(X,W)
print(Y.get_shape()[0].value)
As see in this code, it outputs the particular the shape value of Y even I did not t create the session instance.
How to understand? Thank you!