Suppose I have a neural network with fixed architecture. If I input one data point, the running time is 1s. Then what is the running time if the input is N data points?
Is it O(1) or O(N)? In other words, does the running time depend on the number of inputs in a linear way or constant? I heard the term "vectorization", which can reduce running time and is used in the feedforward neural network. But is vectorization constant in size?