I'm currently struggling when using Capsule Network (Keras version: CapsNet).
Each time I run more than 2-5 predictions in a row (in side a loop) the results vary a lot. I have tried to change so mange things. I have changed the optimizer from ADAM to SGD as well - but I simply can't make it 100 % stable and thereby be able to reproduce a given run - once again.
How can I make CapsNet 100% reproducible every run?