1

I'm build my tf-serving service with tensorflow-v1.12.0. I've tried all kinds of copt available for my CPU. But the result failed my expectation. The picture below shows the performances for each copt in my project. performances for each copt

I was wondering why the copt doesn't make any positive difference. reference: Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2

Roy Huang
  • 579
  • 3
  • 23

1 Answers1

0

Finally find it out by myself. It's because that I didn't enable mkl in compilation. The correct way to compile your TF with CPU instructions set optimization is to add "--config=mkl -c opt --copt=mavx2"

It reduce about 20% of predict time cost in my project.

Roy Huang
  • 579
  • 3
  • 23