I had such setup and all was fine.
compileSdkVersion 25
buildToolsVersion "23.0.3"
classpath 'com.android.tools.build:gradle:2.2.3'
After increase to:
b uildToolsVersion '25.0.0'
classpath 'com.android.tools.build:gradle:2.3.0'
I got ClassNotFoundException for one of my providers.
I have tried with 24.0.3 - same issue.
P.S. i can't make compileSdkVersion lower, because app is in market