I had this problem too, and even though it is apparenetly against the whole idea, I just wanted to nuke the app, as it was causing problems of various sorts that I could not figure it out without breaking another part and it did not matter if it started from scratch everytime. (And I did not want to spend any more days hurting my head with it.)
After trying all of the answers from this question and many similar ones I worked out that doing this in each activity solved it.
@Override protected void onPause(){
super.onPause();
super.finish();
int pid = android.os.Process.myPid();
android.os.Process.killProcess(pid);
}
(For now at least, as I believed I solved it a few times before).