I was just having the same problem today, and I found the solution here :
Android: how to return to Activity with "noHistory" attribute after onStop?
In fact, with noHistory set to true, when the screen goes to sleep, your activity is removed from the stack, and it is not restored when the screen wakes up.
I removed noHistory=true from the layout xml file, and just called finish() when my activity calls another one :
Intent intent = new Intent();
intent.setClass(this, MainActivity.class);
this.startActivity(intent);
finish();
That made the trick ! The previous activity does not appear when I click on the back button.
I am not sure about whether the issue happened on Android 2.x, but what i am sure about is that is working perfectly now on both Android v2.x and Android v4.x