I can suggest you thing with doing some calculations of your div.
add:
document.addEventListener("touchStart",<method>,true/false),
document.addEventListener("touchMove",<method>,true/false)
document.addEventListener("touchEnd",<method>,true/false).
When you start scrolling respective methods will start calling. In touchMove specified method calculate the height of the div which you are doing scrolling.
If scrolling came to the end (means div height max reached) allow user to scroll once finger removed touchEnd
respective method will call. There see the current e.changedTouches.pageY
it will give you the current place of the div on the scree. simply set the height of the div to the actual height of the div. I hope it will help you