This is covered in Is java.util.logging.FileHandler in Java 8 broken?. Update your JDK 8 to update 40 or newer which contains the fix for JDK-8048020.
You should expect to see lock files when the FileHandler is open. If you see them linger after the VM exits, then it is because the The FileHandler was not closed, the VM was halted or crashed while the handler shutdown hook was running, or an I/O exception took place while trying to remove them.
The platform you are running on also plays a role when it comes to the implementation of FileLock used by the FileHandler. The FileLock documentation comes with the following warning:
Whether or not a lock actually prevents another program from accessing the content of the locked region is system-dependent and therefore unspecified. The native file-locking facilities of some systems are merely advisory, meaning that programs must cooperatively observe a known locking protocol in order to guarantee data integrity. On other systems native file locks are mandatory, meaning that if one program locks a region of a file then other programs are actually prevented from accessing that region in a way that would violate the lock. On yet other systems, whether native file locks are advisory or mandatory is configurable on a per-file basis. To ensure consistent and correct behavior across platforms, it is strongly recommended that the locks provided by this API be used as if they were advisory locks.
That means the FileHandler can have different locking behavior on different platforms.
Also related to lock files is garbage collection of loggers which won't close the attached handlers. These issues are covered under JDK-8060132: Handlers configured on abstract nodes in logging.properties are not always properly closed and JDK-6274920: JDK logger holds strong reference to java.util.logging.Logger instances.