Why Should Inner Classes Be Static By Default In Java?

Question

I've been reading posts about why to make inner classes static, and many mention that by default they should be written static unless there's a specific reason for them not to be. Why is this? Is it because there's no reason to have references to the outer class if there's no need for there to be, and that it takes up more memory? Or is there a more complicated reason?