With great power comes great responsibility. Work obligations can get in the way of personal life activities, but not to the point where I think this is a major drawback. I think a reasonable person should be able to manage the demands of SpaceX work and their personal life, although some former employee reviews suggest otherwise.
The company has grown a huge amount, and critics will say that this has brought undesired changes. I'm honestly glad to be working at a successful company that is dealing with the challenges of how to manage growth instead of having to do layoffs.