Most people find the lack of distracting office bante to be a blessing and actually complete projects faster.
Musk's problem is he's stuck in the 20th Century idea of time spent = work done. The rest of us know working smarter is the better idea and that employee productivity should be measured on projects completed, not time spent in the office.
Working from home I can wake up early and kill my inbox before the kids wake up. I can meet with a local colleague for a walk in the park to share ideas instead of sat in a dull meeting room. I can blitz project work then help kids with homework and mop things up before settling down for the evening.
Rather than compartmentalising my life I can let it intertwine. Instead of stopping myself bringing my work self home I can bring my home self to work because lets all be honest, we all prefer that guy.