Asshole neighbors are why I soundproofed my new office we had built here. I can get total silence anytime I want it. There are kids all over my development that are a pack of screaming brats hence the soundproofing
Other more practical advice. People get up early to go to work, Get up before they come by your house and get an early start on the day.