Its tough, I live in a neighborhood where the houses are very close together. I'm lucky as I have a cigar smoker on one side and a butt hacker on the other side.
I am going single soon a nice way to say I'm going through a divorce and I was going to buy a town house, but after thinking about my cigars, I have decided to bite the bullet and buy another house.
If you are in an apartment or condo or town house, you could expect to get the comments.
We no longer have rights, good luck on your issue.