first, i would fill out a change of address form with the post office. it's free, and you can get one from any post office. they don't even require any kind of verification that you are who you say you are (unless you do it online), great for getting revenge on people.
but anyways do that, it should work. if not, just change the numbers to something that isn't already on your block. llike 1503, change it to 1515 on the front of your house. the mailman will figure it out/get used to it eventually.