Good idea, but you’re still using small objects which can be destroyed by someone desperate (or a clever enough wizard). You want something large and physically resilient - the kind of thing that would be both hard to vanish, and is going to take something like a bomb to get rid of.

Make it something huge. One of the Pyramids of Giza. The Papal Palace. The Tower of London.