Cancel that card number immediately and have a new card number issued. End of story. Your card number is compromised.
You don't want to change the card number because you have to change a few autopays. How hard do you think it is for a hacker to figure out they have a valid card id, and charge anywhere they want or sell the number? It isn't just one retailer you can block. Feel like spending a bunch of time later when you credit history is screwed up? Good luck... Guaranteed it will be more time than changing a few autopays...
You don't want to change the card number because you have to change a few autopays. How hard do you think it is for a hacker to figure out they have a valid card id, and charge anywhere they want or sell the number? It isn't just one retailer you can block. Feel like spending a bunch of time later when you credit history is screwed up? Good luck... Guaranteed it will be more time than changing a few autopays...