It’s absolutely possible. It would depend on the store but I’m guessing a store that has a loyalty program is interested enough in analyzing customer data that they would use your credit card as a unique identifier of you as a customer, especially for transactions where there wasn’t a loyalty number entered.
I know which city used to be Constantinople, thanks to They Might Be Giants!