They might not know it.

But they would, if anyone with your name & address ever:

• Stored it on a Google server. (Maybe a business you once placed an order with uses GSuite?)
• Made a Google/GMail Contacts/Address-book entry with that info. (Maybe you invited a friend or colleague for dinner?)
• Made those details public (land registry, company officer registry, etc).
• Etc.