I don’t think it’s a dumb question at all. I’m not a physics person but I think what you’re describing is a thermal battery. It’s the reason people put tiles in their ovens for smoothing out hot and cold spots and moderating temperature swings from the oven cutting on and off or opening the door.