I swear I remember a Saunders short story with the following premise:
The narrator sees a quaint, old house on some rural (probably upstate NY) byway, and wants to buy it. The owner rebuffs the narrator's offers, and the narrator watches as the house decays over the months or years following his generous offer. Finally, the house is a collapsed & dilapidated ruin.