Spoiler:Samuel burned the mansion some years before the events of BM1. This was the fire in which his wife was killed, and I think the reason why he left the mansion.