Ibn Mas'ud reported the Prophet as saying to people who stayed away from the Friday prayer, “I have thought about commanding a man to lead the people in prayer, then burning their houses over men who stayed away from the Friday prayer."
Muslim transmitted it.