Lok Sabha speaker worried about disruptions in houses