Worn down by the politics and constant commuting to his family, who had moved back to Massachusetts after a year in Washington, Patrick left the Justice Department in 1997 and returned home. The civil rights division, former employees say, hated seeing him go.