The quote attributed to Jefferson is apparently a variation of what Ayn Rand wrote in 1963 (“Man’s Rights“):
To violate man’s rights means to compel him to act against his own judgment, or to expropriate his values. Basically, there is only one way to do it: by the use of physical force. There are two potential violators of man’s rights: the criminals and the government. The great achievement of the United States was to draw a distinction between these two — by forbidding to the second the legalized version of the activities of the first.