That is indeed what he said about naturalization, however he also said:and in closing: James Madison defined who America seeked to be citizens among us along with some words of wisdom:
When we are considering the advantages that may result from an easy mode of naturalization, we ought also to consider the cautions necessary to guard against abuse. It is no doubt very desirable that we should hold out as many inducements as possible for the worthy part of mankind to come and settle amongst us, and throw their fortunes into a common lot with ours. But why is this desirable? Not merely to swell the catalogue of people. No, sir, it is to increase the wealth and strength of the community; and those who acquire the rights of citizenship, without adding to the strength or wealth of the community are not the people we are in want of.
It is an established maxim that birth is a criterion of allegiance. Birth however derives its force sometimes from place and sometimes from parentage, but in general place is the most certain criterion; it is what applies in the United States; it will therefore be unnecessary to investigate any other.James Madison