For the majority of the existence of the USA there were no such thing as a border. You could immigrate simply by traveling to the USA.