Most likely a variant of Amery, ultimately derived from Emery. Emery originates in Germanic languages and means "home power". Formerly it was more popular as a masculine given name, recently it gained popularity as a feminine given name as well. It also functions as a surname. Amory was the name of a character in Fitzgerald's 1920 novel This Side of Paradise.