In Scottish, name Tory means – From the craggy hills. Surname based on Tor; Torrence or Tower.. Other origins for name Tory include – Scottish, American, Celtic, Irish, English. Name Tory is a unisex name and can be used for a boy or girl name (male or female).