Columbia County was settled by Quakers who chose to name their county for an explorer, Christopher Columbus, rather than for a military man as was often the custom. John Appling, the original pioneer of the area, gave his name to the county seat.