Kelly was the son of Gersham and Bridget Kelly of South Carolina. He served under General Andrew Jackson in the Creek War and fought in the Battle of New Orleans in January 1815. In 1818 his home was designated as the area's first courthouse by the Alabama Territorial Assembly.
- Garrett, William (1872) Reminiscences of public men in Alabama. Atlanta, Georgia: Plantation Publishing Co.