Rufus A. Candler married Rosa A. Lipscombe on 16 October 1887 at Bethany Church on Candler's Mountain in Campbell County, Virginia.

Rufus was the son of James Henry (1816-1899) and Mary Elizabeth (b. 1822) Candler. James Henry Candler was the son of Daniel (1788-1860) and Mildred "Milly" (1791-1846) Candler. Daniel was the son of James (c1756-1826) and Agnes (c1755-1817) Candler. James was the son of John (c1730-1802) and Elizabeth Candler. John was the son of Daniel (c1700-1765) and Hannah Candler.