Isaac married Polly Lester on 14 December 1822 in Pulaski County, Kentucky. She is the daughter of Nancy. Polly was born between 1801 and 1810, and she died between 6 October 1840 and 1841 in Rockcastle County, Kentucky. There is no record of her burial place.
Polly's second and third daughters were born between 1826 and 1830;and her first two sons were born between 1831 and 1835. A third daughter was born between 1836 and 1840. There is no evidence to support that these un-named children lived past the year 1850.