He's first listed in the 1870 Census, living with his father Joseph B. He shows up again in the 1900 Census, married to Caroline, with two kids. The 1900 entry has the right location (still in Granby, MO), and the right birthplace for the father. It also tells us that his mother was born in Tennessee, giving a new place to look for Joseph B. and his first wife.
Caroline had been born in Alabama, and they had been married for 12 years (they got married when he was 35). The ``years in this marriage'' entry for Harris has a 22 scratched out, and a 12 written in, suggesting (along with his age at marriage) that this may have been a second marriage for him.
Caroline had had 3 children, and one was still living. The two children living with them were Walter A, age 19, born September 1880, and Allie M, aged 16, born 1884. Notice that the ages are about 10 years too old for the birth year! It may be that there was a vertical stroke added in front of a single digit age for both, but it doesn't look that way.
If the ages are correct, Caroline is the children's mother. If the birth dates are correct, she probably isn't.