Joseph Hayton went to Pike County, Kentucky from Virgnia. On September 19, 1862, he joined the 39th Kentucky Mounted Infantry ‏(Union Army)‏
in Pike County. He was honorably discharged from duty on September 15,1865 in Louisville, Kentucky. In 1865, Joseph and Martha moved with their children to Round Bottom, Wayne County, West Virginia, USA. His military pension papers were signed and sworn by Jacob Sanders in 1882 upon Joseph's application for disabilitiy payments resulting from rheumatic fever suffered October 15, 1864.