The Elgin family lived in what is now Clifton, Virginia in the mid to late 1800s. John W. Elgin married Mary Frances in 1850 and together they had 14 children. They were an average family at the time, John was a farmer and Mary took care of their home and children. All fourteen of the children stayed in the northern-Virginia/Maryland area except Isaac Elgin. In 1910, Isaac is recorded by the census as being a patient at the Western State Lunatic Asylum in Staunton, Virginia.
The Elgin cemetery is currently located in Clifton, Virginia. There are a confirmed eight people buried there and an unknown number of others.