The Fletcher Family Cemetery is located on a remote piece of land, roughly one mile from a living descendant. The Fletcher family takes its name from Elijah Fletcher, a slave owner who moved to Virginia in 1813 and died in 1858. Elijah owned the nearby Sweet Briar Plantation and a large enslaved population lived and worked on his farm. One of these individuals was Isaiah Fletcher. After emancipation he moved to Turkey Mountain, where his descendants still live today. Oral history maintains that Isaiah was a trained stone mason, often hired out to other plantation owners because of his skills.

Isaiah, as well as several generations of Fletchers, is buried in the Fletcher Family Cemetry. The cemetery is still in use today, but the surrounding land is no longer owned by the Fletcher's. A related cemetery is the Broady Family Cemetery, located several miles away on Rose Mill Road. The Broady's are related to the Fletcher's through marriage. Much of the family history is preserved in a family bible and through the remembrances of Jasper Fletcher, a living descendant of the Broady & Fletcher families.