Anna Taliaferro left Caroline County, Virginia in 1812 with her five children, four years after the death of her husband, Robert Taliaferro. One son, William Richard Taylor Taliaferro, married his cousin Alice Berry in 1824. The Taliaferro family, whose papers make up much of this collection, was descended from William and Alice.
Through various marriages, the Taliaferro family is related to a number of prominent Northern Kentucky families, including the Taylor and Southgate families.