Ann Lytle Rowan was the daughter of Captain William Lytle, one of the early settlers of Cincinnati, Ohio. Captain Lytle was deeded over 1200 acres of land for service as one of General Washington's elite corps of officers in the Revolutionary War. Captain Lytle solicited settlers to follow him with the promise of land.
John Rowan affectionately nicknamed his wife "Nancy," had nine children. Nancy was instrumental in the design of Federal Hill Mansion. The couple planned the home for many years before and during its construction. Nancy was the first mistress of Federal Hill Mansion, and diligently helped to maintain the building with her husband.