Frederick Savory was one of five sons born to Sophia and George Savory in Victoria.  The couple were married in 1854 in St Kilda. Their other children were: Harry born 1857 in Ballarat; George Norman born 1858 in Ballarat; John born 1860 in Ballarat; Alfred born 1863 in Brighton Beach.  George Savory was born 1825 in England.  His wife was born about 1821 in London. She died in 1904 at East Melbourne.

Probate on Frederick's estate was sworn to John Savory, attorney of Sophia Savory, to the value of value, £3023.12s. 8d.