CHURCH, JOHN FREDERICK. Mother's Maiden Surname: YEMM
GRO Reference: 1861 M Quarter in ST PANCRAS Volume 01B Page 158

CHURCH, ALBERT: Mother's Maiden Surname: YEM
GRO Reference: 1863 J Quarter in WESTBURY ON SEVERN Volume 06A Page 200

CHURCH, WILLIAM YEMM. Mother's Maiden Surname: YEMIN
GRO Reference: 1865 M Quarter in WESTBURY ON SEVERN Volume 06A Page 213

1881 Census (only record I can find)
Name: William Church
Age: 19
Estimated Birth Year: abt 1862
Where born: Westbury On Trim (?)
Civil parish: Vessels
County/Island: Royal Navy
Country: England
Street Address: "Achilles"
Occupation: Ord 2 Cl
Registration District: Royal Navy
ED, institution, or vessel: Achilles

Apr 5th, 1891, Census
Name: William Yemm Church
Gender: Male
Age: 25
Relationship: Soldier
Birth Year: 1866
Birthplace: East Dean, Gloucestershire, England
Civil parish: Gillingham
Residence Place: Brompton, Gillingham, Kent, England
Registration District: Medway
Sub registration district: Gillingham
ED, Institution or Vessel: Brompton Barracks

UK and Ireland, Outward Passenger Lists, 1890-1960 Preview
Passenger Lists.
Name: William Church
Other: H W Hayes
Birth: Abt 1867
Departure: 8 Jul 1891 England
Arrival: Rio De Janeiro, Brazil.

The only other records I could find for a William, has his occupation of a Wheelwright?

Is this their Father?

Name: John Church
Birth Year:abt 1837
Age:35
Committal Date:14 Dec 1872
Residence Year: 1872
Residence Place: Mitcheldean
Occupation: Butcher
Reference Number:Q/Gc6/6
URL: http://ww3.gloucestershire.gov.uk/genealogy/Search.aspx

Ancestry has John Church. Trial: 1 Apr. 1873. Gloucestershire, England. 14 years Imprisonment for Bigamy.

Possibly Eliza?

1881 Census
Eliza Ann Church
Age: 45
Estimated Birth Year: 1836
Relationship to Head: Servant
Where born: Abenhall, Gloucestershire, England
Civil parish: St Georges Hanover
County/Island: London
Street Address: 28 B Albemarle St
Marital Status: Widow
Occupation: Nurse Domestic Serv
Registration District: Chelsea