FOD families listed as Chepstow, Monthmouthshire (General)
From the parish records on this site:
Batism Lydney - 6 Feb 1880 - Ernest Hill - Father Walter Mother Maria - Residence: Aylburton Common - Father was a Labourer.
and unfortunately there is also:
Burial Lydney - 8 Mar 1880 - Ernest Hill aged 2 months - Residence Aylburton Common.
Is this the person that you mentioned above?
Joanne.