Census data suggests he was from Mitcheldean or Abenhall, so thats the parish records I'd start with :-)

such as :-

Year 1784
Month Mar
Day 5
Parents Surname GOODE
Child Forename(s) W[illa]m
Father's Forename(s) [not stated]
Mother's Forename(s) Bettey
Mother's Surname
Place of Residence
Occupation
Officiating Minister
Event type Baptism
Memoranda
Notes Pauper
Register Reference P1 IN 1/3
Page No 10
Parish/Chapel Abenhall