These records on this site, which may be your couple:

Record_ID: 218184
Entry_Number: 334
Year: 1796
Month: Oct
Day: 10
Parents_Surname: WILLIAMS
Child_Forenames: Richard
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence:
Occupation:
Officiating_Minister: Tho[ma]s Edmunds Curate
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/4
Page_Number: 13
Parish_Chapel: St Briavels
Soundex: W452

Record_ID: 218217
Entry_Number: 367
Year: 1798
Month: Apr
Day: 15
Parents_Surname: WILLIAMS
Child_Forenames: Joseph
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence:
Occupation:
Officiating_Minister: Tho[ma]s Edmunds Curate
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/4
Page_Number: 14
Parish_Chapel: St Briavels
Soundex: W452

Record_ID: 218264
Entry_Number: 414
Year: 1800
Month: Sept
Day: 12
Parents_Surname: WILLIAMS
Child_Forenames: Richard
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence:
Occupation:
Officiating_Minister: Tho[ma]s Edmunds Curate
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/4
Page_Number: 16
Parish_Chapel: St Briavels
Soundex: W452

Record_ID: 218297
Entry_Number: 446
Year: 1803
Month: Jan
Day: 2
Parents_Surname: WILLIAMS
Child_Forenames: John
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence:
Occupation:
Officiating_Minister: Tho[ma]s Edmunds Curate
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/4
Page_Number: 17
Parish_Chapel: St Briavels
Soundex: W452

Record_ID: 218378
Entry_Number: 526
Year: 1806
Month: Apr
Day: 4
Parents_Surname: WILLIAMS
Child_Forenames: George
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence: St. Briavels
Occupation:
Officiating_Minister: Tho[ma]s Thomas Curate
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/4
Page_Number: 20
Parish_Chapel: St Briavels
Soundex: W452

Record_ID: 218468
Entry_Number: 616
Year: 1810
Month: Apr
Day: 29
Parents_Surname: WILLIAMS
Child_Forenames: William
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence: Hudnalls
Occupation:
Officiating_Minister: Tho[ma]s Thomas Curate
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/4
Page_Number: 24
Parish_Chapel: St Briavels
Soundex: W452

Record_ID: 59035
Entry_Number: 38
Year: 1814
Month: Jun
Day: 5
Parents_Surname: WILLIAMS
Child_Forenames: Thomas
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence: Hudnalls
Occupation: Labourer
Officiating_Minister: T.Thomas
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/5
Page_Number: 5
Parish_Chapel: St Briavels
Soundex: W452

Record_ID: 59113
Entry_Number: 116
Year: 1817
Month: Dec
Day: 7
Parents_Surname: WILLIAMS
Child_Forenames: Hannah
Fathers_Forenames: Richard
Mothers_Forenames: Hannah
Mothers_Surname:
Residence: Hudnalls
Occupation: Hoopmaker
Officiating_Minister: C.H.Morgan
Event: Baptism
Memoranda:
Notes:
Register_Reference: P278 IN 1/5
Page_Number: 15
Parish_Chapel: St Briavels
Soundex: W452

I notice that there were children born to a John & Hannah Williams as well. I wonder if that is the Hannah that died in 1812? You just need to check when their last child arrived!

Record_ID: 143552
Entry_Number: 345
Year: 1812
Month: Mar
Day: 6
Surname: WILLIAMS
Forenames: Hannah
Residence: St Briavels
Age_at_death:
Officiating_Minister: Tho[ma]s Thomas Curate
Event: Burial
Cause_of_death:
Memoranda: Mrs.
Notes:
Register_Reference: P278 IN 1/4
Page_No: 26
Parish_Chapel: St Briavels
Soundex: W452

This could be the burial of the first child named Richard?

Record_ID: 143419
Entry_Number: 212
Year: 1796
Month: Oct
Day: 16
Surname: WILLIAMS
Forenames: Richard
Residence:
Age_at_death:
Officiating_Minister: Thomas Edmunds Curate
Event: Burial
Cause_of_death:
Memoranda:
Notes:
Register_Reference: P278 IN 1/4
Page_No: 13
Parish_Chapel: St Briavels
Soundex: W452