If you google Chepstow Union Workhouse records …..

Monmouthshire Family History have transcribed births from 1855-1914 - and Gwent Records Office also hold records. Would try and do the link, but have had a steroid injection in my finger this afternoon and struggling to type…..