Cannot find any direct references to Hill House definitely being the old Workhouse, but certainly that's the belief according to this old forum thread, which includes plenty of links for info abt the Workhouse itself.
https://forest-of-dean.net/fodmembers/index.php?id=45502