here it is in the 1880's

http://www.old-maps.co.uk/
co-ords 365415,221956

I have a suspicion its still there set back off the road behind a high stone wall and conifirs ..

PS

Castle End Farm is currently up for sale , not to be confused with Castle End house