As Richard Maile appears related to your Caleb, I've found the following articles in the local papers, which I hope are relevant and of interest.

District News, Ledbury.
Misconduct in Service.
On Wednesday last, Ann Seaborn, servant to Mr Richard Maile, of Putley, was charged before Capt Jones, with disobeying his orders, as also those of Mrs Maile, and refusing to perform her accustomed work. Mrs. Maile stated that the defendant came into her service on the 12th of June, and on the 13th July inst. she complained to the defendant that the cows were not properly milked, when defendant told her to milk them herself; she also refused to feed the pigs. Mr Maile corroborated his wife's statement. The defendant, in answer to the charge, said that the cows were never tied up; she had to milk them in the fold, where they caused her to move several times before she could finish milking one cow, but on that day she milked them twice over, although she was very unwell at the time, and Mr Maile cursed her and called her a " scamp," &c; she said she was not hired to feed the pigs. The magistrate told her she could not legally refuse obeying any order of her master or mistress, being a general servant in husbandry. Mrs Maile also said she was very " pert," and would retaliate with her tongue to the tune of ten words for one. In answer to a question, defendant said her friends resided at Winforton. The magistrate said that if the defendant had before been brought to this court upon a similar charge, he should then have considered it his duty to commit her to prison which he should be very sorry to do, but not hearing of any former complaint against her, he had come to the determination of discharging her from the service of complainant, and that the wages due to her for the time she had served should be forfeited.
Saturday 17 July 1847, Hereford Times

LEDBURY
Petty Sessions
Cruelty. A boy, named James Nelmes,servant to Mr Richard Maile, of Putley, was charged with this offence.— Mr Maile stated that defendant was driving his team, on Tuesday last, when he saw him lash one of his mares with a whip, which caused the blood to flow from her thigh in three places. Mr Maile added that there was uo occasion to do so, the mare being a capital worker.— The boy said the mare did not work up with the rest. Fined 5s., and 9s. costs.
Saturday 21 July 1849 , Hereford Times.

Sales by Auction
BRAINGE ESTATE, WOOLHOPE, HEREFORDSHIRE.
Mr Richard Maile has instructed JOSEPH BIRD TO SELL BY AUCTION, On Monday the 28th April, 1851, (who is leaving the Estate,)
The whole of his valuable LIVE and DEAD STOCK and other EFFECTS, consisting of very prime Milch Cows and other Horned Cattle, Horses, Sheep, Pigs, Implements in Husbandry, 50 Hogsheads of Tankard and Family Cider, with other Effects.
Particulars will appear in handbills.
Saturday 19 April 1851, Hereford Times.

ROSS
Murder of an Infant.
H. Underwood, Esq., coroner, held an inquest on Wednesday, at Weston Cross Inn, in the parish of Weston-under-Penyard, on the body of a female infant that had been found in a pool near to Kingston Court, Weston. Henry Hall, a lad in the employ of Mr. Henry Burgune, of Kingston Court farm, was the first witness called ; he said he was going by the pool on Tuesday morning, and observed a substance floating in the water, and informed Richard Maile of it. Richard Maile went to the pool in consequence of what the boy Hall had told him ; he got the substance out of the pool, which he found to be the body of a female infant. C. E. Thomson, Esq., surgeon, had made a post-mortem examination of the body by direction of the coroner; the child was at its full time; the body was much decomposed, the viscera of the chest and the abdomen were healthy ; the lungs floated in water; there was nothing in the viscera to account for death ; found a contusion above parietal bone; the skull was not fractured, but the injury on the head was sufficient to cause death; he had no doubt the child was born alive, and that death resulted from the blow. A verdict of ”Wilful murder against some person or persons unknown” was returned.
Saturday 20 December 1856 , Monmouthshire Beacon , Gwent

MALVERN.
Assault.— Mr. Cecil McCann, fly proprietor, was summoned for assaulting Richard Maile, cab-driver for Mr. Henry Hayes, Malvern Link. Fined 10s. and costs 225. 6d.
Wednesday 29 August 1866, Worcestershire Chronicle.

I see several Richard Mailes/Mayles in the FoD PRs but from earlier times. Unsure without further work, but a quick look at FamilySearch suggests the above articles relate to the following family groups;

1851 Census for Putley, Ledbury, Hfds.

Household Role Gender Age Birthplace
Richard Maile Head M 53 Farmer, out of business. Dymock, Gloucestershire
Anne Maile Wife F 50 Wootton, Gloucestershire
John Maile Son M 27 Dymock, Gloucestershire
Richard H Maile Son M 19 Single. Mercer. Munsley, Herefordshire
Charles F Maile Son M 16 Munsley, Herefordshire
Mary A Maile Daughter F 13 Munsley, Herefordshire

---------------

1871 Census for Great Malvern, Worcs.

Household Role Gender Age Birthplace
Richard H Maile Head M 38 Porter. Mundon, Herefordshire
Jane Maile Wife F 28 Bramford, Worcestershire
Mary A Maile Daughter F 4 Leigh, Worcestershire
Henry C Maile Son M 2 Leigh, Worcestershire

---------------

1881 Census for North Malvern Rd, Great Malvern, Worcs.

Household Role Gender Age Birthplace
Richard H Maile Head M 47 Draper's Assistant. Pixley, Herefordshire, England
Jane Maile Wife F 37 Bransford, Worcestershire, England
Mary Ann Maile Daughter F 14 Day Servant. Malvern Link, Worcs.
Henry Charles Maile Son M 12 Malvern Link, Worcs.
Georgiana M Maile Daughter F 9 Scholar. North Malvern, Worcs.
Laura K Maile Daughter F 7 North Malvern, Worcs.
Alice M Maile Daughter F 4 North Malvern, Worcs.
Richard J Maile Son M 1 North Malvern, Worcs.
Emma Hunt Sister In Law F 39 Invalid. Bransford, Worcs.
Charles Hunt Brother In Law M 47 Gardener ND. Bransford, Worcs.
Frederick C Hunt Nephew M 16 Errand Boy. Bransford, Worcs.

There are other wills on Ancestry which may be of interest if only for confirmation.

There is an image of the will of Elizabeth MAILE of the Parish of Dymock in the County of Gloucester, spinster, dated 13th November 1817. In it she bequeaths sums of money to her eldest brother, John MAILE, and another brother, Richard MAILE. This money is to be paid from securities due to her from the late John BOWER of Newent. She bequeaths the remainder of her estate to her sister, Mary JONES, wife of Edward JONES of Dymock, mason. In a codicil dated 14th November 1817 she wills that, if her brother John dies before her, the money is to be distributed equally amongst his children.

There is also a will of John MAILE of the Woodland Cottage in the Parish of Dymock in the County of Gloucester. It is dated 21st March 1823. In it he leaves all his estate to his wife Sarah MAILE. Probate was granted to Sarah MAILE on 22nd November 1834, John MAILE having died on 27th May. The value of the estate was under £100.

Edward JONES also left a lengthy will which confirms the details of the will of Elizabeth MAILE.

The strange thing is that RICHARD's son CHRISTOPHER, my ancestor, also says he was born in Dymock, about 1821, and yet there is no trace of it, the same as CALEB about 1800. Is anybody aware of any Non-Conformist chapel in the area - I have to admit this is rather a longshot as all RICHARD's other children were baptised in Dymock church.

Like you I cannot find any trace of Christopher's birth, on Ancestry or within this site's PRs, beyond the references in the 1851 Census and so forth. Similarly I cannot find him mentioned in the old papers.
Regarding possible Non-Conformist activities in Dymock, clearly there were such groups although I've not found much detail. The usual source of such info would be the British History website, however Volume 12 which covers Dymock has only recently been published and is not yet on their website. However the website does have this mention, when describing activities in the city of Gloucester;

"In 1855 a Primitive Methodist mission to Gloucester was established with the help of preachers from Stroud. It covered a large area, including until 1874 Cheltenham, and from 1875 looked after chapels at Broom's Green in Dymock and at Lowbands in Redmarley D'Abitot (Worcs., later Glos.)."

http://www.british-history.ac.uk/vch/glos/vol4/pp319-334

I have no doubt that Volume 12 will include more references to Non-Conformism in Dymock and nearby Kempley, Gloucester public library etc should have a copy for reference.

This Kempley website includes this tantalising reference, but no more detail that I can find yet, suggesting they maybe worth contacting ?
"Van Goulding. Born locally, researcher and historian of the non-conformist movement in Kempley and surrounding parishes"
http://www.kempleytardis.org.uk/the-crew-at-launch/

Finally, please see this old thread for a list of Non-Conformist chapels within the Forest area.
http://www.forest-of-dean.net/fodmembers/index.php?mode=thread&id=10483

Of course, this doesn't help find actual Parish Records, sorry.
I wonder if you need to look across the border into Herefordshire, which sadly isn't so well-covered online as Gloucestershire. See
https://www.herefordshire.gov.uk/leisure-and-culture/local-history-and-heritage/family-...
More Herefordshire FH links on this old post and my reply
http://www.forest-of-dean.net/fodmembers/index.php?id=47207