This information has been passed to me by a fellow forum Contributor which is very interesting and explains why the children were being looked after by other family members.

Hogg: Old Bailey: 6 May 1861

Caroline HOGG - : Lar & Rec: acquitted and discharged.

James HOGG was sent down for 3 years

1861 Census:

Newgate Prison

James HOGG aged 28, occupation Porter, born Ingasteston, Essex