I can't say I blame him! I've done the same. I've had chicks get out of the broody area, and been glad that I had a fence between me and the mama when I rounded up the babies! I finally put a row of bricks along the fence to keep them in.
2 chicks under the white hen She still has 5 eggs under her, so we'll see how it goes. My banty, Chooks, is still sitting strong and still beating the tar out of me when I check for fresh eggs.