Careful with a goat!! They can sure be cute, but also big trouble. We had one for a while. (Ulysses S. Goat) He ruled the place and was playful. Unfortunately he wouldn't stop playing and he got too rough. Ulysses thought it was all a game, but one day he wore both my husband and another man completely out. He would butt at them and they would grab his horns, but then he wouldn't stop and neither of them could turn and walk away. They finally got backed into the garage and were able to get away. He never bothered the kids and I started just carrying the horse whip with me, but we finally decided he was just too dangerous and needed another home. Fences mean nothing to a goat. Right now the neighbor across the way has one and he goes in and out as he pleases, but he also will just butt the posts and then lean on them until he loosens them one by one. They climb on cars, machinery, convertibles, etc. The kids left the travel trailer door open and I found him on the bed. I remember hearing my youngest hollering, "Goat in the house, goat in the house" and finding Ulysses heading up stairs! And you have the right idea - an older mare or gelding. If you aren't an experienced horse person it is a good idea to get one already trained. If your kids are young enough horse 4-H is good. I led a group for quite a while. Don't ever, ever let anyone talk you into a stallion. Seems like every kids wants the "black stallion". A stallion is never a kid's horse and without a lot of experience and the proper environment, they are a real liability. I once saw a stallion that got loose at a horse show, mount a mare that a little girl was riding. the mare tried to get away, but the stallion had managed to pin the little girl. In the end no one was physically hurt, but I am sure the little girl was traumatized. My husband had open heart surgery, but his biggest scar was from being bitten by his Dad's "gentle" stallion!