Eggs spawning baby chickens is a good thing! First, make a Mob Grinder (Use YouTube to learn how.) and the throw the eggs in until you have around 10-20 baby chickens. Wait for them to grow into adult chickens and then turn on the Mob Grinder.
After the chickens are all dead, collect the food for health, feathers for arrows, and XP for yourself! It's a win-win situation.