I think that underground caverns are sometimes boring and there should be some sort of special biome that only spawns underground, they will have special items inside them as well. Maybe it will be like an underground jungle or something. I know I made this very vague so feel free to add suggestions
If all you can find is caves, look harder.