Jalapeño is Dropping Immature Fruit.

[Bgiaach]

Hey folk,
I've been growing tomatoes and herbs for quite a few years now but this is my first year growing peppers. That being said, I'm having some issues with my jalapeno plant. While at first I had a few good peppers, who are now around 1" long, the newest buds flowered, lost their flowers and new fruit began to grow. Today I went to check on the plant and all 4 of the new baby peppers have turned yellow and fallen off. The 3 good peppers are still going strong but the new ones are all laying in the soil. What happened? By the way, this also has happened with my red bell pepper plant.