Yes and no. There was a period of time where they were particularly bad. If you go back to some earlier eras (like the 1970s and even earlier) you can find many capacitors that are still good.

It also depends on the materials. Electrolytic capacitors naturally dry out and then fail. Many kinds of ceramic capacitors should last an extremely long time if they’re kept within a reasonable temperature range.