​Anyone regret outsourcing IT instead of keeping it in-house?

We’re a small business and seriously thinking about outsourcing IT. Right now we handle everything ourselves and it’s getting exhausting.

That said, I keep wondering if anyone actually regrets switching to an MSP. Did it ever feel slower, more expensive, or harder to deal with than just having someone in-house? Curious to hear the good and the bad.