Haha I've had exactly the same thing happen to me. A friend told me to stop saying "désole" about everything, and I instinctively replied "désolé". I guess "sorry" just serves a broader variety of uses in English, whereas in French it's much more specifically about apologising for wrongdoings. In English, you can say things like "Sorry to hear about your loss" or "I'm sorry but that's not right at all", but "désolé" wouldn't work in these contexts ^^