Why people think they should stop
Retinol (and all retinoids for that matter) increases cell turnover. As the skin sheds faster, the newer skin underneath is temporarily more sensitive to UV exposure. This is true. It's also why the advice has always been to use retinol in the evening only, and to apply SPF every single morning without fail. Those two rules don't change in summer. They become more important.
The idea that retinol is incompatible with sun exposure is based on a misunderstanding of how it works. Retinol itself breaks down in UV light, which is why it should only ever be applied at night. But when applied in the evening, it has metabolised and done its work before you're exposed to sun the next morning. The increased sensitivity that follows is managed by good SPF. Which you're already wearing. Every day.
If you stop retinol in summer you lose four to five months of cumulative results every single year. Retinol works progressively. The benefits build over months of consistent use. Pausing for summer means starting again from scratch every September, which significantly reduces what you actually get from it long term.