Do you have your through-flow air vents open?
Rarely, but sometimes the chin one. (The rear vents are permanently open on my current helmet for the 'exhaust'.)
I find having the visor open a tiny bit works better than vents, and that's been true for about 5 helmets = ~20 years.
The reason I'm looking now is I'm doing several group tours this year, and it's not really possible to stop and clear when in a convoy!
On your own it's fine to do that. Just planning ahead. Bit like buying a phone mount for Android-based GPS. Slippery slope down, etc.