They absolutely should not be banned, they should be treated legally like any other camera/video recording device - not allowed in places like change room, bathrooms, hospitals, etc.
The actual usefulness and potential of smart glasses, especially ones with cameras, is almost unfathomable. The cameras are arguably the most important part, as that’s what will enable AR stuff, AI object recognition, and all of the other almost endless ways that will be thought of in the future.
I think laws are going to have to mandate physical shutters over the cameras, that make it super noticeable when they’re open - even if not recording.