It can only matter if you sit precisely on axis with the tweeter, as freqs. above 20 kHz are beamed extremely narrowly, due to the increasingly shorter wavelengths as you go higher on freq.
As the frequency increases, the wavelength decreases. Any frequency whose wavelength is longer than the tweeter diameter will be aimed straight ahead in a narrow beam. IMO, there are no tweeters in existence that can go to 50kHz if even a couple of inches off-axis.
Those who sit off axis (which can be anything short of having the tweeter aimed DIRECTLY at you), and claim that the sound is better, are DEFINITELY NOT hearing the higher-than-20 kHz freqs. at all, unless they also have a tweak that changes the laws of physics.
Sitting directly on axis of the driver, I have used super-tweeters that went up to 50kHz or so, and I thought they made a difference when aimed directly at me. Ultimately, I found that I preferred the system's musical involvement without these devices. YMMV...