Just a thought here... but quality can be impaired with the use of a incorrect decoder.
Does everyone use ffdshow with AAC decoding set to libfaad2? If not, you should try that and listen again!
Since HE-AAC + PS actually strips high frequencies and stereo channels, you get a mono 24 KHz file, which will be decoded as 48 KHz, Stereo if a proper decoder is used.