If you are using PJ64 1.6 and Jabo's DirectSound, start the game, then go to:
Options > Configure Audio Plugin
Enable 'Sync game to Audio'. This should fix it with most games. If this does not work, check your audio drivers are up to date or switch to Azimer's HLE Audio v0.56 WIP2 and enable Dynamic Audio Sync in the Audio Plugin configuration.