I have a folder with different systems in, then in those folders I put the emulators in their own folder and a rom folder. I also have an extra folder which contains archived misc stuff for most systems. I have a folder dedicated to the GoodTools and Install files in the Xtras folder.
I put links to emulators in the Start menu also.