To change the icon for a particular folder, right click it in Explorer, and click Properties, then the Customize tab, and hit the "Change Icon" button.
To change the default icon for all folders, just open C:\WINDOWS\system32\shell32.dll in Resource Hacker and replace the folder icon.
Hope that helps.
