Agreed. Although the time for us having to use 64-bit whether we want to or not is getting very close (at least if you want to play the cutting edge games that use so much RAM), I would still stick with 32-bit for now.
When I built two brand new systems for a customer of mine two years ago, I anticipated a mainstream move to 64-bit Windows much more quickly, so I installed 64-bit XP on her and her son's systems.
First of all, there was an audio issue under 64-bit that I didn't have under 32-bit. It required some update from MS. It couldn't have been the common HD audio issue because that update would've been required under 32-bit as well. Either that or the 32-bit driver included that hotfix but the 64-bit driver didn't.
Also, I bought a specific Pre-N wireless networking card because I had information that a 64-bit driver existed (not necessarily specifically for that card, was actually meant for another that used the same chipset). Turned out that the one she bought was a newer revision that used a different chipset, but I still found yet another driver meant for another card that worked under 64-bit.
I've worked on her computers several times since then, installing new software or updating the hardware even. I don't remember why at this time but I swore to myself that I definitely jumped the gun and wished I hadn't done so - it would've simplified things tremendously.
Of course you can always dual-boot later, so you have both 32 and 64-bit Windows. If I were going to install a 64-bit Windows on a system, I would install Vista.