In general, the main benefit of using the 64-bit version of Office, is that it can use access memory when needed. With the 32-bit version of Office, the application can only use up to 2GB of memory, even when more is available in your computer.
Using the 64-bit version of Office will for instance allow you to work with large data sets like Excel workbooks or Project files that are over 2GB in size.