If you choose to use a custom menu file via the Applications Menu Property dialogue and don't set any file there, the panel crashes on opening the menu.
Was fixed via bug 7895 for Xfce 4.8.