Merge the source of panel menu plugin and desktop's menu into a new widget. So there's no duplication of menu source any more and it would be available to other components or applications as well. We think that libxfce4ui is the best place for such a thing, a dependency to libgarcon wouldn't harm.
There is garcon-gtk