I was able to play such a disc using VLC, but I am wondering if any music player supports the DVD-A format.
UPDATE:
I checked Rhythmbox and Banshee - I found no option like Play Disc or Open Disc, so I have no idea how I could even try to start playing a DVD-A disc.
This has also nothing to do with missing plug-ins or codecs - the packages gstreamer0.10-plugins-ugly, gstreamer0.10-plugins-bad and ubuntu-restricted-extras were installed on my machine before.
I guess I am stuck with VLC (Totem shows a DVD menu, but then hangs). However, I am missing the regular music player experience - ability to change order of tracks, adding tracks to a playlist, listening only to selected tracks, etc.
I found Idea #22415: Please add full support for DVD-Audio and LPCM at Ubuntu Brainstorm.