The problem in trying to do this with Phonon is that Phonon::MediaSource does not expose any API with which you can specify the audio format - i.e. the sample rate, encoding and number of channels in your PCM data stream. Normally, this information is encoded in the file header (for PCM data files, typically a WAV header), but since you stated that you want to play "raw audio", I'm assuming you mean literally buffers of PCM samples.
Qt 4.6 introduces a new, lower level, suite of audio APIs in the QtMultimedia module. You can use QAudioOutput to play raw audio streams.
Note that support for the QtMultimedia APIs is not yet as widespread as Phonon, but there are already backends for Windows, Mac, and Linux (supporting PULSE and ALSA audio subsystems).