2

I'm trying to make a simple video player like program with Direct2D and WIC Bitmap.
It requires fast and CPU economic drawing (with stretch) of YUV pixel format frame data.

I've already tested with GDI. I hope switching to Direct2D give at least 10x performance gain (smaller CPU overhead).

What I'll doing is basically such as below:

  1. Create an empty WIC bitmap A (for drawing canvas)
  2. Create another WIC bitmap B with YUV frame data (format conversion)
  3. Draw bitmap B onto A, then draw A to the D2D render target

For 1, 2 step, I must select a pixel format.
WIC Native Pixel Formats

There is a MSDN page recommends WICPixelFormat32bppPBGRA.
http://msdn.microsoft.com/en-us/library/windows/desktop/hh780393(v=vs.85).aspx

What's the difference WICPixelFormat32bppPBGRA and WICPixelFormat32bppBGRA? (former has additional P)

If WICPixelFormat32bppPBGRA is the way to go, is it always the case? Regardless hardware and/or configuration?

What is the most effective pixel format for WIC bitmap processing actually?

9dan
  • 4,222
  • 2
  • 29
  • 44
  • It is explicitly mentioned in the article you linked, "This provides a more efficient method of image composition". – Hans Passant Oct 01 '14 at 11:06

1 Answers1

5

Unfortunately, using Direct2D 1.1 or lower, you cannot use pixelformat different from DXGI_FORMAT_B8G8R8A8_UNORM which is equivalent to WIC's WICPixelFormat32bppPBGRA ("P" is if you use D2D1_ALPHA_MODE_PREMULTIPLIED alpha mode in D2D).

If your target OS in Windows 8 then you can use Direct2D's newer features. As far as I remember there is some kind of YUV support for D2D bitmaps. (Edit: No, there is not. RGB32 remains the only pixelformat supported along with some alpha-only formats)

What is the most effective pixel format for WIC bitmap processing actually?

I'm not sure how to measure pixel format effectiveness, but if you want to use hardware acceleration you should draw using D2D instead of WIC, and use WIC only for colorspace conversion. (GDI is also hardware accelarated btw).

What's the difference WICPixelFormat32bppPBGRA and WICPixelFormat32bppBGRA? (former has additional P)

P means that RGB components are premultiplied. (see here)

What I'll doing is basically such as below:

  1. Create an empty WIC bitmap A (for drawing canvas)
  2. Create another WIC bitmap B with YUV frame data (format conversion)
  3. Draw bitmap B onto A, then draw A to the D2D render target

If you target for performance, you should minimize the bitmap copy operations, also you should avoid using WIC bitmap render target, because it is uses software rendering. If your player would only render to a window, you can use HWND render target, or DeviceContext with Swap Chain (depending of Direct2D version you use).

Instead of rendering frame B to frame A, you can use software pixel format conversion featuers of WIC (e.g. IWICFormatConverter). Another way would be to write (or find) a custom conversion routine using SIMD operations. Or use shaders to convert the format (colorspace) on the GPU side. But the latter two require advanced knowledge.

When it is converted you can lock the pixels to get the pixel data and directly copy that data to a D2D bitmap (ID2D1Bitmap::CopyFromMemory()). Given that you already have a ready d2d bitmap.

And the last step would be to render the bitmap to the render target. And you can use transformation matrices to realize stretching.

Anton Angelov
  • 1,223
  • 7
  • 19
  • I posted a follow up question. Please take a look at it. http://stackoverflow.com/questions/26153633/windows-stretchblt-api-performance – 9dan Oct 02 '14 at 02:31
  • Hasn't hardware acceleration in GDI varied over different versions of Windows? – Mark Ransom Oct 02 '14 at 16:43
  • Yes, I assumed that the question poster will most likely use Windows 7+. Here is more information about the (hardware) acceleration of GDI: http://en.wikipedia.org/wiki/Graphics_Device_Interface – Anton Angelov Oct 03 '14 at 06:42