0

I'm developing an android app that for every YUV image passed from camera, it randomly pick 10 pixels from it and check if they are red or blue. I know how to do this for RGB images, but not for YUV format. I cannot convert it pixel by pixel into a RGB image because of the run time constrains.

GEOCHET
  • 21,119
  • 15
  • 74
  • 98
Junfei Wang
  • 578
  • 1
  • 13
  • 26
  • 1
    How do you define whether a color is red or blue, in RGB ? Did you check the basics of YUV already, as in http://software.intel.com/sites/products/documentation/hpc/ipp/ippi/ippi_ch6/ch6_color_models.html for example ? – mmgp Dec 05 '12 at 01:18

3 Answers3

9

I'm assuming you're using the Camera API's preview callbacks, where you get a byte[] array of data for each frame.

First, you need to select which YUV format you want to use. NV21 is required to be supported, and YV12 is required since Android 3.0. None of the other formats are guaranteed to be available. So NV21 is the safest choice, and also the default.

Both of these formats are YUV 4:2:0 formats; the color information is subsampled by 2x in both dimensions, and the layout of the image data is fairly different from the standard interleaved RGB format. FourCC.org's NV21 description, as one source, has the layout information you want - first the Y plane, then the UV data interleaved. But since the two color planes are only 1/4 of the size of the Y plane, you'll have to decide how you want to upsample them - the simplest is nearest neighbor. So if you want pixel (x,y) from the image of size (w, h), the nearest neighbor approach is:


Y = image[ y * w + x];
U = image[ w * h + floor(y/2) * (w/2) + floor(x/2) + 1]
V = image[ w * h + floor(y/2) * (w/2) + floor(x/2) + 0]

More sophisticated upsampling (bilinear, cubic, etc) for the chroma channels can be used as well, but what's suitable depends on the application.

Once you have the YUV pixel, you'll need to interpret it. If you're more comfortable operating in RGB, you can use these JPEG conversion equations at Wikipedia to get the RGB values.

Or, you can just use large positive values of V (Cr) to indicate red, especially if U (Cb) is small.

Eddy Talvala
  • 17,243
  • 2
  • 42
  • 47
  • You saved my day. – Ghazi Jan 02 '19 at 19:42
  • @Ghazi how were you doing the byte array (yuv) to nv21 conversion? – mger Nov 03 '21 at 17:40
  • @mger NV21 is actually an encoding format of YUV image format. Both resides in ByteArray. In simple words, your YUV array is compatible with NV21 if you got it from camera in android. – Ghazi Nov 06 '21 at 23:58
1

From the answer of Reuben Scratton in Converting YUV->RGB(Image processing)->YUV during onPreviewFrame in android?

You can make the camera preview use RGB format instead of YUV.

Try this:

Camera.Parameters.setPreviewFormat(ImageFormat.RGB_565);

Community
  • 1
  • 1
Heejin
  • 4,463
  • 3
  • 26
  • 30
  • 3
    RGB_565 is not guaranteed to be supported. You need to check getSupportedPreviewFormats first (http://developer.android.com/reference/android/hardware/Camera.Parameters.html#getSupportedPreviewFormats() ) to see if it's listed. – Eddy Talvala Dec 05 '12 at 19:05
0

YUV is just another colour space. You can define red in YUV space just as you can in RGB space. A simple calculator suggests an RGB value of 255,0,0 (red) should appear as something like 76,84,255 in YUV space so just look for something close to that.

OldCurmudgeon
  • 64,482
  • 16
  • 119
  • 213