1

I am using ARCore Augmented faces to create Try-out-Jewellery App in Android. I have created App which supports 3 different nose rings and 1 Mang Tikka (Head Jewellery). You can find reference video of our Try-out-Jewellery App on youtube.

ARCore augmented face mesh is only covers points in front face and not include points related to Ear part of face.

I have also tried Google's ML Kit Face Detection API to detect ear but I am not able to use the 3d models files (.obj, .glb files) there, it uses Graphic Overlay to augmented image on face. I have tried to use Graphic overlay and Added bitmap to detected face elements using MLKit but it is not looking like real and also the overlay image has depth related issue.

I have 1 question based on above scenario of augmenting a ear ring.

  1. Can we use ML Kit Face detection API such that it can render the 3d model files with .glb, .obj extensions ?

Below image is face mesh indices used in ARCore Augmented face API. enter image description here

Pradip Tilala
  • 1,715
  • 16
  • 24
  • 1
    Speaking for ML Kit, the Face API currently only provides 2D landmarks, so I don't think it can help you here. – Chrisito Jan 26 '21 at 18:51
  • Hi, Pradip. I watch your youtube video. I wonder how you get 468 landmarks points using ARCore in ios/android. Can you please help me out to solve this issue? https://stackoverflow.com/questions/68450636/how-to-get-468-face-landmarks-points-using-arcore-ios – Hiral Jul 21 '21 at 09:39

1 Answers1

0

You can find the face rotation in augumented faces from the faceNode object.

faceNode.localRotation.x
ajaitaarak
  • 1
  • 1
  • 1