Stack Overflow
Stack Overflow

Questions tagged [realitykit]

Apple RealityKit is a high-level framework that helps a developer to load and render AR/VR models with PBR shaders, animations and physics simulations for iOS, visionOS and macOS apps.

RealityKit is an Apple framework for building, animating and rendering 3D scenes. It was introduced at WWDC 2019 for iOS and macOS, and at WWDC 2023 for visionOS. RealityKit allows us implement a high-performance life-like 3D simulation, or fulfil a physically based rendering for its companion – and frameworks – to seamlessly integrate virtual objects into the real world.

RealityKit was built from the ground up for Augmented Reality apps, and it shines with and . Using this framework you can asynchronously load assets in .usdz and .reality formats, or in .rcproject format that stores compositions of app. Starting from Xcode 15, there will be the Reality Composer Pro app.

References

795 questions
71
votes
1 answer

RealityKit vs SceneKit vs Metal – High-Quality Rendering

I'm creating an iOS app that I intend to display realistic/high-quality renders within AR. Whilst experimenting with these 3 options, I'm still unsure which of them I should go forward with developing my app's framework around: SceneKit, RealityKit…
rmLuma
  • 829
  • 1
  • 6
  • 4
29
votes
2 answers

LiDAR and RealityKit – Capture a Real World Texture for a Scanned Model

Task I would like to capture a real-world texture and apply it to a reconstructed mesh produced with a help of LiDAR scanner. I suppose that Projection-View-Model matrices should be used for that. A texture must be made from fixed Point-of-View, for…
Andy Jazz
  • 49,178
  • 17
  • 136
  • 220
27
votes
3 answers

Are there any limitations in Vuforia compared to ARCore and ARKit?

I am a beginner in the field of augmented reality, working on applications that create plans of buildings (floor plan, room plan, etc with accurate measurements) using a smartphone. So I am researching about the best AR SDK which can be used for…
Kitwradr
  • 1,986
  • 3
  • 18
  • 32
26
votes
1 answer

What is ARAnchor exactly?

I'm trying to understand and use ARKit. But there is one thing that I cannot fully understand. Apple said about ARAnchor: A real-world position and orientation that can be used for placing objects in an AR scene. But that's not enough. So my…
PrepareFor
  • 2,448
  • 6
  • 22
  • 36
25
votes
4 answers

ARKit Plane Detection - Value of type 'ARView' has no member 'session'

I am trying to add plane detection to a simple ARKit app. I want to put a picture on a vertical plane. So first I need to detect the plane then I can add my object anchor which I created in RealityKit. However the problem is I am not sure the…
Jaz King
  • 353
  • 3
  • 5
18
votes
3 answers

What 3D model formats are supported by ARKit?

What 3D model formats are supported by ARKit? Does someone know all supported formats for using in ARKit, and which format Xcode can export to use in app?
user3371261
  • 185
  • 1
  • 1
  • 5
17
votes
3 answers

How to create USDZ file using Xcode converter?

At the 2018 WWDC Apple announced the introduction of new USDZ file format. In relation to creating USDZ file the following was said: To create your own usdz files, a usdz_converter has been bundled as part of Xcode 10 beta. Its a command line tool…
Clay
  • 1,721
  • 2
  • 10
  • 18
16
votes
3 answers

How to create a .usdz animation?

You can now convert 3D models to .usdz files (uncompressed zip archive) using Apple's command line tool bundled with Xcode 10 beta. Example code to convert an .obj file to .usdz: xcrun usdz_converter magnifying_glass.obj -g frame…
Clay
  • 1,721
  • 2
  • 10
  • 18
15
votes
2 answers

Understanding ARKit World Transform Matrices

In ARKit, when I perform a hit-test, I get back an instance of ARHitTestResult. One of the properties of this is worldTransform, which I understand contains a 4x4 transformation matrix of the position of the object – simd_float4x4. As someone who is…
Zack
  • 1,585
  • 1
  • 18
  • 29
14
votes
4 answers

ARKit – How to export OBJ from iPhone/iPad with LiDAR?

How can I export the ARMeshGeometry generated by the new SceneReconstruction API on the latest iPad Pro to an .obj file? Here's SceneReconstruction documentation.
zhou junhua
  • 462
  • 1
  • 4
  • 12
14
votes
2 answers

Which format file for 3d model SceneKit/ARKit better to use

I read several tutorials how to place 3d objects in SceneKit/ARKit applications and all of them uses .scn format files for the objects. But I found there is no any issues if I use original .dae format and do not convert it to .scn format. I don't…
wm.p1us
  • 2,019
  • 2
  • 27
  • 38
13
votes
1 answer

What's the difference between ARAnchor and AnchorEntity?

I'm currently doing some experiments with RealityKit. I've been looking at some sample code, and I'm a bit confused about the differences between ARAnchor and AnchorEntity, and when to use one over the other. So far I know that: Both are anchors…
eivindml
  • 2,197
  • 7
  • 36
  • 68
12
votes
1 answer

RealityKit – Getting runtime warning when placing a model in ARView

I get the following warning during runtime when I tap to load the model in ARView: Warning (secondary thread): in AppendProperty at line 859 of sdf/path.cpp -- Can only append a property 'preliminary:anchoring:type' to a prim path (/) Warning…
Myoung
  • 161
  • 5
12
votes
7 answers

How to specify a Double-sided material in RealityKit?

I'm trying to load a model and texture in RealityKit (set up in an ARView instance), but I can't seem to figure out how to specify the material should be two-sided. I have the model loaded up as a ModelEntity, the texture loaded up as a…
smithco
  • 679
  • 5
  • 17
11
votes
1 answer

How to record video in RealityKit?

I have a RealityKit project in Xcode and I want to record the ARView. I considered ReplayKit, but that is for screen recording, I want to record only the ARView with its camera feed. I considered the open source project ARVideoKit by AFathi but that…
Tad
  • 889
  • 9
  • 23
1
2 3
…
52 53