繁體中文, 正體中文, zh-tw In this presentation, you'll know: - how to get the SDK - how to integrate 3D object to RealityKit - how to use System and Components

1. A brief look at visionOS
Ray Yuan Liu

2. Hi!
劉瑞元 Ray Yuan Liu
- Software Developer
- Tech Lover
- JetBrains 粉絲

3. Outline
- visionOS SDK
- UI Interactions
- RealityKit
- 3D Model
1

4. How can I get into VISION PRO 👓
- You can’t purchase a kit yet. (US only)
- Simulator in XCode 15
2

5. Download Vision SDK
3

6. Let us replicate a website
- The Inspiration 4 Website
4

7. UI interactions in Spatial Computing
- Eyes
- Pinch
- New glass effects: glassBackgroundEffect
- Volumetric
z axis
5

8. glassBackgroundEffect
6

9. RealityKit
- RealityView
- 3D object as a window
- Work with SwiftUI
- Full immersive Scene
7

10. RealityView
Load
Scene.usdz
from realitykit
content bundle
Add entity to
RealityView
8

11. 3D object as a window
a volumetric
window
9

12. 3D object as a window
10

13. Work with SwiftUI
Add view as
attachment
Adjust view
in
RealityView
11

14. Work with SwiftUI
12

15. Full immersive Scene
Also can be
a .mixed
mode
13

16. 3D Object
- Model Editor: Reality Composer Pro
- Like Unity
- Built-in particle projector
- Swift code can interact with 3D objects
- Component
- A representation of a geometry or a behavior that you apply to an entity.
- Skybox light (One of a predefined component)
- System
- Use systems to implement any behavior or logic that updates entities every frame.
- e.g. rotation
14

17. Reality Composer Pro
15

18. Component
e.g. built-in light effect
Add
components
to a entity
16

19. 17

20. System
E.g. Custom System with a custom components
Update per
frame 18

21. System
Register into main entry point
Custom
components and
systems should
be registered
19

22. System
Custom component: set and get
20

23. Can I use Unity 3D over Reality Composer Pro?
- Only Pro and Enterprise version can use Vision SDK
- Free version is NOT supported
- Unity Pro annual prepaid pricing will be $2,040/yr
21

24. Where to get free resources of 3D object?
- Sketchfab
- Download usdz file
22

25. Let’s
Walkthrough…
23

26. References
- visionOS Development Fundamentals - Build A VisionOS App From Scratch
- https://www.youtube.com/watch?v=eMA1Vd1nc9M
- RealityKit Documentation
- https://developer.apple.com/documentation/realitykit
24
- https://rayuan.tw
- me@rayuan.tw
- https://www.linkedin.com/in/rayyuanliu/
Find me at