AR Quick Look

RSS for tag

Allow users to see incredibly detailed object renderings in real-world surrounding, with support for audio playback, using AR Quick Look.

Posts under AR Quick Look tag

77 Posts

Post

Replies

Boosts

Views

Activity

Quick Look - error message - model Universal Scene Description Package
Hi guys, I have a little problem with Quick Look and I am not sure, if it is because of 3D model, iPhone 8 or if there is a bug from Apple side. What is hapenning? I am able to download 3D model to my iPhone 8, then I am able to place 3D model on my table and in the moment when I place it, Quick Look stop to work. There is this message: "model Universal Scene Description Package 2,9 MB" Do you know, where can be the problem? YT video: https://www.youtube.com/watch?v=wZKlPZUJkbk&ab_channel=AZtutorialy USDZ file: https://drive.google.com/file/d/1TcL4VoISRuMtdHd3XoW_Se4Lq6tNucYt/view?usp=sharing I am looking forward to read you answers. Thank you very much in advance Have a nice day Jan
0
0
931
Dec ’21
Does Apple plan on supporting PNG Alpha in AR or not? It's been two years.
This thread actually marks an unsolved problem as "accepted"/solved https://developer.apple.com/forums/thread/119265 As of iOS 14/15 Apple's own QuickLook does not support: On iOS and in AR, any USDZ with PNG transparency. It's a shame and testament to the AR dev team's (in)ability to address this issue. Multiple tweets and a basic google search shows this problem existing for over 2 years and now entering the third year. Meanwhile formats such as GLTF/GLB... just work
1
0
725
Dec ’21
AR Quick Look additional controls?
I've recently added some USDZ files to a web page, and I can download and display them fine via AR Quick Look on an iPhone or iPad. I've noticed full occlusion is active in the AR view. Over time, the device appears to heat up and the frame rate drops. Are there any properties I can set in the <a rel="ar" ...> HTML tag to control things like occlusion or autofocus (i.e., turn them off)?
0
0
951
Nov ’21
usdzconvert and metersPerUnit
I've been creating USDA files manually and converting them to USDZ via Apple's usdzconvert tool (version 0.64). In the file I set unit size to be 1 meter metersPerUnit = 1.0 but the USDZ keeps the unit size at 1 cm. Apple's Reality Converter does process the metersPerUnit metadata, so that is a viable work-around for me. But sometimes I'd prefer the command-line tool. Is there an update to the usdzconvert tool? I couldn't find one.
0
0
915
Nov ’21
object could not be opened
We are producing augmented reality in about 2 minutes with various scenes and animations. On ios14, everything worked without any problem, but on ios15, it suddenly says that AR Quick Look cannot open it. It seems that the reality file with a large capacity or two or more animations does not open. Please check. I attach a video that worked well on ios14. https://youtu.be/KPo_ikRclmc Thanks.
1
0
777
Oct ’21
USDZ AR Quick Look - displayColor appears as pink
Hi all, I am able to create USDZ files to load in AR Quick Look. However, for prims that contain displayColor primvar values, they all appear incorrect (pink) when opened via AR Quick Look. To repro, create a usdz from this (size too big for attaching usdz directly): #usda 1.0 ( defaultPrim = "Origin" ) def Xform "Origin" ( apiSchemas = ["GeomModelAPI"] kind = "component" ) { string label = "Golden Krone Hotel" string modern_name def Sphere "Volume" ( doc = "This is the main volume for the Golden Krone" ) { color3f[] primvars:displayColor = [(0.721156, 0.0030596028, 0.27578437)] ( elementSize = 1 interpolation = "constant" ) double radius = 2 float xformOp:rotateX:tilt = 12 float xformOp:rotateZ:spin.timeSamples = { 0: 0, 192: 1440, } double3 xformOp:translate = (0, 2, 0) uniform token[] xformOpOrder = ["xformOp:translate", "xformOp:rotateZ:spin", "xformOp:rotateX:tilt"] } def Cube "TopBackLeft" ( doc = "This is the volume for the top back left section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.8052342, 0.0014515291, 0.19331428)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (-2, 6, -2) uniform token[] xformOpOrder = ["xformOp:translate"] } def Capsule "TopFrontLeft" ( doc = "This is the volume for the top front left section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.007277872, 0.58201957, 0.41070253)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (-2, 6, 2) uniform token[] xformOpOrder = ["xformOp:translate"] } def Cylinder "TopBackRight" ( doc = "This is the volume for the top back right section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.20229208, 0.39510167, 0.40260625)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (2, 6, -2) uniform token[] xformOpOrder = ["xformOp:translate"] } def Cone "TopFrontRight" ( doc = "This is the volume for the top front right section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.08033847, 0.7920769, 0.12758464)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (2, 6, 2) uniform token[] xformOpOrder = ["xformOp:translate"] } } Opening the file in USDView, SideFX Houdini, Autodesk Maya ends up in viewport displaying expected colors: Opening it in AR Quick Look iOS appears pink: Searching on the internet, I have not been able to find any information about why this happens, what the requirements are, or if it is a known issue. Only a post on usd-interest google group from 2019 reported the same: https://groups.google.com/g/usd-interest/c/8hD2rzRboeg/m/PSgIPlLCBgAJ with the answer: """ And I was just told that ARQL does not currently support vertex displayColors in any capacity - neither without a bound material (as in the example I provided), nor as something read via a UsdPrimvarReader shader to feed to a UsdPreviewSurface... the only primvars currently supported in ARQL are texture coordinates for feeding a UsdUVTexture shader. """ I can not bake textures as my app is meant to work with display colors only. Does anyone have links to official help or information on this? Searching if supporting displayColor as other USD renderers do will be coming eventually.
2
0
1.5k
Oct ’21
USDZ AR Quick Look - UsdGeom PointInstancer does not load
Hi all, I have a question regarding UsdGeom.PointInstancer: https://graphics.pixar.com/usd/docs/api/class_usd_geom_point_instancer.html schema support on AR Quick Look for USD stages. When packaging the city set example from pixar https://graphics.pixar.com/usd/downloads.html: and using it as a USDZ file ends up in AR Quick Look displaying: No point instancer at all. Prototypes at the origin. I have not been able to find any information regarding support, requirements or plan for UsdGeom.PointInstancer in AR Quick Look or Reality Composer pages. USDView, SideFX Houdini and Autodesk Maya support it without problem, I was hoping to use it for some AR models. Can somebody point me in the right direction for documentation on this, please?
0
0
811
Oct ’21
Reality Composer - Combining animations and movement
Long time listener, first time caller here, We'd like to use AR Quick Look to render a rigged game character that walks to where you tap on the base surface. So far, I'm only seeing the ability to sequentially trigger actions. So move+animate simultaneously seems un-doable. I guess one could parent the USDZ to a "mover" object and then run the transform on the mover and the animation on the USDZ but ugh. Anyone done something like this?
1
0
1.2k
Oct ’21
usdz audio not working
I use usdzaudioimport to embed a simple audio file in my usdz. But in QuickLook (iOS or macOS) the audio is never played. What I've tried : usdzaudioimport ./myfile.usdz ./myfile.usda -a /test audio.mp3 -auralMode notSpatial -playbackMode loopFromStart usdzip myfile.usdz myfile.usda ./0/* where ./0 is the asset folder of myfile.usda I tried with usdc usdzaudioimport ./myfile.usdz ./myfile.usdc -a /test audio.mp3 -auralMode notSpatial -playbackMode loopFromStart usdzip myfile.usdz myfile.usdc ./0/* I tried with usdz without converting to usd(a/c) usdzaudioimport ./myfile.usdz -a /test audio.mp3 -auralMode notSpatial -playbackMode loopFromStart I tried m4a and mp3. I tried the sample cube from Reality Composer by adding my audio.mp3 as behavior at start of scene and exporting in usdz for Quicklook. But none of this solutions worked. I'm not able to play any audio with AR Quick Look usdz file at the start of the scene.
1
0
1.7k
Sep ’21
QuickLook AR broken in In-App Browsers in iOS 15
Hi! Opening any web-based QuickLook AR experience (e.g. https://developer.apple.com/augmented-reality/quick-look/) in an app that launches an In-App Browser (e.g. Slack, Discord) will result in only the "Object" tab being visible, the AR mode never loads despite the USDZ object loading just fine in the Object tab. This is a breaking change from iOS 14 & one that I depend on.
1
0
1.1k
Sep ’21
Dose AR quick look support Mask Material?
Hey! Dose AR quick look support Mask Material? I have seen the the face tracking have face Mask out, which the face will create occlusion for the face. So the object like helmet wont look like just floating over the head. Now I wanted to take that mask material and apply to my other project, like world tracking and image tracking, is this possible? thanks.
0
0
871
Jul ’21
AR Web View with user interaction through 2D HTML Overlay with buttons?
AR Web View with user interaction through 2D HTML Overall Is there a way to add user actions to an AR Quick View object and trigger them as a 2D overall, for example a button in HTML? I have an object that can display different animations and I want to control them with buttons on an overlay. Is there a possibility to exchange commands betweenHTML Overlay and Object ? If yes, how exactly?
0
0
519
Jul ’21
Quick Look - error message - model Universal Scene Description Package
Hi guys, I have a little problem with Quick Look and I am not sure, if it is because of 3D model, iPhone 8 or if there is a bug from Apple side. What is hapenning? I am able to download 3D model to my iPhone 8, then I am able to place 3D model on my table and in the moment when I place it, Quick Look stop to work. There is this message: "model Universal Scene Description Package 2,9 MB" Do you know, where can be the problem? YT video: https://www.youtube.com/watch?v=wZKlPZUJkbk&ab_channel=AZtutorialy USDZ file: https://drive.google.com/file/d/1TcL4VoISRuMtdHd3XoW_Se4Lq6tNucYt/view?usp=sharing I am looking forward to read you answers. Thank you very much in advance Have a nice day Jan
Replies
0
Boosts
0
Views
931
Activity
Dec ’21
Does Apple plan on supporting PNG Alpha in AR or not? It's been two years.
This thread actually marks an unsolved problem as "accepted"/solved https://developer.apple.com/forums/thread/119265 As of iOS 14/15 Apple's own QuickLook does not support: On iOS and in AR, any USDZ with PNG transparency. It's a shame and testament to the AR dev team's (in)ability to address this issue. Multiple tweets and a basic google search shows this problem existing for over 2 years and now entering the third year. Meanwhile formats such as GLTF/GLB... just work
Replies
1
Boosts
0
Views
725
Activity
Dec ’21
Will AR Quick Look ever have object permanence?
It's annoying that my image anchored scenes are migrating as soon as the image goes out of frame. Wondering if theres a way to make an image target anchored model stay put as a user moves far from the image anchor. Say 100 feet or so. I'm using this for house sized models.
Replies
0
Boosts
0
Views
577
Activity
Dec ’21
Hiding objects when previewing in AR within Quick Look
Hi, I have build an experience with different hotspots. I hide them on start using Reality Composer. But they still show up in the Preview half-transparent object in Quick Look. (Before it's actually on an AR plane) How can I hide them for the Quick Look preview?
Replies
0
Boosts
0
Views
573
Activity
Nov ’21
object always facing the camera during the AR experience.
Hey. Anyone have experience build AR quick look from Reality Composer. How can I set the object always facing the camera during the AR experience. For now I can only do scene start trigger which only play once. Is there any way we can keep it alway facing the camera? Thank.
Replies
1
Boosts
0
Views
1.3k
Activity
Nov ’21
AR Quick Look additional controls?
I've recently added some USDZ files to a web page, and I can download and display them fine via AR Quick Look on an iPhone or iPad. I've noticed full occlusion is active in the AR view. Over time, the device appears to heat up and the frame rate drops. Are there any properties I can set in the <a rel="ar" ...> HTML tag to control things like occlusion or autofocus (i.e., turn them off)?
Replies
0
Boosts
0
Views
951
Activity
Nov ’21
usdzconvert and metersPerUnit
I've been creating USDA files manually and converting them to USDZ via Apple's usdzconvert tool (version 0.64). In the file I set unit size to be 1 meter metersPerUnit = 1.0 but the USDZ keeps the unit size at 1 cm. Apple's Reality Converter does process the metersPerUnit metadata, so that is a viable work-around for me. But sometimes I'd prefer the command-line tool. Is there an update to the usdzconvert tool? I couldn't find one.
Replies
0
Boosts
0
Views
915
Activity
Nov ’21
object could not be opened
We are producing augmented reality in about 2 minutes with various scenes and animations. On ios14, everything worked without any problem, but on ios15, it suddenly says that AR Quick Look cannot open it. It seems that the reality file with a large capacity or two or more animations does not open. Please check. I attach a video that worked well on ios14. https://youtu.be/KPo_ikRclmc Thanks.
Replies
1
Boosts
0
Views
777
Activity
Oct ’21
USDZ AR Quick Look - displayColor appears as pink
Hi all, I am able to create USDZ files to load in AR Quick Look. However, for prims that contain displayColor primvar values, they all appear incorrect (pink) when opened via AR Quick Look. To repro, create a usdz from this (size too big for attaching usdz directly): #usda 1.0 ( defaultPrim = "Origin" ) def Xform "Origin" ( apiSchemas = ["GeomModelAPI"] kind = "component" ) { string label = "Golden Krone Hotel" string modern_name def Sphere "Volume" ( doc = "This is the main volume for the Golden Krone" ) { color3f[] primvars:displayColor = [(0.721156, 0.0030596028, 0.27578437)] ( elementSize = 1 interpolation = "constant" ) double radius = 2 float xformOp:rotateX:tilt = 12 float xformOp:rotateZ:spin.timeSamples = { 0: 0, 192: 1440, } double3 xformOp:translate = (0, 2, 0) uniform token[] xformOpOrder = ["xformOp:translate", "xformOp:rotateZ:spin", "xformOp:rotateX:tilt"] } def Cube "TopBackLeft" ( doc = "This is the volume for the top back left section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.8052342, 0.0014515291, 0.19331428)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (-2, 6, -2) uniform token[] xformOpOrder = ["xformOp:translate"] } def Capsule "TopFrontLeft" ( doc = "This is the volume for the top front left section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.007277872, 0.58201957, 0.41070253)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (-2, 6, 2) uniform token[] xformOpOrder = ["xformOp:translate"] } def Cylinder "TopBackRight" ( doc = "This is the volume for the top back right section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.20229208, 0.39510167, 0.40260625)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (2, 6, -2) uniform token[] xformOpOrder = ["xformOp:translate"] } def Cone "TopFrontRight" ( doc = "This is the volume for the top front right section of the Golden Krone" ) { color3f[] primvars:displayColor = [(0.08033847, 0.7920769, 0.12758464)] ( elementSize = 1 interpolation = "constant" ) double3 xformOp:translate = (2, 6, 2) uniform token[] xformOpOrder = ["xformOp:translate"] } } Opening the file in USDView, SideFX Houdini, Autodesk Maya ends up in viewport displaying expected colors: Opening it in AR Quick Look iOS appears pink: Searching on the internet, I have not been able to find any information about why this happens, what the requirements are, or if it is a known issue. Only a post on usd-interest google group from 2019 reported the same: https://groups.google.com/g/usd-interest/c/8hD2rzRboeg/m/PSgIPlLCBgAJ with the answer: """ And I was just told that ARQL does not currently support vertex displayColors in any capacity - neither without a bound material (as in the example I provided), nor as something read via a UsdPrimvarReader shader to feed to a UsdPreviewSurface... the only primvars currently supported in ARQL are texture coordinates for feeding a UsdUVTexture shader. """ I can not bake textures as my app is meant to work with display colors only. Does anyone have links to official help or information on this? Searching if supporting displayColor as other USD renderers do will be coming eventually.
Replies
2
Boosts
0
Views
1.5k
Activity
Oct ’21
USDZ AR Quick Look - UsdGeom PointInstancer does not load
Hi all, I have a question regarding UsdGeom.PointInstancer: https://graphics.pixar.com/usd/docs/api/class_usd_geom_point_instancer.html schema support on AR Quick Look for USD stages. When packaging the city set example from pixar https://graphics.pixar.com/usd/downloads.html: and using it as a USDZ file ends up in AR Quick Look displaying: No point instancer at all. Prototypes at the origin. I have not been able to find any information regarding support, requirements or plan for UsdGeom.PointInstancer in AR Quick Look or Reality Composer pages. USDView, SideFX Houdini and Autodesk Maya support it without problem, I was hoping to use it for some AR models. Can somebody point me in the right direction for documentation on this, please?
Replies
0
Boosts
0
Views
811
Activity
Oct ’21
Reality Composer - Combining animations and movement
Long time listener, first time caller here, We'd like to use AR Quick Look to render a rigged game character that walks to where you tap on the base surface. So far, I'm only seeing the ability to sequentially trigger actions. So move+animate simultaneously seems un-doable. I guess one could parent the USDZ to a "mover" object and then run the transform on the mover and the animation on the USDZ but ugh. Anyone done something like this?
Replies
1
Boosts
0
Views
1.2k
Activity
Oct ’21
usdz audio not working
I use usdzaudioimport to embed a simple audio file in my usdz. But in QuickLook (iOS or macOS) the audio is never played. What I've tried : usdzaudioimport ./myfile.usdz ./myfile.usda -a /test audio.mp3 -auralMode notSpatial -playbackMode loopFromStart usdzip myfile.usdz myfile.usda ./0/* where ./0 is the asset folder of myfile.usda I tried with usdc usdzaudioimport ./myfile.usdz ./myfile.usdc -a /test audio.mp3 -auralMode notSpatial -playbackMode loopFromStart usdzip myfile.usdz myfile.usdc ./0/* I tried with usdz without converting to usd(a/c) usdzaudioimport ./myfile.usdz -a /test audio.mp3 -auralMode notSpatial -playbackMode loopFromStart I tried m4a and mp3. I tried the sample cube from Reality Composer by adding my audio.mp3 as behavior at start of scene and exporting in usdz for Quicklook. But none of this solutions worked. I'm not able to play any audio with AR Quick Look usdz file at the start of the scene.
Replies
1
Boosts
0
Views
1.7k
Activity
Sep ’21
QuickLook AR broken in In-App Browsers in iOS 15
Hi! Opening any web-based QuickLook AR experience (e.g. https://developer.apple.com/augmented-reality/quick-look/) in an app that launches an In-App Browser (e.g. Slack, Discord) will result in only the "Object" tab being visible, the AR mode never loads despite the USDZ object loading just fine in the Object tab. This is a breaking change from iOS 14 & one that I depend on.
Replies
1
Boosts
0
Views
1.1k
Activity
Sep ’21
Display AR object from url
I want to add AR objects to my backend server and view them in my mobile application. How can I display these object without adding them to my assets folder? Thanks
Replies
1
Boosts
0
Views
632
Activity
Aug ’21
Dose AR quick look support Mask Material?
Hey! Dose AR quick look support Mask Material? I have seen the the face tracking have face Mask out, which the face will create occlusion for the face. So the object like helmet wont look like just floating over the head. Now I wanted to take that mask material and apply to my other project, like world tracking and image tracking, is this possible? thanks.
Replies
0
Boosts
0
Views
871
Activity
Jul ’21
AR Web View with user interaction through 2D HTML Overlay with buttons?
AR Web View with user interaction through 2D HTML Overall Is there a way to add user actions to an AR Quick View object and trigger them as a 2D overall, for example a button in HTML? I have an object that can display different animations and I want to control them with buttons on an overlay. Is there a possibility to exchange commands betweenHTML Overlay and Object ? If yes, how exactly?
Replies
0
Boosts
0
Views
519
Activity
Jul ’21
Disable instant AR placement in AR quick look
I want to disable the instant scan and placement in AR quick look and implement tap/touch to place an object. Can the instant object placement in AR quick look, be disabled?
Replies
0
Boosts
0
Views
996
Activity
Jun ’21