Integrating an “Expressive-Iteration” AI narrative system with 3 modular AR gameplays in 8th Wall

🧑‍💻 Technical Support
1

Hi 8th Wall Support Team,

I’m working on a prototype that combines:

  1. EI Framework – an OpenAI-powered storytelling loop that yields discrete “Events”.
  2. Three standalone WebAR mini-games (orbit-to-find-mark · hand-tilt-reveal · fly-and-grab).
  3. Dynamic 3D assets – each event’s user-photo is sent to Meshy AI → returns a GLB URL.

At runtime we:
– call /api/photo_event → get { event_text, gameplay_type, glb_url }
– inject the GLB into the scene and launch the matching gameplay A-Frame component.

Flowchart

AI - MR System
AI - MR System1920×1080 84.2 KB

Key questions

  1. Architecture fit – Is it okay to run such a fully dynamic flow (async GLB download + hand-tracking + component hot-swap) inside an 8th Wall xrweb scene?

  2. Can OpenAI choose one of the three gameplay based on the generated Event? How to implement it between 8th Wall and Backend Server?

  3. Best-practice for modular gameplays – current idea:

html

CopyEdit

<a-entity id="gameRouter"
          ei-gameplay-router="type: gameplay2; glb: ./model.glb; label: '…';">
</a-entity>
  • The router component removes/creates inner entities and adds one of three child components (gameplay-orbit, gameplay-hand-reveal, gameplay-fly).
    Does this align with 8th Wall’s recommended pattern for memory/performance?
  • Asset streaming – Any limits or tips for repeatedly loading Meshy-generated GLBs (~2 MB each) into the same xrextras-hand-anchor?
    Should we cache via <a-assets> or call scene.renderer.compile()?
  • Hand-tracking overlay – We currently attach the GLB to xrextras-hand-attachment point="inner,palm".
    Is there an official way to disable hand-mesh rendering but keep the tracking grip point?
  • Compatibility – Target devices are iOS + Safari/Chrome.
    Any known gotchas with the combination: A-Frame 1.4.2 + 8th Wall XRExtras + dynamic gltf-model attribute changes?

Demo

EI Framework

Gameplay 1

Gameplay 2

Gameplay 3

Thanks a lot for any guidance you can share!

2

8th Wall, specifically the Editor, doesn’t do anything beyond providing the tools to create AR experiences and tracking. That being said, there is nothing specific to 8th Wall that you need to do when optimizing your A-Frame project. I recommend following A-Frame’s best practices and style guidelines, along with those of any other tools you are using.

Additionally, xrextras is open source. I encourage you to take a look and potentially clone it if you would like to make any edits:

3

Dear Butler,

Thanks for your reply, I will read the documentation carefully.

1 Like