xiaoan @_seanliu

reality computing ex-@Google. building https://t.co/qPvPG03thU to bridge intent and experience. seanliu.io New York, USA Joined May 2020

Tweets

2K
Followers

3K
Following

2K
Likes

18K

Google Research @GoogleResearch

2 weeks ago

Sensible Agent is a research prototype for proactive, unobtrusive AR agents that use real-time context (gaze, noise, hand availability) to offer seamless, socially-aware assistance, to minimize disruption. Learn more and check out the paper: goo.gle/47JTQ0y

8 20 136 17K 26

Download Video

Dr. Mar Gonzalez-Franco @twi_mar

2 weeks ago

🚨New vision paper on "Programmable Reality"* in @FrontVR we double down on the idea that "XR is to AI, what screens has been to computers" & then reimagine the principles + components that enable it in the real world. Certainly hoping to inspire durable lines of research.

2 5 26 2K 2

Download Image

xiaoan @_seanliu

a month ago

built a AI-HUD on my mac, get answers immediately just by ⌘+C any context; or take a screenshot, with or without speaking to AI in the meantime. like cluely, but for daily tasks; like raycast, but always-on.

1 1 6 612 2

Download Video

UploadVR @UploadVR

2 months ago

A research paper details how "proxies" can become a core interaction concept for mixed reality. Details here: uploadvr.com/research-proxi…

8 65 332 27K 100

Download Video

xiaoan @_seanliu

2 months ago

You can think of this as a reality interface that makes AI easier to offer options and share its reasoning so that all you need to do then is to select rather than speak. And it doesn’t have to rely solely on visuals, imagine camera input +audio/haptics feedback.

xiaoan @_seanliu

2 months ago

40 151 1K 118K 509

Download Video

1 0 16 818 2

xiaoan @_seanliu

2 months ago

World is a large latent space. Use your code to find a way out.

0 0 1 352 0

Dr. Mar Gonzalez-Franco @twi_mar

2 months ago

Over the last 2 years we have seen an acceleration on AI, but if AI is going enable humans in their day to day tasks, it most probably will be via XR. The issue is if a selection has real-world consequences, we will need great precision to interact. We envision Reality Proxy.