Matthieu LC @matthieulc

robots and llms / prev built typeless to make doctors happy, acq by @Doctolib matthieulc.com Joined January 2013

Tweets

151
Followers

1K
Following

1K
Likes

982

Sreejan Kumar @sreejan_kumar

3 weeks ago

I'm excited to share that my new postdoctoral position is going so well that I submitted a new paper at the end of my first week! A thread below

bioRxiv Neuroscience @biorxiv_neursci

3 weeks ago

I'm excited to share that my new postdoctoral position is going so well that I submitted a new paper at the end of my first week! A thread below

0 2 20 15K 21

1 11 69 21K 22

Matthieu LC @matthieulc

a month ago

Please give this new model a try, it is so so good!

Peter Bakkum @pbbakkum

a month ago

Please give this new model a try, it is so so good!

31 47 419 67K 173

Download Video

6 2 28 5K 3

Matthieu LC @matthieulc

3 months ago

wrapped up the blogpost and code for the shoggoth mini project! will release everything tomorrow 👀

2 0 8 1K 1

Matthieu LC @matthieulc

3 months ago

i've been working on a blogpost about the project these past few days, hopefully released by the end of the week! here's a cute animation of the system design

0 0 25 1K 3

Download Gif

Matthieu LC @matthieulc

3 months ago

just found out the white in human eyes is adaptive as the contrast makes gaze direction obvious, which helps in communicating intent much better than other animals sciencedirect.com/science/articl…

1 0 3 655 0

Matthieu LC @matthieulc

3 months ago

in dexterity tests, shoggoth mini reveals strong passive grasping generalization

4 5 86 11K 7

Download Video

played around with action smoothing due to control instabilities in the PPO policy. see how the raw predicted action diverges as it goes OOD. happy to find that exponential moving average is extremely effective here!

0 0 14 676 0

Download Video

Luke Darlow @LearningLukeD

3 months ago

Learning where to look, learning what to see. Work on Continuous Thought Machines continues to be exciting! As a teaser, take a look at our approach to "Foveated Active Vision". Check it out 👇 (details in the thread) pub.sakana.ai/ctm

18 129 870 61K 534

Download Video

Matthieu LC @matthieulc

3 months ago

approaching the end of v1 here :) worked on some new primitives, and integrating them all together. making the gpt4o realtime api consistent in its use of the primitives was harder than i thought. i will now start writing the blogpost and cleaning the vibecode a bit for…

8 11 155 9K 29

Download Video

Matthieu LC @matthieulc

4 months ago

worked on having gpt4o drive open-loop motor primitives like waving or grabbing from stereo vision. special tokens like <distance: 10cm> get streamed straight into the transcript stream, which gpt4o reacts too. next up is integrating the closed-loop hand tracking. main challenge…

94 163 2K 2.5M 539

Download Video

Mustafa Shukor @MustafaShukor1

4 months ago

The Worldwide @LeRobotHF hackathon is in 2 weeks, and we have been cooking something for you… Introducing SmolVLA, a Vision-Language-Action model with light-weight architecture, pretrained on community datasets, with an asynchronous inference stack, to control robots🧵