rex ledesma @rexrledesma

prev: @recursecenter, @dagster, @thejkcf rexledesma.com brooklyn Joined December 2015

Tweets

353
Followers

301
Following

305
Likes

3K

rex ledesma @rexrledesma

3 days ago

the data transformation wars are over. dbt, sdf, and sqlmesh are all joined together in one table

0 0 2 130 0

Download Image

GPAS is very cool! My original intuition here was that the residual stream should generally be free of operations. But looks like as long as the gradient flow is preserved, the residual stream can be subject to transformations.

PapersAnon @papers_anon

3 months ago

1 6 37 7K 23

Download Image

0 0 2 271 0

Download Image

rex ledesma @rexrledesma

3 months ago

i visited the airbnb office for the first time since leaving in 2020 and i’m immediately greeted by a colleague (from my former sf team!) who happened to be in nyc such a serendipitous encounter with the past. i’m glad someone still remembers me after half a decade :)

0 0 5 178 0

Download Image

rex ledesma @rexrledesma

3 months ago

new green card and new hair, call him legally blonde

0 0 2 184 0

Download Image

rex ledesma @rexrledesma

4 months ago

Some progress from @recursecenter: we have a lovely study group doing Stanford's CS336 The material (from just three lectures) has been so great in building intuition for all the different model matmuls After 2 weeks, I implemented the transformer architecture in ~250 LOC 🤯