Saurabh Singh @saurasingh

Research Scientist @ Poetiq, Ex-Google DeepMind saurabhsingh.info California, USA Joined December 2009

Tweets

44
Followers

220
Following

326
Likes

30

Nate Gillman @GillmanLab

11 months ago

LLMs are powerful sequence modeling tools! They not only can generate language, but also actions for playing video games, or numerical values for forecasting time series. Can we help LLMs better model these continuous "tokens"? Our answer: Fourier series! Let me explain… 🧵(1/n)

26 215 2K 206K 2K

Download Video

Saurabh Singh @saurasingh

a year ago

Congrats to all the best paper award winners at ICML, no doubt lot of hard work went into it. However, some of these papers clearly can't be reproduced, due to missing details etc. Didn't realize that is not necessary anymore (to be best).

1 0 0 252 0

Alfredo De la Fuente @alfo_512

a year ago

Happy to announce our paper ‘Fourier Basis Density Model’, joint work with @saurasingh and Johannes Ballé, won Best Paper Award at Picture Coding Symposium (PCS 2024)🏅 arxiv.org/abs/2402.15345

1 3 10 1K 2

Alfredo De la Fuente @alfo_512

2 years ago

Can we use Fourier series to model univariate PDFs? (esp. useful in neural compression) We introduce a lightweight, flexible, and end-to-end trainable Fourier basis density model. w/ @saurasingh Johannes Ballé Paper: arxiv.org/abs/2402.15345 Code: github.com/google/codex

1 6 15 1K 4

Download Image

Tanmay Gupta @tanmay2099

3 years ago

Pleased to announce that the GPV-1 paper will be presented as an Oral at #CVPR2022. An updated version of the paper that conveys the key ideas much more clearly is now available on arxiv arxiv.org/abs/2104.00743 #GeneralPurposeVision #GPV @allen_ai

Tanmay Gupta @tanmay2099

4 years ago

1 8 33 0 8

1 3 16 0 2

Jeff Dean @JeffDean

5 years ago

An excellent implementation of keepalive loop.

Dr. Shuchi Grover 🇮🇳🇺🇸🌎 @shuchig

5 years ago

An excellent implementation of keepalive loop.

15 225 807 0 11

Download Image

15 108 617 0 7

Sander Dieleman @sedielem

5 years ago

Very excited about the renewed focus on iterative refinement as a powerful tool for generative modelling! Here are a few relevant ICLR 2021 submissions: (image credit: github.com/ermongroup/ncsn) (1/3)

5 102 501 0 117

Download Gif

George Toderici @george_toderici

5 years ago

Our group just released an arXiv paper that reviews Nonlinear Transform Coding approaches. We hope this will make the development of new end-to-end neural/learned compression methods easier to understand for those new to the field. arxiv.org/abs/2007.03034

2 24 102 0 33

Download Image

Peyman Milanfar @docmilanfar

5 years ago

1/8 What does it mean to filter an image (or signal)? Often we choose, or design, a set of weights and apply them to the input image. But what loss/objective function does this process optimize (if any)? Should we care?

4 185 723 0 278

Download Image

Jeremy Konyndyk @JeremyKonyndyk

5 years ago

Welcome to May. As I feared, the federal government wasted April much as it wasted February. That is a harsh assessment given how much the country has been suffering. But without competent federal leadership, the best we are managing is to tread water. Some stats:

137 4K 12K 0 880

Peyman Milanfar @docmilanfar

5 years ago

Years ago when my wife and I we were planning to buy our home, my dad stunned me with how quickly he could compute loan payments in his head. I asked him how he did it. He'd learned a strange formula for compound interest from his father, who was a merchant in 19th century Iran.

13 374 2K 0 553

Download Image

XKCD Comic @xkcdComic

6 years ago

Garbage Math xkcd.com/2295/ m.xkcd.com/2295/

102 3K 12K 0 295

Download Image

Natalie Wolchover @nattyover

6 years ago

Confusion surrounds the nature of time. The physicist Nicolas Gisin argues that the problem is mathematical. In recent papers, he claims that math with finite numbers describes a universe in which time passes and the future is open. New by me: quantamagazine.org/does-time-real…

32 88 252 0 45

Dave Richeson @divbyzero

6 years ago

One way to visualize the real projective plane in 3D is via Werner Boy's immersion ("Boy's surface") I found this video and arXiv article showing how to make one out of paper. I guess I know what I'm doing this evening! youtube.com/watch?v=dekzCB… arxiv.org/pdf/1303.6448v…

3 9 47 0 4

Download Image

Saurabh Singh @saurasingh

6 years ago

Our paper "Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Networks" is accepted as Oral at CVPR 2020. An updated version is now up on arXiv with additional implementation considerations. arxiv.org/abs/1911.09737

3 57 187 0 35

Download Image

Saurabh Singh @saurasingh

6 years ago

medium.com/@Cancerwarrior…

0 0 0 0 0

Keenan Crane @keenanisalive

6 years ago

Have been recording lectures on Discrete Differential Geometry for remote teaching. Here for instance is a broad overview of the idea of *curvature* for those who haven't studied it before (or maybe also for those who have!): youtu.be/e-erMrqBd1w #DiscreteDifferentialGeometry

6 111 470 0 79

Download Image

Saurabh Singh @saurasingh

6 years ago

Since number of COVID19 cases in India are relatively fewer, an exponential model should provide reasonable short term predictions. Here is a simple fit that I did on recent data (from JHU) with predictions up to end-of-month.

2 0 3 0 0

Download Image

Sander Dieleman @sedielem

6 years ago

New blog post: 'Generating music in the waveform domain' benanne.github.io/2020/03/24/aud… A comprehensive overview of the field and some personal thoughts, based on a tutorial I gave at @ismir2019 with @jordiponsdotme and Jongpil Lee back in November. Comments / feedback welcome!