LLMs are powerful sequence modeling tools! They not only can generate language, but also actions for playing video games, or numerical values for forecasting time series. Can we help LLMs better model these continuous "tokens"? Our answer: Fourier series! Let me explain… 🧵(1/n)
Congrats to all the best paper award winners at ICML, no doubt lot of hard work went into it. However, some of these papers clearly can't be reproduced, due to missing details etc. Didn't realize that is not necessary anymore (to be best).
Happy to announce our paper ‘Fourier Basis Density Model’, joint work with @saurasingh and Johannes Ballé, won Best Paper Award at Picture Coding Symposium (PCS 2024)🏅 arxiv.org/abs/2402.15345
Can we use Fourier series to model univariate PDFs?
(esp. useful in neural compression)
We introduce a lightweight, flexible, and end-to-end trainable Fourier basis density model.
w/ @saurasingh Johannes Ballé
Paper: arxiv.org/abs/2402.15345
Code: github.com/google/codex
Very excited about the renewed focus on iterative refinement as a powerful tool for generative modelling! Here are a few relevant ICLR 2021 submissions:
(image credit: github.com/ermongroup/ncsn)
(1/3)
Our group just released an arXiv paper that reviews Nonlinear Transform Coding approaches. We hope this will make the development of new end-to-end neural/learned compression methods easier to understand for those new to the field. arxiv.org/abs/2007.03034
1/8 What does it mean to filter an image (or signal)? Often we choose, or design, a set of weights and apply them to the input image. But what loss/objective function does this process optimize (if any)? Should we care?
Welcome to May.
As I feared, the federal government wasted April much as it wasted February.
That is a harsh assessment given how much the country has been suffering. But without competent federal leadership, the best we are managing is to tread water. Some stats:
Years ago when my wife and I we were planning to buy our home, my dad stunned me with how quickly he could compute loan payments in his head. I asked him how he did it. He'd learned a strange formula for compound interest from his father, who was a merchant in 19th century Iran.
Confusion surrounds the nature of time. The physicist Nicolas Gisin argues that the problem is mathematical. In recent papers, he claims that math with finite numbers describes a universe in which time passes and the future is open. New by me: quantamagazine.org/does-time-real…
One way to visualize the real projective plane in 3D is via Werner Boy's immersion ("Boy's surface") I found this video and arXiv article showing how to make one out of paper. I guess I know what I'm doing this evening! youtube.com/watch?v=dekzCB…arxiv.org/pdf/1303.6448v…
Our paper "Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Networks" is accepted as Oral at CVPR 2020. An updated version is now up on arXiv with additional implementation considerations. arxiv.org/abs/1911.09737
Have been recording lectures on Discrete Differential Geometry for remote teaching. Here for instance is a broad overview of the idea of *curvature* for those who haven't studied it before (or maybe also for those who have!): youtu.be/e-erMrqBd1w#DiscreteDifferentialGeometry
Since number of COVID19 cases in India are relatively fewer, an exponential model should provide reasonable short term predictions. Here is a simple fit that I did on recent data (from JHU) with predictions up to end-of-month.
New blog post: 'Generating music in the waveform domain'
benanne.github.io/2020/03/24/aud…
A comprehensive overview of the field and some personal thoughts, based on a tutorial I gave at @ismir2019 with @jordiponsdotme and Jongpil Lee back in November. Comments / feedback welcome!
8 Followers 487 FollowingThe team provid es free cryptocurrency analysis,trading i nstructions, and you can earn $3,000+ per day. WS:https://t.co/ZbKxDUeHYS
82 Followers 7K FollowingThose who really have a skill, steadfastly on a road to work hard, no matter where the tuyne, he will eventually become a continuous shine.
3K Followers 7K FollowingFather of two great kids, husband, supporting and protecting #innovation, #Technology #enthusiast; enforcing #intellectualproperty #FBPE #FBPEU #FollowBack
1K Followers 7K FollowingSerial founder at the forefront of Physical AI and immersive technology. Co-Founder and CEO https://t.co/bJimVjYUQ8, theLIFT (acquired), AR Corp, Eggscape Mixed Reality.
2K Followers 7K FollowingFounder, Imaginator ai
knowledge discovery 2D navigation TS ML DL recsys econ math incentives mech design finance networks bridges boundaries, Time, 3d type
353 Followers 646 FollowingPhD candidate studying AI at @Stanford. Advised by @scott_linderman. Parallelizing nonlinear dynamics, including RNNs and MCMC.
84 Followers 357 FollowingAssistant Prof at CUHK, leading the Language and Vision (LaVi) Lab. Working on vision-language learning and large models,etc. PhD from UIUC
38 Followers 803 FollowingData Scientist l Coupa (Llamasoft) l Opex Analytics l
Problem Solver l
Documenting my thoughts and opinions here along with the timestamp
31K Followers 669 FollowingVP Research, Google DeepMind, ex-head of Google Brain. Professor at University of Cambridge. Machine Learning Researcher. ex-Chief Scientist & VP of AI, Uber.
16K Followers 489 FollowingAssociate Professor @UofT, Vice President of AI Research @nvidia, founding member of @VectorInst. Computer vision, deep learning, 3D. Opinions are my own.
2K Followers 546 FollowingSenior Research Scientist @allen_ai (Ai2) | Developing the science and art of multimodal AI agents | Prev. CS PhD, UIUC and EE UG, IIT Kanpur
11K Followers 253 FollowingOnce and future physicist masquerading as a statistician. Reluctant geometer. @mcmc_stan developer. Support my writing at https://t.co/Ut25MyjIAy. He/him.
1K Followers 217 FollowingBoard Member of IAIFI https://t.co/BrbTxA1iPI • Physics professor @Northeastern • String theorist interested in particle-cosmology, mathematics, and deep learning.
373K Followers 3K FollowingCosmologist, pilot, author, connoisseur of cosmic catastrophes. She/her. Dr. Personal account; not representing employer or anyone else.
14K Followers 519 FollowingAsst. Prof. of CS at Stanford, Google DeepMind. Prev: Anthropic, Google Brain. Co-Creator of MoEs, AlphaChip, Test Time Scaling Laws.
37K Followers 483 FollowingDigital Geometer, Assoc. Prof. of Computer Science & Robotics @CarnegieMellon @SCSatCMU and member of the @GeomCollective. There are four lights.
4K Followers 1K FollowingHead of Instruction at MoMath| Professor | Author | #MathRecess | Joyful Mathematics | Budding Data Scientist | Play | Art | #BlackLivesMatter Tweets are mine
12K Followers 2K FollowingMath and science writer. These days, I mostly use Twitter to complain to local government about street safety. Find me on Insta/Bluesky for other topics.
26K Followers 1K FollowingMathematician. Curley Chair in Liberal Arts at Dickinson College. Author of Tales of Impossibility and Euler's Gem. Now: https://t.co/cefdX8CG6u
22K Followers 5K FollowingWe work to develop, nurture and promote a physics community.
This page is managed by Val@ the Dept of Physics Alumni Relations Office.