exploring different dimensions of being a human.
creating efficient ai models, art, communities,
and running super long distances...instagram.com/honnesh_29/ TorontoJoined May 2020
Can't help but look at optimizers as ways of living life.
SGD: Just deciding what's feels right at this particular moment. Zig-Zag.
AdaGrad: Learn from every stumble, but can lead to becoming overcautious and stop moving.
Adam: Moving with nuance, both direction and adaptivity.
Learning about Optimizers, reminded me how Momentum is such a beautiful thing.
It remember your past successes, keeps you pushing forward, avoiding stalls, and escaping flat plateaus.
Don't just react to the slope at this instant, but to the accumulated wisdom of past steps...
TSFM Tangents, All about Optimizers by @yacinelearning
Navigating the loss landscape and making it more "roundy".
The analogies were on point. (e.g. The Duct tape fix on the Optimizers to solve particular characteristics of the architecture)
TLDR: AdamW is the way to go :)
Truly!
There has never been a better time.
A better time to have a problem. To be stuck. To be overwhelmed. To be impatient.
To be out of ideas or out of your depth.
Out of breath.
Keep creating. Keep researching. Keep learning.
Truly!
There has never been a better time.
A better time to have a problem. To be stuck. To be overwhelmed. To be impatient.
To be out of ideas or out of your depth.
Out of breath.
Keep creating. Keep researching. Keep learning.
Papers in the park (at the OG Trinity Bellwoods) with @asusevski
To answer or not to answer. Truly one of the hardest optimization problems. How much do we want the model to guess and when?
A thought which pops up as I learn Foundational Models from scratch-:
A complex system that works is invariably found to have evolved from a simple system that worked.
(Gall's Law)
9K Followers 3K Followingai workspace for computational research || analyze research papers || link your papers, notes and code || https://t.co/z8y0u34EEI
238 Followers 1K FollowingAI Computing Engine: Its GPUs are widely used for deep learning and artificial intelligence training and reasoning, becoming the "gold standard" for AI hardware
543K Followers 24K FollowingThe best from ML/AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, & startups.
108 Followers 1K FollowingOpinions are of my own as well as error. Retweets not always endorsements. transiting from Indian politics to Canadian so help along if you can.
1K Followers 6K Followingscaling speech native LLMs @rimelabs
the future is willed into existence.
bioML, discovering new science, housing, industrial policy, local politics.
1 Followers 98 FollowingRecruiting webshell engineers t o penetrate websites, with a monthly salary of up to $100,000. If interested, please contact https://t.co/hs81Bl7oDh
251 Followers 311 FollowingThe Raw Researcher | On a mission to make PhD great again | Unsettled, unbound, and relentlessly curious | @uoft | @VectorInst 🚀
136K Followers 1 FollowingClaude is an AI assistant built by @anthropicai to be safe, accurate, and secure. Talk to Claude on https://t.co/ZhTwG8dz3D or download the app.
14K Followers 2K FollowingSenior AI Researcher at the Samsung SAIT AI Lab 🐱💻
I build generative AI for images, videos, text, tabular data, weights, molecules, and video games.
32K Followers 913 Followingfather. husband. building a garden in a dying world so my children remember what paradise looked like before men forgot how to tend it
1K Followers 6K Followingscaling speech native LLMs @rimelabs
the future is willed into existence.
bioML, discovering new science, housing, industrial policy, local politics.
13K Followers 4K FollowingDevoted to addressing alignment. We develop state of the art open sourced AI.
https://t.co/oANsMnut7V
https://t.co/6aJDLUvuU5
21K Followers 272 FollowingExec coach to the world’s top leaders. Founder @artofaccomp. Father & husband. Tweets on self-discovery, emotional fluidity, and more
52K Followers 588 FollowingMD. Ortho 🦴 Human Condition. I think you should turn my notifications on, it takes 1 post to inspire your upward spiral. https://t.co/sc3qLiY4XW
251 Followers 311 FollowingThe Raw Researcher | On a mission to make PhD great again | Unsettled, unbound, and relentlessly curious | @uoft | @VectorInst 🚀
5K Followers 193 FollowingPodcast, courses, and resources exploring emotional fluidity, transformation, and the journey of self-discovery in the modern world. @FU_joehudson
12K Followers 2K Following🌱 humaning: asking how can we human beautifully? • attunement, emotional fluency & wellbeing • 15yrs exploring: how can I learn to love my emotions?
2K Followers 2K FollowingHead of Growth @ConsensusNLP (prev. @VoiceflowHQ) || I plan pop up raves around Toronto @ https://t.co/EUauOj7FI6 and cook on TikTok!
108K Followers 4 FollowingCohere builds secure, scalable, and private enterprise-grade AI solutions for real-world business problems. Join us: https://t.co/Yb2xItMObl