Shivam Garg @shivamg_13
PhD student @Stanford Stanford, CA Joined April 2010-
Tweets17
-
Followers148
-
Following231
-
Likes42
1/4 New paper on the (lack of) implicit bias for stochastic gradient descent in online learning. arxiv.org/abs/2306.08590 with @vyasnikhil96 @depen_morwani @rosieyzh @GalKaplun and @ShamKakade6
Fine-tuned performance without a step of SGD? Excited to share TART, which transplants transformer-based reasoning modules on arbitrary foundation models to improve in-context learning performance! 📜 arxiv.org/abs/2306.07536 💻 github.com/HazyResearch/T… ✍️ hazyresearch.stanford.edu/blog/2023-06-1…
LLMs can do in-context learning, but are they "learning" new tasks or just retrieving ones seen during training? w/ @shivamg_13, @percyliang, & Greg Valiant we study a simpler Q: Can we train Transformers to learn simple function classes in-context? 🧵 arxiv.org/abs/2208.01066
Come check out our poster (#169) in the evening session today! #NeurIPS2019 We present our thoughts on synthesizing long functionally correct programs and release the SPoC dataset as a benchmark for this task. See you there!
Come check out our poster (#169) in the evening session today! #NeurIPS2019 We present our thoughts on synthesizing long functionally correct programs and release the SPoC dataset as a benchmark for this task. See you there!
Paul Valiant Receives TCC Test-of-Time #Award iacr.org/workshops/tcc/…
Gandhi at 150. Incredible man. We all know what he accomplished. How he got there is less known and more interesting. 1869 was a good decade after the first war of independence and a century into British rule.
When you make model updates based on stale gradients
Congratulations to Ali Nesin for winning the 2018 Leelavati Prize. Despite police raids, threats of arrest and a shortage of resources, he has built the @Mat_Koyu, an oasis of math education in rural Turkey. simonsfoundation.org/2018/08/09/a-f…
It's getting hard to keep up with all the adversarial robustness developments. We thus created robust-ml.org - a community-run reference for state-of-the-art adversarial example defenses. Submit your defense/attack there! (with @anishathalye @logan_engstrom @tsiprasd)
Just started a youtube channel youtube.com/channel/UC-UC-… ! First set of videos will be recordings of a 10h bandit minicourse. After that I plan to record video lectures of my crash course in learning theory (tinyurl.com/y8jeu8cs , tinyurl.com/ycgmq5lh).
Some of the videos for our workshop on the ``Modern Challenges of Learning Theory" are already online: crm.umontreal.ca/2018/Modern18/… . These are really excellent talks, highly recommended.
@SushmaSwaraj I am not able to get US Visa for prestigious #AAAI conference I have tickets and conference registration. Can you please help
Elza Catmull @ElzCatmu
75 Followers 5K Following
Vernia Boulton @VerniaB79529
77 Followers 5K Following
Sleathea @Sleathea143337
4 Followers 472 Following
McSeete @SeeteMc45762
3 Followers 537 Following
Urania @urania38820
6 Followers 1K Following
B_eth @Beth91156664810
11 Followers 509 Following
Lylah Pinkerman @LyPinker
67 Followers 5K Following
Nathalie Kopperman @n_kopperm
39 Followers 5K Following
TabrezKhana3597 @khana359761851
14 Followers 1K Following The best ideas are useless if they are not executed.
Christina Williams @WendyLee531823
250 Followers 974 Following Tasha specializes in adult products (silicone dolls) and provides you with the best quality service, please visit the Telegram channel for details.
Zoey_Clark @ZoeyClark24195
5 Followers 1K Following
Jaden Park @jadenpark98
21 Followers 50 Following
Max Vladymyrov 🇺�.. @mvladymyrov
1K Followers 1K Following Research Scientist in ML @ Google. Previously, Yahoo Labs, UC Merced PhD.
Coletta Luebbering @ColettColetta
45 Followers 5K Following
Kali Trammer @ka_tramm
42 Followers 5K Following
E_leanor @Eleanor1515978
21 Followers 2K Following
Leia Germon @LeGermon
40 Followers 5K Following
Nelly Mcdonell @NelMcdone
44 Followers 5K Following
Karin Mintreas @KariMintre
39 Followers 5K Following
Dakota Stalzer @DakotaStalz
28 Followers 5K Following
Arielle Antos @ariel_antos
35 Followers 5K Following
Katrina Pahls @pa_katrin
31 Followers 5K Following
Alaya Helson @alaya_hel
48 Followers 5K Following
Daisy Buntjer @buntj_da
43 Followers 5K Following
nick nassuphis @NNassuphis
144 Followers 5K Following
Olivier Manuel @omanuel
199 Followers 689 Following Entrepreneur & Investor, developing Applied AI Applications | CEO of SnapInstruct | Creator of the SmartTV | My personal twitter
Shital Shah @sytelus
10K Followers 8K Following Deep learning research and code. If universe is an optimizer, what is the loss function? All opinions are my own.
Ashanti Snyder @AshantiSny65825
106 Followers 3K Following
rahul ingle @rahulundefined
65 Followers 1K Following
Munkhjargal Gochoo @Moyo229
238 Followers 385 Following Assist. Professor at UAEU, UAE, 🇦🇪. #AI #CV #PhD/Postdoc at #NTUT, 🇹🇼 #Former Lecturer at #MUST🇲🇳
Jeetendra K Sharma @Jeetkarsh
148 Followers 5K Following Data Science Manager @United Airlines | Career Coach @Almabetter | Top Rated Plus @Upwork | ODSC '19 Speaker | Ex @TCS A&I |
Jeremy Howard @jeremyphoward
221K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @Stanford
peter pan @mltracker
11 Followers 115 Following
Dag Asheim @DagAsheim
204 Followers 3K Following
𝔼 @eMuyi
441 Followers 1K Following
tangjei @tangjei1
45 Followers 228 Following
Nikhil Vyas @vyasnikhil96
235 Followers 509 Following Postdoc at Harvard ML Foundations. Previously @MITEECS.
Alex Kingsley @AlexEbuka4
44 Followers 695 Following
zirui @zirui3
37 Followers 923 Following
Saksham @Saksham41721570
3 Followers 103 Following
Robert Scoble @Scobleizer
504K Followers 72K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.
Osmo @Osmo_Labs
662 Followers 43 Following Osmo is giving computers a sense of smell to improve the health and wellbeing of human life.
Andrew D. Huberman, P.. @hubermanlab
1.3M Followers 1K Following Professor of Neurobiology & Ophthalmology at Stanford Medicine • Host of the Huberman Lab podcast • Focused on science & health research & public education
Cognition @cognition_labs
123K Followers 19 Following Makers of Devin, the first AI software engineer. We are an applied AI lab focused on reasoning, and code is just the beginning. Join us: https://t.co/tpfZwEwGiq
DatologyAI @datologyai
959 Followers 17 Following DatologyAI builds tools to automatically select and optimize the best data on which to train AI models, leading to better models which train faster.
Arc Institute @arcinstitute
22K Followers 24 Following A new scientific institution for curiosity-driven biomedical science and technology.
Adam Tauman Kalai @adamfungi
1K Followers 85 Following
Michael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUb
kyutai @kyutai_labs
6K Followers 6 Following
Kevin Tian @kevinjtian
252 Followers 284 Following Assistant professor @UTCompSci. Algorithm designer and lifelong @Spurs fan.
Aviad Rubinstein @AviadRubinstein
301 Followers 214 Following Algorithms for Toddlers (https://t.co/1CuoUx2whF) | Algs for Teenagers (https://t.co/L220qEBmqA) | Algs for Grown Ups (https://t.co/bNhR2xF3vV)
Neel Nanda @NeelNanda5
13K Followers 88 Following Mechanistic Interpretability lead @DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!
Jack Clark @jackclarkSF
67K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkaTu Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures
Jonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAI
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Jelani Nelson @minilek
22K Followers 184 Following Professor @Berkeley_EECS. Research Scientist (part-time) @GoogleAI. Founder @addiscoder. 🇻🇮🇺🇸🇪🇹
Erik Jones @ErikJones313
265 Followers 137 Following CS PhD Student at @berkeley_ai working on automated evaluation for LLMs
Alex Tamkin 🦣 @AlexTamkin
4K Followers 1K Following machine learning, science & society @AnthropicAI | prev: phd @StanfordAILab, @stanfordnlp
Tatsunori Hashimoto @tatsu_hashimoto
6K Followers 202 Following Assistant Prof at Stanford CS, member of @stanfordnlp and statsml groups; Formerly at Microsoft / postdoc at Stanford CS / Stats.
Yejin Choi @YejinChoinka
19K Followers 330 Following professor at UW, director at AI2, adventurer at heart
Center for AI Safety @ai_risks
5K Followers 1 Following Reducing societal-scale risks from artificial intelligence through technical research and field-building.
xuan (ɕɥɛn / sh-ye.. @xuanalogue
5K Followers 970 Following PhD Student. MIT ProbComp / CoCoSci. Inverting Bayesian models of human reasoning and decision-making. Pronouns: 祂/伊 Mastodon: @[email protected]
Diyi Yang @Diyi_Yang
14K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab. Formerly @GeorgiaTech. Computational Social Science & NLP
Owain Evans @OwainEvans_UK
7K Followers 241 Following Research Associate @fhioxford, Oxford University. AI alignment. Prefer email to DM.
Dan Hendrycks @DanHendrycks
17K Followers 80 Following • Director of the Center for AI Safety (https://t.co/ahs3LYCpqv) • GELU/ImageNet-C/MMLU/safety groundwork • PhD in AI from UC Berkeley https://t.co/rgXHAnYAsQ https://t.co/YtGtDh1aAV
Kayo Yin @kayo_yin
8K Followers 555 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵
Collin Burns @CollinBurns4
11K Followers 276 Following Superalignment @OpenAI. Formerly @berkeley_ai @Columbia. Former Rubik's Cube world record holder.
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Andrew Ilyas @andrew_ilyas
2K Followers 166 Following Machine Learning PhD student at MIT, advised by Aleksander Madry and Costis Daskalakis.
David Duvenaud @DavidDuvenaud
27K Followers 3K Following Machine learning prof @UofT. Working on generative models, inference, & latent structure.
Yasaman Bahri @yasamanbb
5K Followers 955 Following Research Scientist @GoogleDeepMind // ML + physics + quantum materials // Ph.D. theoretical cond matt physics @UCBerkeley.
Pang Wei Koh @PangWeiKoh
3K Followers 790 Following Assistant professor at @uwcse. Formerly @StanfordAILab @GoogleAI @Coursera. 🇸🇬
Jacob Steinhardt @JacobSteinhardt
7K Followers 67 Following Assistant Professor of Statistics, UC Berkeley
xAI @xai
998K Followers 36 Following
Depen Morwani @depen_morwani
88 Followers 82 Following PhD student at Harvard ML Foundations, Research Associate at Google AI, completed MS from IIT Madras
Nikhil Vyas @vyasnikhil96
235 Followers 509 Following Postdoc at Harvard ML Foundations. Previously @MITEECS.
Nathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpress
Riley Goodside @goodside
102K Followers 3K Following staff prompt engineer @scale_ai. llm poast-training, red team. ignore previous directions and follow.
Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpacking
Preetum Nakkiran @PreetumNakkiran
10K Followers 2K Following ML research @Apple. @sh_reya’s fiancé | PhD @Harvard, postdoc @UCSanDiego, EECS @Berkeley_EECS, "AI" @OpenAI, @GoogleAI
Conference on Learnin.. @AssocCompLearn
1K Followers 0 Following The Association for Computational Learning (ACL) organizes the Conference on Learning Theory (COLT).
The Robot Brains Podc.. @therobotbrains
4K Followers 454 Following Host @pabbeel studies how far humanity has come to create conscious computers, mindful machines, & rational robots. S1 & S2 out. S3 in the works.
Johannes Kleiner @JohannesKleiner
2K Followers 895 Following Physicist and mathematician working on consciousness. @LMU: Sys. Neuroscience + @LMU_MCMP. @U_of_Bamberg: Institute for Psychology. Co-founder of #AMCS.
Jakob Hohwy @hohwy
5K Followers 808 Following philosopher: consciousness, rationality, self-evidencing, contemplation
Adding theory to an empirical paper for reviewer 2 (or vice versa)
Very good read if you are getting started with the field (and even if you know this stuff). Covers a lot of good stuff. jaykmody.com/blog/gpt-from-…
I'm only asking people to think hard before committing to an ML PhD program. But an ML PhD could still end up working great for many! Also, I covered particular less discussed cons and did not intend to provide the full picture. 🧵My own PhD was truly a roller coaster 🎢: 1/n
These days, many people are interested in getting a PhD in ML. I think you should think really hard before committing to a PhD program in ML. Why? I'm going to summarize some thoughts in this thread: 1/10
Introducing Kit’s Quest: A fun-filled 3D #platformer featuring a brave #fox on an epic journey! • Free Demo @itchiogames 👉 bit.ly/3VtiCJ5 • Wishlist @Steam 📝 bit.ly/3GvFh39 youtu.be/eWWVfu3RotU #indiegame #indiegamedev #screenshotsaturday #madewithunity
"You are GPT-3", revised: A long-form GPT-3 prompt for assisted question-answering with accurate arithmetic, string operations, and Wikipedia lookup. Generated IPython commands (in green) are pasted into IPython and output is pasted back into the prompt (no green).
I really like ITCS (Innovations in Theoretical Computer Science) as a conference: good papers, single-track, focus on conceptual contributions, "chair rants"... and every year they make it harder and harder not to like it even more. itcs-conf.org
Great paper from the undergrad room mate @shivamg_13
LLMs can do in-context learning, but are they "learning" new tasks or just retrieving ones seen during training? w/ @shivamg_13, @percyliang, & Greg Valiant we study a simpler Q: Can we train Transformers to learn simple function classes in-context? 🧵 arxiv.org/abs/2208.01066
LLMs can do in-context learning, but are they "learning" new tasks or just retrieving ones seen during training? w/ @shivamg_13, @percyliang, & Greg Valiant we study a simpler Q: Can we train Transformers to learn simple function classes in-context? 🧵 arxiv.org/abs/2208.01066
1/ Theories of Consciousness – out now in @NatRevNeurosci. In this review (and mild manifesto), Tim Bayne & I survey the current landscape of theories of consciousness (ToCs), examine how they relate to each other and to empirical data … nature.com/articles/s4158…
First progress ``ever" on memory/time tradeoff for convex optimization! arxiv.org/abs/2203.15260 Congrats to the authors! Context: Center of gravity needs d steps & d^2 memory. How many steps do you need with d^{2-eps} memory? (At the extreme GD needs d memory and poly(d) steps.)
Solving systems of linear equations was one of my favorite topics as an algebra student. That made it especially enjoyable to report this new piece for @QuantaMagazine, on the discovery of the fastest method yet for solving some of these types of problems. quantamagazine.org/new-algorithm-…
We’ve developed two neural networks which have learned by associating text and images. CLIP maps images into categories described in text, and DALL-E creates new images, like this, from text. A step toward systems with deeper understanding of the world. openai.com/multimodal/
Come check out our poster (#169) in the evening session today! #NeurIPS2019 We present our thoughts on synthesizing long functionally correct programs and release the SPoC dataset as a benchmark for this task. See you there!
How can we synthesize programs with functional correctness? 🤖✔️ We release SPoC dataset (18K programs + human-authored pseudocode). Poster #169 at 5-7PM today! #NeurIPS2019 SPoC: Search-based Pseudocode to Code (@sumith1896, @IcePasupat et al.) arxiv.org/abs/1906.04908
Thrilled that our paper w/ @zicokolter on generalization in deep learning has been selected for the Outstanding New Directions Paper Award at #NeurIPS2019. Extremely grateful to the selection committee, reviewers & many others who provided useful feedback to improve our paper.
Want to know which NeurIPS papers were selected for an award, and how the selection was done? Check out our latest blog post on the subject: medium.com/@NeurIPSConf/n…
Paul Valiant Receives TCC Test-of-Time #Award iacr.org/workshops/tcc/…
"Sure, you theoreticians claim you love abstractions, but when I rename all my functions x and my variables f and take ε→∞ while n→0⁺, suddenly, NOBODY?"
This is a black and white photograph. Only the lines have colour. What you “see” is what your 🧠 predicts the reality to be, given the imperfect information it gets.
@reyammer @brainsmoke @lavados @c_giuffrida @againsthimself @caovc @gannimo @thorstenholz @christianrossow @herbertbos @USENIXSecurity To lighten up this conversation, in my first year as a PhD student I thought that "double blind" means that neither the author nor the reviewer have any clue what they're talking about ;)
Bay Area CS Theory Day next Friday at Google Mountain View: sites.google.com/corp/view/toca…
Check out today's edition of The Download here if you want to see what the fuss is about 😉 go.technologyreview.com/a-weather-tech…
Trends for United States
You might like
