Honghua Zhang @HonghuaZhang2
Ph.D. student at UCLA StarAI Lab web.cs.ucla.edu/~hzhang19/ Joined April 2020-
Tweets36
-
Followers283
-
Following114
-
Likes99
🚨LLM RESEARCHERS🚨Want a free boost in speed and memory efficiency for your HuggingFace🤗LLM with ZERO degradation in generation quality? Introducing Prepacking, a simple method to obtain up to 6x speedup and 16x memory efficiency gains in prefilling prompts of varying lengths.…
📢Please join me in congratulating Harold Li @LiLiunian for passing his Ph.D. defense today🎉 Harold has accomplished remarkable work and has been a pioneer in vision-language foundation models. 🧵 1/
Pretraining without Attention (arxiv.org/abs/2212.10544) - BiGS is alternative to BERT trained on up to 4096 tokens. Attention can be overkill. Below shows *every* word-word interaction for every sentence over 23 layers of BiGS (no heads, no n^2).
🚨Novel Generative Model:MoAT🚨 🤔Is it possible to learn a compact mixture over all possible (exponentially many) tree-shaped Markov Random Fields? Yes, MoATs can!😱 🧐But can you do it in a way that allows for polynomial time exact likelihood arxiv.org/abs/2302.14202…
🎉🎉Oral at #NeurIPS2022 !🎉🎉 arxiv.org/abs/2205.13554 Masked models (MAEs, MLMs) are great for representation learning, but did you know they are secretly tractable probabilistic models? By unmasking one pixel/token at a time (chain rule), they give SOTA marginal likelihoods!
Happy to share our work on Controllable Text Generation with NeurAlly-Decomposed Oracle (NADO) accepted at #Neurips2022! Looks like our model is excited about NeurIPS as much as we do. See more in arxiv.org/abs/2205.14219
Do models know bride is in white in Americans wedding while bride usually wears in red in traditional Indian weddings? We design a brand new geo-diverse commonsense probing benchmark **GeoMLAMA** to evaluate model’s geo-diversity. 1/N Paper: wadeyin9712.github.io/files/emnlp202…
antonio vergari 💥 .. @tetraduzione
4K Followers 1K Following human being | associate prof in #ML #AI @ancAtEd | PI of #APRIL https://t.co/7uTqRZtmEd | #probabilistic #models #tractable #generative #neuro #symbolic |Guy Van den Broeck @guyvdb
4K Followers 2K Following Associate Professor and Samueli Fellow at UCLA @UCLAComSci; Scientist at @RelationalAI; working on Artificial IntelligenceKristian Kersting @kerstingAIML
5K Followers 2K Following #AI prof @TUDarmstadt, co-director @Hessian_AI, @DFKI, @RealAAAI Councilor, @vision_claire, @ELLISforEurope, AI Columnist @WELTAMSONNTAGKarush Suri @karush_
441 Followers 668 Following Meta Learner @Theteamatx in @GoogleAI swimmer & comic fan Past @borealisai @eceuoftAnalytics Camp @AnalyticsCamp
417 Followers 1K Following Data stories: Textual and data analytics, generative AI, Language Models & LLM, Natural Language Processing, fun programming and machine learning projectsHaoyi Qiu @HaoyiQiu
443 Followers 559 Following First year PhD student @UCLA 💙 BS in CS&Math @UMich〽️ #NLP 🌷Xiao Liu @xxxxiaol
158 Followers 233 Following PhD student at PKU #NLProc | Prev Visiting Researcher at UCLAAndreas Grivas @andreasgrv
375 Followers 551 Following PhD Candidate in Natural Language Processing at the University of Edinburgh.Kaixuan Ji @Kaixuan_Ji_19
444 Followers 881 Following Ph.D. student in CS UCLA, B.E. from Tsinghua Uiversity. Interested in machine learning, especially RL Theory and LLM.@Vicky Li @vickyli_li
66 Followers 427 Following HR @huawei. I'm looking for upcoming or graduated PhD students who focus on cybersecurity, privacy protection, cryptography, system security, etc.Cheeze-ai @IamChaiM1234
1 Followers 471 FollowingSalauddin Tapu @salauddin_tapu
42 Followers 583 Following Junior Machine Learning Engineer at Anwar Enterprise Systems LimitedChuck Yang @chiehwenyang
440 Followers 4K Following Node.js and Golang Evangelist, and Web3 Adventurer.飞翔的八戒 @ko82777867
2 Followers 28 FollowingTasksWithCode @TasksWithCode
489 Followers 3K Following We spotlight ML researchers & practitioners. High (S) fact: ~50% code contributors to ML paper implementations are practitioners collaborating with researchersluisemillerin @luisemillerin13
7 Followers 286 FollowingAileen @vigap1972
26 Followers 540 Following As an enthusiastic and motivated cybersecurity and networking professional, I am committed to advancing my career and making a significant impact in the industrYixin Wan @yixin_wan_
1K Followers 892 Following PhD student @UCLAComSci | Trustworthy Generative Models | Previously @AmazonScience, @MSFTResearch AsiaYu (Bryan) Zhou @yu_bryan_zhou
483 Followers 712 Following Incoming PhD @uclanlp, currently @StanfordSVLMingyu Derek MA @mingyu_ma
316 Followers 746 Following PhD student @UCLA; Working on #NLProc; he/his/himHeyang Zhao @HeyangZhao
334 Followers 727 Following PhD @UCLA, || Previously undergrad at IIIS, @Tsinghua_UniJunkai Zhang @JunkaiZZ
437 Followers 1K Following CS Ph.D. student @UCLA | Machine Learning, Generative Model, AI for Science | Previous Mathematics B.S. @TsinghuaZixiang Chen @_zxchen_
989 Followers 2K Following Ph.D. student in CS @UCLA. 📚 B.S. from Tsinghua Univ. 🔍 Interested in Representation Learning, Generative Model & Reinforcement Learning.djinnome @djinnome
310 Followers 3K Following I am a computational biologist applying causal AI to develop multi-scale scientific simulations that learn from data to answer prognostic and diagnostic queriesnaveen ark @nvnark
220 Followers 4K FollowingCasey @thezahima
452 Followers 838 Following quivering alien chrysalis - https://t.co/mhZZLjuHH4 - https://t.co/pk8aG1MUMUSoftware Dev @swdevservice
359 Followers 2K Following I build/support SaaS w/ 300M users. Observability, identity, privacy. Interests: AI, personal finance, society. Solved my RSI/back pain. español 日本語 e/💻tu02 @_tu02_
25 Followers 239 FollowingJPT4 @flankbruno
127 Followers 423 Following GP somewhere with general interest in public equities, macro and markets.feature345 @feature345
0 Followers 976 FollowingHimanshu @Himansh37886383
164 Followers 3K FollowingKibtia Chowdhury @kibtiachowdhury
0 Followers 41 FollowingMax @maxzpchen
204 Followers 2K Following Father, Investment Partner @factorialfunds; Love Tech, Sociology, Music, Photography;D @dylan_works_
191 Followers 788 FollowingChulin Xie @ChulinXie
627 Followers 661 Following CS PhD student at UIUC and student researcher @GoogleAI; Ex research intern @MSFTResearch @NvidiaAIArman Adibi @AdibiArman
490 Followers 2K Following Postdoc @Princeton | Ph.D. from @Penn, @WarrenCntrPenn | Studying machine learning and optimization.Kevin a. Wang @often_wang
388 Followers 228 Following computer science beep boop phd at brown @BrownCSDept games / reasoningHarit Vishwakarma @harit_v
317 Followers 1K Following PhD Student at @WisconsinCS , prev. @iiscbangalore, @IBMResearch Interested in machine learning, statistics and applications.سروش @ADHD_AI
49 Followers 1K Following ML researcher with a little bit of ADHD. Trying to escape from local minimaPo-Nien Kung @P_N_Kung
135 Followers 118 Following Ph.D. Student @ UCLA | Natural Language Processing & Machine LearningXuejie Liu @liebenxj
4 Followers 17 FollowingRena Zuo @RenaZuo1
0 Followers 34 FollowingLiu Zixi @LiuZixi9
5 Followers 146 FollowingKushal R. Bhandari @kushalrbhandari
131 Followers 611 Following Graduate Student @rpi | Graph ML | Complex Networks | Reinforcement Learning | Multi Agent RL Summer Researcher @ibm | NLP | Constrained Text Generation | LLMsYihe Deng @Yihe__Deng
2K Followers 1K Following CS PhD student @UCLA | Prev. Applied Scientist Intern @AWS | LLM, Multi-modal learningantonio vergari 💥 .. @tetraduzione
4K Followers 1K Following human being | associate prof in #ML #AI @ancAtEd | PI of #APRIL https://t.co/7uTqRZtmEd | #probabilistic #models #tractable #generative #neuro #symbolic |Guy Van den Broeck @guyvdb
4K Followers 2K Following Associate Professor and Samueli Fellow at UCLA @UCLAComSci; Scientist at @RelationalAI; working on Artificial IntelligenceKristian Kersting @kerstingAIML
5K Followers 2K Following #AI prof @TUDarmstadt, co-director @Hessian_AI, @DFKI, @RealAAAI Councilor, @vision_claire, @ELLISforEurope, AI Columnist @WELTAMSONNTAGJacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwHunter Lang @hunterjlang
260 Followers 248 Following phd student at @MIT_CSAIL working in self/weak supervision, nlp with @David_Sontag. he/himAkari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Haoyi Qiu @HaoyiQiu
443 Followers 559 Following First year PhD student @UCLA 💙 BS in CS&Math @UMich〽️ #NLP 🌷Xiao Liu @xxxxiaol
158 Followers 233 Following PhD student at PKU #NLProc | Prev Visiting Researcher at UCLAZixiang Chen @_zxchen_
989 Followers 2K Following Ph.D. student in CS @UCLA. 📚 B.S. from Tsinghua Univ. 🔍 Interested in Representation Learning, Generative Model & Reinforcement Learning.Junkai Zhang @JunkaiZZ
437 Followers 1K Following CS Ph.D. student @UCLA | Machine Learning, Generative Model, AI for Science | Previous Mathematics B.S. @TsinghuaHeyang Zhao @HeyangZhao
334 Followers 727 Following PhD @UCLA, || Previously undergrad at IIIS, @Tsinghua_UniMingyu Derek MA @mingyu_ma
316 Followers 746 Following PhD student @UCLA; Working on #NLProc; he/his/himYu (Bryan) Zhou @yu_bryan_zhou
483 Followers 712 Following Incoming PhD @uclanlp, currently @StanfordSVLYixin Wan @yixin_wan_
1K Followers 892 Following PhD student @UCLAComSci | Trustworthy Generative Models | Previously @AmazonScience, @MSFTResearch AsiaRémi 〰️ @remilouf
6K Followers 1K Following LLMs & structured generation @dottxtai. @OutlinesOSS 〰️ . Alumni @ENS_ULM & @UniOfOxford. I wander.Arman Adibi @AdibiArman
490 Followers 2K Following Postdoc @Princeton | Ph.D. from @Penn, @WarrenCntrPenn | Studying machine learning and optimization.Harit Vishwakarma @harit_v
317 Followers 1K Following PhD Student at @WisconsinCS , prev. @iiscbangalore, @IBMResearch Interested in machine learning, statistics and applications.Chulin Xie @ChulinXie
627 Followers 661 Following CS PhD student at UIUC and student researcher @GoogleAI; Ex research intern @MSFTResearch @NvidiaAIKevin a. Wang @often_wang
388 Followers 228 Following computer science beep boop phd at brown @BrownCSDept games / reasoningPo-Nien Kung @P_N_Kung
135 Followers 118 Following Ph.D. Student @ UCLA | Natural Language Processing & Machine LearningXuejie Liu @liebenxj
4 Followers 17 FollowingYihe Deng @Yihe__Deng
2K Followers 1K Following CS PhD student @UCLA | Prev. Applied Scientist Intern @AWS | LLM, Multi-modal learningFan Yin @FanYin63689862
198 Followers 204 Following PhD candidate at UCLA-NLP | former intern at Salesforce Research, Amazon AWS | Robustness/Reliability/Interpretability in NLPSiyan Zhao @siyan_zhao
780 Followers 488 Following CS PhD student @UCLA | Interested in decision making, LLMs, generative models | Bachelors @UofT EngSciSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzArthur @theta_x
32 Followers 60 FollowingWilliam Cao @themehguy
25 Followers 131 FollowingDiyi Yang @Diyi_Yang
14K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab. Formerly @GeorgiaTech. Computational Social Science & NLPRujun Han @HanRujun
158 Followers 184 Following Applied Scientist @AWS AI Labs working on open-domain search + question-answering. CS Ph.D. from @USC_ISI. Former research analyst @federalreserve.Songlin Yang @SonglinYang4
2K Followers 2K Following PhD student @MIT_CSAIL. Prev. @ShanghaiTechUni @SUSTechSZ. Working on scalable and principled methods in #ML & #NLProc. INTP | 5w4 | sx/sp | she/herTung Nguyen @tungnd_13
1K Followers 821 Following Ph.D. Student in CS at UCLA. Working on Sequence Modeling and Decision making.Yufei Tian @yufei_t
565 Followers 539 Following CS PhD student @UCLA. Working on NLP, machine reasoning, creative/controllable NLG, commonsense, LLM eval. Intern @ai2_mosaic, @Amazon, undergrad @Tsinghua_UniEleonora Giunchiglia @e_giunchiglia
473 Followers 475 Following DPhil student at University of Oxford, Intelligent Systems Group. @UniofOxford @KebleOxfordEmile van Krieken @EmilevanKrieken
2K Followers 1K Following Postdoc @ University of Edinburgh | Neurosymbolic Machine LearningVolodymyr Kuleshov �.. @volokuleshov
8K Followers 998 Following AI Researcher. Prof @Cornell & @Cornell_Tech. Co-Founder @afreshai. PhD @Stanford.Ryan Tjoa @ryantjoa
27 Followers 95 FollowingBennet Wittelsbach @bennet_wi
99 Followers 315 Following CS @TUDarmstadt. ML for Healthcare @Crdsio. I like probabilistic circuitsSIDI LU @sidilu_pluslab
142 Followers 130 Following Just a dumb bunny. Ph.D. Candidate @ UCLA Pluslab NLG/Generative Models/ML/RLcats with jobs 🛠 @CatWorkers
2.2M Followers 172 Following Good cats being workers • Unionized • Mascot @JobertTheCat • Takedown/credit/submissions: [email protected]ACLRollingReview @ReviewAcl
5K Followers 62 Following ACL Rolling Review. Deadlines 10/15, 12/15, 2/15, 4/15 Tweets by @mayhewsw, @gneubig, @karmake2, @zeeraktalat, & othersNASA Artemis @NASAArtemis
755K Followers 112 Following With #Artemis, @NASA will land the first woman and first person of color on the Moon. Take the next giant leap with us. Verification: https://t.co/T7VkNRy6Nd🚨LLM RESEARCHERS🚨Want a free boost in speed and memory efficiency for your HuggingFace🤗LLM with ZERO degradation in generation quality? Introducing Prepacking, a simple method to obtain up to 6x speedup and 16x memory efficiency gains in prefilling prompts of varying lengths.…
Harold guided me step by step when I was an undergrad and just started research. He was so nice to share his valuable research experience to junior students and introduced so many chances to help me grow up 🚀. He also taught me a lot about how to do solid research and think of…
📢Please join me in congratulating Harold Li @LiLiunian for passing his Ph.D. defense today🎉 Harold has accomplished remarkable work and has been a pioneer in vision-language foundation models. 🧵 1/
📢Please join me in congratulating Harold Li @LiLiunian for passing his Ph.D. defense today🎉 Harold has accomplished remarkable work and has been a pioneer in vision-language foundation models. 🧵 1/
Excited to share that the checkpoints are online at 🤗 HuggingFace. Feel free to check it out! SDXL-DPO: huggingface.co/mhdang/dpo-sdx… SD1.5-DPO: huggingface.co/mhdang/dpo-sd1…
Excited to announce DPO has gone multi-modal! New paper out on RLHF for text-to-image diffusion models! We obtain large-scale state of the art results with 70% win rates against Stable Diffusion XL on human evals! Deep dive below 🧵
Spent a wonderful day at the #UAI2023 Workshop on Tractable Probabilistic Modeling learning about tractable inference algorithms! Enjoyed presenting my NeurIPS paper on any-order autoregressive models, and super happy to be recognized with Best Paper Honorable Mention 🥳
🎉🎉Oral at #NeurIPS2022 !🎉🎉 arxiv.org/abs/2205.13554 Masked models (MAEs, MLMs) are great for representation learning, but did you know they are secretly tractable probabilistic models? By unmasking one pixel/token at a time (chain rule), they give SOTA marginal likelihoods!
Duality on manifolds by @ronnybergmann_ at the DP4ML workshop #ICML2023
Is likelihood the right training objective for generative models? We study normalizing flows trained using a new kind of energy-based loss which *does not require computing expensive determinants of Jacobians*. We call these energy flows. #ICML2023
.@davidweichiang from @ND_CSE presenting his latest work characterizing the expressivity of transformer encoders! (by far my favorite paper from #ICML2023) arxiv.org/abs/2301.10743
Congrats @NikilSelvam and our collaborators @sunipa17, @DanielKhashabi, @tusharkhot for winning the outstanding paper award at #ACL2023. See details of the paper 👇 x.com/kaiwei_chang/s… @uclanlp
Outstanding Papers at #ACL2023NLP. Congrats to all authors!! 2023.aclweb.org/program/best_p… 📚 Backpack Language Models 🔎 CAME: Confidence-guided Adaptive Memory Efficient Optimization 🌍 Causes and Cures for Interference in Multilingual Translation [1/n]
Thrilled to receive the Outstanding Paper Award at #ACL2023 for ‘The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks’! 🥳 Thanks to my wonderful collaborators @sunipa17 @DanielKhashabi @tusharkhot @kaiwei_chang 💛 Paper👇 x.com/nikilselvam/st…
Congrats @NikilSelvam and our collaborators @sunipa17, @DanielKhashabi, @tusharkhot for winning the outstanding paper award at #ACL2023. See details of the paper 👇 x.com/kaiwei_chang/s… @uclanlp
Excited to share our new work DesCo (arxiv.org/pdf/2306.14060…) -- an instructing object detector that takes complex language descriptions (e.g., attributes & relations). DesCo improves zero-shot detection (+9.1 APr on LVIS) and ranks 1st at the #OmniLabel Challenge of CVPR2023!
Uncertainty quantification for neural networks via Bayesian model average is compelling, but uses just a few samples in practice😥 We propose 👾CIBER, a collapsed sampler to aggregate infinite NNs via volume computations, w/ better accuracy & calibration! arxiv.org/abs/2306.09686
I got my PhD!!!! 🎉🎉🎉🎉🎉
In building TART we were inspired by many great works around understanding ICL and reasoning over / programming transformers including work from folks like @sangmichaelxie, @tsiprasd, @DimitrisPapail, @shivamg_13, and @HonghuaZhang2.
Just successfully defended my PhD! 🎓 It's been an incredible journey for the past five years. Thanks to my advisor @kaiwei_chang and the committee members. I am excited about my next chapter in NLP research. 🎉🎉🎉
Pretraining without Attention (arxiv.org/abs/2212.10544) - BiGS is alternative to BERT trained on up to 4096 tokens. Attention can be overkill. Below shows *every* word-word interaction for every sentence over 23 layers of BiGS (no heads, no n^2).
👏👏
Led by Hal Daumé III (@haldaume3), the new Institute for Trustworthy Artificial Intelligence in Law & Society (TRAILS) aims to transform AI by prioritizing ethics, human rights, and input from communities who have been previously marginalized. Read more: go.umd.edu/trailslaunch
Completely agree. This counter culture (sorry, had to pun -- lame, I know) has been going on for a few years, and it's not only annoying, but misleading about what makes progress, both on the personal level and globally on research. If anything, slow down!