Jian Zhu @lukeZhu20
Asst Prof @UBCLinguistics | PhD@Umich | Speech processing & NLP & Computational Social Science | Humble servant of two cats | Siu-mei master wannabe lingjzhu.github.io Vancouver Joined May 2019-
Tweets184
-
Followers300
-
Following662
-
Likes2K
🦅 Eagle & 🐦 Finch The RWKV v5 and v6 architecture paper is here arxiv.org/abs/2404.05892 Both of which, improve over RWKV-4, scaled up to 7.5b and 3.1b billion multilingual models respectively Open-source code, weights, and dataset Apache 2 licensed, under Linux Foundation
I have updated the OWSM-CTC model page to include examples of short-form ASR/ST, long-form ASR/ST, and CTC forced alignment (it takes a few seconds to align a 20min audio on a GPU): huggingface.co/pyf98/owsm_ctc… x.com/ArxivSound/sta…
I have updated the OWSM-CTC model page to include examples of short-form ASR/ST, long-form ASR/ST, and CTC forced alignment (it takes a few seconds to align a 20min audio on a GPU): huggingface.co/pyf98/owsm_ctc… x.com/ArxivSound/sta…
David is a great researcher and a wonderful mentor! Vote for him!
David is a great researcher and a wonderful mentor! Vote for him!
Introducing: StarCoder2 and The Stack v2 ⭐️ StarCoder2 is trained with a 16k token context and repo-level information for 4T+ tokens. All built on The Stack v2 - the largest code dataset with 900B+ tokens. All code, data and models are fully open! hf.co/bigcode/starco…
Excited to share our new applied causal machine learning book causalml-book.org is available online. Any feedback/corrections greatly appreciated!
I'm collecting data about using LLMs for NLP system development. Please fill out this short survey and RT: surveymonkey.com/r/CHK6QTP
We're hiring in Computational Linguistics! (tenure track, research stream) Deadline Dec 8th. linguistics.ubc.ca/job-opportunit…
Dear ACL community, ACL is considering multiple proposals to change its anonymity period policy. It seeks immediate feedback from the community about the proposed changes. Please add your voice until Friday, September 22nd (AOE): aclweb.org/portal/content… #NLProc
Jobs: Linguistics - Tenure-track Position, University of Michigan: The Department of Linguistics at the University of Michigan, Ann Arbor, invites applications for a new full-time, tenure-track position, beginning August 26, 2024. Qualifications: We seek… dlvr.it/SvgX7k
Hi there, I've been using Matplotlib for 8+ years and I still google how to do everything except plt.plot()
RWKV: Reinventing RNNs for the Transformer Era propose a novel model architecture, Receptance Weighted Key Value (RWKV), that combines the efficient parallelizable training of Transformers with the efficient inference of RNNs. Our approach leverages a linear attention mechanism…
MMS: Massively Multilingual Speech. - Can do speech2text and text speech in 1100 languages. - Can recognize 4000 spoken languages. - Code and models available under the CC-BY-NC 4.0 license. - half the word error rate of Whisper. Code+Models: github.com/facebookresear… Paper:…
Pengi: An Audio Language Model for Audio Tasks introduce Pengi, a novel Audio Language Model that leverages Transfer Learning by framing all audio tasks as text-generation tasks. It takes as input, an audio recording, and text, and generates free-form text as output. The input…
There is an incredible Chrome extension by @JiaLi52524397 that let's you use StarCoder in Jupyter Notebooks. It uses previous cells and their outputs to make predictions. As such it can infer your DataFrames columns from the cell outputs or interpret your markdown text!
There is an incredible Chrome extension by @JiaLi52524397 that let's you use StarCoder in Jupyter Notebooks. It uses previous cells and their outputs to make predictions. As such it can infer your DataFrames columns from the cell outputs or interpret your markdown text! https://t.co/DpGvvX8ktc
Really excited to see StarCoder released after months of effort from across the world! Proud to be part of this huge open-source collaboration.
Really excited to see StarCoder released after months of effort from across the world! Proud to be part of this huge open-source collaboration.
You can find all the links here: huggingface.co/bigcode
well. @UMich has officially docked all pay but $100 for april from its grad workers, putting many of us in a position of dangerous financial precarity. friends/allies, please consider donating to @geo3550 strike fund at givebutter.com/GEOStrikeFund. we need all the help we can get ✊
Our department has started to maintain an "awesome computational social science" #GitHub list. To make it truly awesome, we are now looking for contributions from the community. So spread the word and feel free to add any awesome material you are aware of github.com/gesiscss/aweso…
As an audio researcher, here's everything you need to know about the 98-page technical report from @OpenAI on GPT-4 (1/n)
The Fruehwald @JoFrhwld
8K Followers 2K Following I'm a linguist. Not a real sir. And I enjoy knitting. Asst Prof @ University of Kentucky™️ he/him. mastodon: @[email protected]Julia Mendelsohn @jmendelsohn2
1K Followers 812 Following PhD candidate @UMSI & @Google PhD fellow. NLP, computational social science, linguistics, polcomm; past CS + Lx @StanfordRasmus Puggaard-Rode @RPuggaardRode
1K Followers 1K Following Postdoc at IPS in Spoken Language Processing group @LMU_Muenchen, lab phon, corpus phon, usage-based linguistics, rstatsWenhu Chen @WenhuChen
11K Followers 520 Following AI researcher @UWaterloo @GoogleAI @VectorInst. Interested in natural language processing, diffusion models. I direct TIGER-Lab at UWaterloo.David Mortensen @dmort27
2K Followers 2K Following I make colorless green GPUs sleep brriously @LTIatCMU. phonology • morphology • language change • #NLProc data resources.Zhāng, Miǎo 张淼 @Miao_Zhang_dr
762 Followers 723 Following Post-doc at @cl_uzh doing corpus phonetics. SW Mandarin, Changsha Xiang, Mandarin, Japanese, English, Korean, German, Ikema. He/him. https://t.co/3GwrjPl0v3Justin T. Craft @justincraft
540 Followers 1K Following I tweet about language and sports and spend a lot of time fermenting now. #COYMO🌳 #eisern 🔴⚪️ he/him/his @UCLA and @UMich alum. https://t.co/c6eauRFzrImatt @m_faytak
650 Followers 282 Following Also faytak on 🟦 🐘 / phonetics, fieldwork, languages of Cameroon & China / he~they / BLMDr. Rachel Elizabeth .. @rachelawiselure
2K Followers 853 Following full & freed with love | Assistant Professor @uoregon | I’m here for Black women, African American English, sociolinguistics, & mentorship. I've moved to bsky ✌Alexander Jura @alexand_jur
49 Followers 5K FollowingMenaal Arguillo @MenArguil
67 Followers 5K FollowingLudivina Dorman @DormLudivin
80 Followers 5K Followinglooking forward to un.. @languistical
167 Followers 388 Following lang & cog, small ANNs, exemplar shit, bass, pool, unions, acab, protect trans kids, he/himDaniela Labrec @DanielaLabr
92 Followers 5K FollowingMarget Manary @marget99119
48 Followers 5K FollowingBianca Mencer @bian_menc
78 Followers 5K FollowingCaitlyn Imbimbo @ImbimCait
65 Followers 5K FollowingSusieMartin @0A75R5X91jVAf
14 Followers 2K FollowingKatheryn Graybeal @graybe_kathery
46 Followers 5K FollowingRosa Zhou @qiaoyu_rosa
195 Followers 256 Following PhD @ChicagoHAI @UChicagoCS. NLP and machine reasoning.Elidia Jarosz @ElidiaJaro11274
64 Followers 5K FollowingIsabel Chow @IsabelChow59181
95 Followers 5K FollowingDong Zhang @dongzha35524835
86 Followers 263 Following Speech Language Models | MS Student at FudanNLP Lab @FudanUniv | Looking for Ph.D. in 2025 fallZhang Ruichong @ZhangRuichong
26 Followers 92 FollowingWei-Rui Chen @WeiRuiChen01
47 Followers 92 Following PhD candidate and NLP researcher focusing on Multilingual NLP @UBC | @UBC_NLP | @UBCLangScisTomorrowMan.coto 💙.. @70m0rr0w_m4n
404 Followers 5K Following My name is Matt Dondo, and I'm #TheManWhosOuttaTime. How will 2023 go? Will I succeed in bringing Mr. Soto online? Will Chicago be saved? #gottatunein #bitcoinZixuan Yi @ZixuanYI_
201 Followers 430 Following PhD student @TerrierTeam, University of Glasgow. Previous algorithm engineer @ Bosch GmbH Views my own. He/Him.Kai-Wei Chang @KaiWeiChang5
76 Followers 103 Following 3rd Ph.D. student at National Taiwan University. Currently working on prompting speech LLMs. SpeechPrompt / SpeechGen. Ex-intern at @Meta @RealityLabs.Hannah King @hannahhmking
366 Followers 455 Following Associate professor (Maître de conférences) at @univ_paris_cite | phonetics, phonology, speech articulation | lover of plants, knitting, indie rock & soulBryony Rumore @rumo_bryo
44 Followers 5K FollowingDavid Fields @DavFields
1K Followers 2K Following Founder @afterparty AI | Strong Beliefs, Loosely Held | ex @disney, @Harvard econ/incentive designUrsula Kier @KierUrsu
34 Followers 5K FollowingEulah Armbruster @Armbruster53486
83 Followers 5K FollowingMindy Mandolfo @MandolfoMi30852
97 Followers 5K FollowingAria-grace Dirico @DiricoAria30318
82 Followers 5K FollowingLondyn Ilardi @IlarLondy
37 Followers 5K FollowingTawnya Molnar @TawMoln
68 Followers 5K FollowingSonja Sha @sha_sonja54967
39 Followers 5K FollowingFlorencia Generous @FlorenciGenero
57 Followers 5K FollowingClaudie Collar @ClaudieCol63809
38 Followers 5K FollowingSunny Norsworthy @NorsworthSu
54 Followers 5K FollowingSalina Drummey @DrummeSali
54 Followers 5K FollowingStefania Degaetano-Or.. @OrtliebStefania
303 Followers 358 Following Assistant Professor (Akad. Rätin) @LstSaar @Saar_Uni applying ML and information theory @1102Sfb to study socio-linguistic and diachronic variationXiang Fu @thisisxfu
42 Followers 2K Following Researcher @BUSPH | @BU_CDS | Founder of @ModularNLP | Deep Learning | Data Science |Ruiyi Wang @RuiyiWang153
127 Followers 177 Following Incoming PhD @ucsd_cse | MS @LTIatCMU | BS @UMichCSE and @sjtu1896 | NLP & HCI researchZheng fu @fu10zheng
550 Followers 482 Following Sociology PhD at Columbia University. Interested in all things political. Retweet is not endorsement Mastodon handle: @[email protected]Sahithya Ravi @Sahithya_Ravi
304 Followers 499 Following PhD Student @UBC_CS | @VectorInst I @UBC_NLPMax Morrison @maxrmorrison
222 Followers 133 Following Audio + ML PhD researcher @NorthwesternU | Former research intern @AdobeResearch and @DescriptAppSamir @Samir9Sm
62 Followers 121 Following PhD student @ubc_nlp. Currently visiting @tsvetshop @uwnlp. @nserc_crsng doctoral scholar (2022-2025). Previously intern @ NVIDIA, Amazon ResearchRohan Kumar Das @imrohankumardas
34 Followers 78 Following Researcher in Speech/Audio processing and their applications | Explorer | TravelerNayan Saxena @SaxenaNayan
2K Followers 2K Following Brought artificial intelligence to @RBC, @Glowforge, @Wombo, @Bell & beyond.Jordi Pons @jordiponsdotme
4K Followers 726 Following Music, audio, and deep learning research at @StabilityAI ~ Building bridges between audio signal processing wisdom and deep learning ~ Prev: @Dolby & @MTG_upf.Yifan Peng @pengyf21
353 Followers 207 Following Speech Foundation Models | 4th-year PhD student @CMU_ECE @WavLab | Ex-intern @MetaAI @asapp | B.E. @Tsinghua_Uni_C_rush @Crush533439
0 Followers 114 FollowingTal Linzen @tallinzen
16K Followers 894 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzAI at Meta @AIatMeta
533K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.Yi Tay @YiTayML
29K Followers 97 Following chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼Julia Mendelsohn @jmendelsohn2
1K Followers 812 Following PhD candidate @UMSI & @Google PhD fellow. NLP, computational social science, linguistics, polcomm; past CS + Lx @StanfordYoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCRasmus Puggaard-Rode @RPuggaardRode
1K Followers 1K Following Postdoc at IPS in Spoken Language Processing group @LMU_Muenchen, lab phon, corpus phon, usage-based linguistics, rstatsNathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.socialRada Mihalcea @radamihalcea
9K Followers 600 Following Janice M. Jenkins Collegiate Professor of Computer Science at U. Michigan, Director @Michigan_AI Lab, Researcher #NLProc, #AI.Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.Wenhu Chen @WenhuChen
11K Followers 520 Following AI researcher @UWaterloo @GoogleAI @VectorInst. Interested in natural language processing, diffusion models. I direct TIGER-Lab at UWaterloo.Timo Roettger @TimoRoettger
2K Followers 844 Following Cognitive scientist / Linguist (Full Professor at @UniOslo) Find me on BlueSky @timoroettger.bsky.social #DataViz #PresentationDesign #SciCommXin Eric Wang @xwang_lk
7K Followers 1K Following Multimodal and Embodied AI Researcher / Professor @UCSC. Director of https://t.co/Y4swOBag21. AI for Humanity in the long run. he/himFrançois Chollet @fchollet
470K Followers 769 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Sebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxDavid Mortensen @dmort27
2K Followers 2K Following I make colorless green GPUs sleep brriously @LTIatCMU. phonology • morphology • language change • #NLProc data resources.mike cook @mtrc
11K Followers 791 Following AI/Creativity/Generative Systems Researcher and Game Designer. Senior Lecturer @ KCL. 🗡🖌 @knifeandbrush 🤖🎮 @gamesbypuck @angelinasgames | he/theyAIIDE Conference @AIIDEconference
4K Followers 167 Following Artificial Intelligence and Interactive Digital Entertainment Conference.Rosa Zhou @qiaoyu_rosa
195 Followers 256 Following PhD @ChicagoHAI @UChicagoCS. NLP and machine reasoning.Dong Zhang @dongzha35524835
86 Followers 263 Following Speech Language Models | MS Student at FudanNLP Lab @FudanUniv | Looking for Ph.D. in 2025 fallZhang Ruichong @ZhangRuichong
26 Followers 92 FollowingWei-Rui Chen @WeiRuiChen01
47 Followers 92 Following PhD candidate and NLP researcher focusing on Multilingual NLP @UBC | @UBC_NLP | @UBCLangScisZixuan Yi @ZixuanYI_
201 Followers 430 Following PhD student @TerrierTeam, University of Glasgow. Previous algorithm engineer @ Bosch GmbH Views my own. He/Him.ACM CHI Conference @acm_chi
17K Followers 105 Following Official account for ACM SIGCHI Conference: CHI #CHI2024 is in Honolulu, Hawai'i, USA 🌴 May 11-16 Content managed by @tknearem @XiangHCIKai-Wei Chang @KaiWeiChang5
76 Followers 103 Following 3rd Ph.D. student at National Taiwan University. Currently working on prompting speech LLMs. SpeechPrompt / SpeechGen. Ex-intern at @Meta @RealityLabs.Summer Game Fest @summergamefest
255K Followers 239 Following #SummerGameFest Live Friday, June 7th, from @youtubetheater, 2p PT / 5p ET / 9p GMT. Public tickets on sale May 7 at https://t.co/wOA7uPeKNMHannah King @hannahhmking
366 Followers 455 Following Associate professor (Maître de conférences) at @univ_paris_cite | phonetics, phonology, speech articulation | lover of plants, knitting, indie rock & soulMitacs @MitacsCanada
21K Followers 4K Following Bringing Innovation Into Reach | L’innovation à votre portéeJialin Liu @_JialinLiu
747 Followers 202 Following AI in games, evolutionary computation, optimisation and learning in uncertain contexts. Assistant Professor @SUSTech Cat loverOmar Khattab @lateinteraction
11K Followers 2K Following CS PhD candidate @StanfordNLP. 2022 Apple Scholar in AI/ML. Author of ColBERT (https://t.co/2ZtgXoa1np), DSPy (https://t.co/BH7WmMKDXR), & various retrieval & LM systems.ACM CHI PLAY @acmchiplay
3K Followers 177 Following CHI PLAY is an international conference by @SIGCHI for researchers & professionals across all areas of play, games & HCI. Oct 14-17, '24 | [email protected]ACM Interactive Media.. @ACMIMX
727 Followers 368 Following Official account for the leading conference focusing on Interactive Media Experiences. Prev. @ACMTVX & EuroITV.Game Developer @gamedevdotcom
482K Followers 27 Following Serving the video game industry through breaking news, insight on game industry trends, expert advice & resources, and more.Kosta Derpanis @CSProfKGD
48K Followers 197 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chairStefania Degaetano-Or.. @OrtliebStefania
303 Followers 358 Following Assistant Professor (Akad. Rätin) @LstSaar @Saar_Uni applying ML and information theory @1102Sfb to study socio-linguistic and diachronic variationCFI / FCI @InnovationCA
19K Followers 4K Following The Canada Foundation for Innovation funds research infrastructure. | La Fondation canadienne pour l'innovation investit dans des installations de recherche.NSERC / CRSNG @NSERC_CRSNG
92K Followers 4K Following The Natural Sciences and Engineering Research Council of Canada. En français @CRSNG_NSERC Terms of Service: https://t.co/JCzJHAStwuRuiyi Wang @RuiyiWang153
127 Followers 177 Following Incoming PhD @ucsd_cse | MS @LTIatCMU | BS @UMichCSE and @sjtu1896 | NLP & HCI researchZheng fu @fu10zheng
550 Followers 482 Following Sociology PhD at Columbia University. Interested in all things political. Retweet is not endorsement Mastodon handle: @[email protected]Hubert Siuzdak @HubertSiuzdak
100 Followers 113 Following i just keep staring at tensorboard curves | deep learning && audioSahithya Ravi @Sahithya_Ravi
304 Followers 499 Following PhD Student @UBC_CS | @VectorInst I @UBC_NLPPascale Fung @pascalefung
2K Followers 45 Following Chair Professor of ECE, Director of the Centre for AI Research (CAiRE), Hong Kong University of Science & Technology. Fellow of AAAI, ACL, IEEE, ISCA.Max Morrison @maxrmorrison
222 Followers 133 Following Audio + ML PhD researcher @NorthwesternU | Former research intern @AdobeResearch and @DescriptAppBig Data & Society @BigDataSoc
23K Followers 3K Following Open access peer-reviewed journal connecting debates on emerging Big Data practices & how they reconfigure academic, social, industry, & government relations.Samir @Samir9Sm
62 Followers 121 Following PhD student @ubc_nlp. Currently visiting @tsvetshop @uwnlp. @nserc_crsng doctoral scholar (2022-2025). Previously intern @ NVIDIA, Amazon ResearchSohee Yang @soheeyang_
1K Followers 428 Following PhD student/research scientist intern at @ucl_nlp/@GoogleDeepMind (50/50 split). Previously MS at @kaist_ai and research engineer at Naver Clova. #NLProc & MLICIDS @icids
753 Followers 177 Following ICIDS is the premier International Conference on Interactive Digital Storytelling, involving computer scientists, interactive artists and new media scholars.Philipp Schmid @_philschmid
16K Followers 653 Following Tech Lead and LLMs at @huggingface 👨🏻💻 🤗 AWS ML Hero 🦸🏻 | Cloud & ML enthusiast | 📍Nuremberg | 🇩🇪 https://t.co/l1ppq3q3hkYijia Shao @EchoShao8899
2K Followers 281 Following CS Ph.D. student @StanfordNLP. Previous: undergraduate @PKU1898.WikiResearch @WikiResearch
18K Followers 2K Following Research news on @Wikipedia @Wikidata @Wikimedia, hot off the press. Volunteer-curated by @tilmanbayer & @mad_astronaut. Read our newsletter for full coverageRohan Kumar Das @imrohankumardas
34 Followers 78 Following Researcher in Speech/Audio processing and their applications | Explorer | TravelerPieter Abbeel @pabbeel
78K Followers 435 Following Diffusion Models; Large World Model; UniSim; TRPO; SAC; Ring Attention; MAML; HER; Domain Randomization; Decision Transformer; LLM as Zero-Shot Planners; RFM-1Yujia Huang @YujiaHuangC
602 Followers 377 Following PhD student @ Caltech. Machine learning & deep learning. Generative models. Love music.Nayan Saxena @SaxenaNayan
2K Followers 2K Following Brought artificial intelligence to @RBC, @Glowforge, @Wombo, @Bell & beyond.Jordi Pons @jordiponsdotme
4K Followers 726 Following Music, audio, and deep learning research at @StabilityAI ~ Building bridges between audio signal processing wisdom and deep learning ~ Prev: @Dolby & @MTG_upf.Yifan Peng @pengyf21
353 Followers 207 Following Speech Foundation Models | 4th-year PhD student @CMU_ECE @WavLab | Ex-intern @MetaAI @asapp | B.E. @Tsinghua_UniIron Pineapple @IronPineapple_
189K Followers 576 Following youtube guy || merch: https://t.co/WBeGgGtAVvSantiago Castro @bryant1410
858 Followers 2K Following 🇺🇾 CS PhD student @UMich advised by @radamihalcea. Passionate about #NLProc and Machine Learning. Opinions are my own.Remi van Trijp @RemivanTrijp
2K Followers 1K Following On a quest for meaning and understanding in computational linguistics, AI, language evolution, and construction grammar. RT ≠ endorsementCIFAR @CIFAR_News
17K Followers 2K Following Extraordinary minds addressing science and humanity’s most important questions. FR: @nouvelles_CIFARVector Institute @VectorInst
27K Followers 534 Following The Vector Institute is dedicated to AI, excelling in machine & deep learning research. AI-generated content will be disclosed. FR: @InstitutVecteurQing Qu @Qing_Qu_1006
721 Followers 422 Following Assistant Professor at Umich ECE. Research interest: machine learning, optimization, data science. A runner 🏃 in spare time.mat @ballforest
5K Followers 4K Following Pokémon GO / Outlier detection / Anomaly detection / Kernel method / Robust statistics / Statistical depth / Information geometry / Functional AnalysisYichen Jiang @YichenJiang9
652 Followers 472 Following PhD candidate at UNC-Chapel Hill (@uncnlp) | @Apple AI/ML PhD Fellow | Past Intern @Apple @Alexa @MetaAI @MSFTResearch | #NLProc | Working on Compositionality.MASSIVE UPDATE: Text to Speech arena adds OpenVoice v2, PlayHT 2.0 & Voicecraft 2.0 🔥 *sound on 🔔* Why them? OpenVoice v2 is the latest release from myshell ai, trained with more data, better training strategy and more importantly released under MIT license Voicecraft 2.0…
Meta presents Better & Faster Large Language Models via Multi-token Prediction - training language models to predict multiple future tokens at once results in higher sample efficiency - up to 3x faster at inference arxiv.org/abs/2404.19737
We've just released a notebook that shows how to add voice-consistency to Parler-TTS on mono-speaker datasets🚀🔥 How does it work? Simply create prompts that have a consistent name (e.g. Jenny 🍀) and let the magic of fine-tuning work. SPOILER: it does work fine on a free…
We couldn't be prouder to announce that our own Professor Henry Davis has been selected as this year's recipient of the Canadian Linguistic Association’s (@canadaling) National Achievement Award! Congratulations Henry!
Delighted to share that I've been promoted to Professor (aka “Full Professor”) A huge thanks to my wife, students, collaborators, colleagues, family, & friends for everything. It's been an exhilarating, wondrous, fascinating climb, and what a view! Now, which peak to climb next?
🔆From Persona to Personalization: A Survey on Role-Playing Language Agents 🔍 Dive into our comprehensive survey of RPLA technologies, their applications, and the exciting potential for human-AI coexistence. 📖 Paper: arxiv.org/pdf/2404.18231 [1/3]
This will hit arxiv tomorrow night, but you can get the pdf right now: maxim.ece.illinois.edu/pubs/variation…
Academic conference networking events are basically just all old white profs on one side discussing what’s hot in the field and all the people of colour esp women on the other side discussing how expensive the conference is. #AcademicTwitter
``Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models,'' Shengpeng Ji, Minghui Fang, Ziyue Jiang, Siqi Zheng, Qian Chen, Rongjie Huang, Jialung Zuo, Shulei Wang, Zhou Zhao, ift.tt/3LlXFY8
@tallinzen What about the ‘pain’ and humiliation that academics of third world countries endure to secure a visa? Unless one has to endure that, virtual talks would indeed seem to be painful from the ivory towers!
[CL] Player-Driven Emergence in LLM-Driven Game Narrative X Peng, J Quaye, W Xu, C Brockett… [Microsoft Research] (2024) arxiv.org/abs/2404.17027 - Players interact with non-deterministic NPCs generated by GPT-4 in a text-adventure game where they try to solve a mystery and…
A Survey of Generative Search and Recommendation in the Era of Large Language Models Present a unified framework for the emerging generative paradigm in search and recommendation that leverages LLMs. 📝arxiv.org/abs/2404.16924
Audio ML water cooler talk! 🚰 Our community is smaller than NLP and vision. Let's share where we meet online to enhance this advantage! It’s a great way to foster diverse discussions across academia, industry, and independent research. 🚰🤝☕️ >>
ExcluIR: Exclusionary Neural Information Retrieval Presents a benchmark and dataset for exclusionary retrieval where queries express what information to exclude. 📝arxiv.org/abs/2404.17288 👨🏽💻github.com/zwh-sdu/ExcluIR
one of the most important things I know about deep learning I learned from this paper: "Pretraining Without Attention" this what I found so surprising: these people developed an architecture very different from Transformers called BiGS, spent months and months optimizing it and…
🏆 Our #CHI2024 Best Paper 🏆 How does AI change privacy risk, if at all? We present 12 privacy risks that AI technologies either newly created or exacerbated. Visit AIPrivacyTaxonomy.com to learn more! 📝Paper: hankhplee.com/papers/chi24_p…
📣 New #chi2024 paper 📣 Our analysis of 321 AI privacy incidents shows that 93% involved new or heightened risks due to the capabilities or data needs of AI. Also, existing privacy-preserving AI/ML techniques account for a small subset of these risks. sauvikdas.com/papers/51/serve
[CL] Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding M Elhoushi, A Shrivastava, D Liskovich, B Hosmer... [FAIR at Meta & GenAI at Meta] (2024) arxiv.org/abs/2404.16710 - The paper presents LayerSkip, an end-to-end solution to accelerate inference of large…
From Claude100K to Gemini10M, we are in the era of long context language models. Why and how a language model can utilize information at any input locations within long context? We discover retrieval heads, a special type of attention head responsible for long-context factuality
Honored to receive an Honorable Mention at #chi2024 for our study of a voice-based mobile dating platform in China. This work echoes another honorable mention we had on paid gaming teammates. Both work contribute insights into the affordances of voice in shaping relationships.
Thrilled to receive my 2nd Honorable Mention paper at #CHI2024! Both awarded papers investigate how voice can influence interpersonal communication, one within the context of online dating and the other in a paid game teammate online community. Thanks to my collaborators!