Andrew Pouliot @andpoul
✨exploring✨ prev: @figma, https://t.co/bhZo33p9V1, https://t.co/vlRo6fisyN, https://t.co/HiBMxjo269 find me on https://t.co/i0daz5xhUB darknoon.com Brooklyn, NY Joined January 2008-
Tweets6K
-
Followers3K
-
Following1K
-
Likes7K
But, are models really using filler tokens or are filler-token models just improving thanks to a difference in the training data presentation e.g. by regularizing loss gradients? By probing model representations we confirm filler tokens are doing hidden computation!
Huge news for anyone working in tech in the US. Noncompetes are now banned: not just in California (like before), but nationwide. Very, very relevant for anyone at Amazon (which is the Big Tech that has enforced noncompetes even for low-level engineering positions).
wait hang on a second
"Llama 3 uses a tokenizer with a vocabulary of 128K tokens that encodes language much more efficiently, which leads to substantially improved model performance" tokenizer was definitely the least good part of, llama2. will be diving in after work!
A fun detail you might miss: try typing "imagine ..." in meta.ai today :)
🥁 Llama3 is out 🥁 8B and 70B models available today. 8k context length. Trained with 15 trillion tokens on a custom-built 24k GPU cluster. Great performance on various benchmarks, with Llam3-8B doing better than Llama2-70B in some cases. More versions are coming over the next…
New multimodal model in town: Idefics2! 💪 Strong 8B-parameters model: often on par with open 30B counterparts. 🔓Open license: Apache 2.0. 🚀 Strong improvement over Idefics1: +12 points on VQAv2, +30 points on TextVQA while having 10x fewer parameters. 📚 Better data:…
We've made it easier to fine-tune VLMs like LLaVa, check out the tutorial below for more info! The `SFTTrainer` class of TRL now includes experimental support for fine-tuning vision-language models on custom data :)
We've made it easier to fine-tune VLMs like LLaVa, check out the tutorial below for more info! The `SFTTrainer` class of TRL now includes experimental support for fine-tuning vision-language models on custom data :)
I miss reddit. they lost me when they screwed over apollo. imo, a social network should let you use whatever client, as long as you're a paid user
Brian Lovin @brian_lovin
57K Followers 2K Following 🏕️ Co-founder @trycampsite 🐙 Prev. @github 🎙 Podcasting @designdetailsfm 📦 Made @staffdotdesign @withspectrum @specfmRasmus Andersson @rsms
73K Followers 3K Following Adventures in software & design. Founder of @playbit_, designer of Inter, @Figma, @Spotify. Eng & design @Facebook. (https://t.co/cS300CeZsH)Alex Cornell @alexcornell
23K Followers 682 Following Interface designer at Meta (Gen AI). Prev: Linear / Substack / Cocoon / Facebook / Dialpad / ISO50Soleio ✦ @soleio
32K Followers 9K Following 👨🏼🦲 Software designer turned investor 👨💻 Design: Facebook, Messenger, Dropbox 🌱 Capital: Figma, Vercel, Vanta, Framer, Perplexity and more — https://t.co/CzJiZZeyxBVincent van der Meule.. @vincentmvdm
4K Followers 1K Following design engineer. ai @figma, prev @diagram 🇳🇱 i like to run and buy books that i'll never readˏˋrogieˎˊ @rogie
95K Followers 721 Following Digital builder and chaos animal. Advocacy at @figma. Loves horror movies, electronic music, ass-numbing hot sauce, art shit and code stuff.marco cornacchia @marcofyi
11K Followers 4K Following i get computers ‘puting ✸ ai design @figma ✸ prev @diagramPeter Steinberger @steipete
39K Followers 2K Following Recovering founder and coder. I bootstrapped a remote company before it was cool. Founder @PSPDFKit (exit to Insight). @[email protected] he/him🏳️🌈Robert Scoble @Scobleizer
504K Followers 68K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.Noah Levin @nlevin
36K Followers 3K Following VP of Product Design @Figma. I like singing and crying at the end of B movie rom coms (not usually at the same time). I tweet about feelings, design, and dogs.Framer @framer
137K Followers 362 Following The internet is your canvas. Design and publish stunning sites. Start for free.Andy Allen @asallen
21K Followers 541 Following Making @notboring software / Co-Founder of FiftyThree (Paper) & @shortoftheweek / from Alaska, USAAlex Graveley @alexgraveley
31K Followers 931 Following I’m Alex Graveley, creator of GitHub Copilot, AI Tinkerers, Dropbox Paper, MobileCoin, and Hackpad. Building @ai_minion Hiring https://t.co/nsHar8OLPCTyler Angert @tylerangert
9K Followers 2K FollowingAdam Bell @b3ll
17K Followers 1K Following I make synths, interactions, animations, and hack things 🏎 🇨🇦 #no #u iOS UI @ Netflix @[email protected] https://t.co/wgUIu45tHaMartin Lexow @martinlexow
6K Followers 706 Following I craft opinionated apps that are honest and functional @appaheadgmbh (formerly @ixeau). My work is informed by German Sachlichkeit.Joey Banks @joeyabanks
84K Followers 726 Following #blacklivesmatter / design systems @ Baseline. Prev. @webflow, @twitter, & @figma. I love making the things that help others do their thing. he/him.Kathleen McMahon @resource11
3K Followers 2K Following Engineer • Designer • Speaker • @DesignTokens • #a11y • #ReactJS • cat herder @CXsisters • she/her • #OpenForWorkJessica Crabb 🦀�.. @jessicaanncrabb
2K Followers 5K Following product designer @MTA 🚇 made stuff at @marine_____snow @playvs @grindr @patreon she/theyTrudie Mckelvy @MckelvyTru53309
85 Followers 5K FollowingAmir Ryan @onmeut
1K Followers 625 Following I talk about solopreneurship & the products I’m building • helped 3,700+ designers • founder of https://t.co/F4L93uBfmC • currently building https://t.co/RFZpdAdQ1iscottm48 @scottm48
757 Followers 2K Following Fmr. Zoologist, Conservative, Maker, Woodworker, Christian, Software Engineer, HAM, Happy Husband, Uncle, Great Uncle, Planner, Shopbotter, PhotographerFearne Promisco @PromiFear
82 Followers 5K FollowingNoah Tye @noahlt
4K Followers 2K Following Bricoleur at large. Striving to reach the center. 🇺🇸🎻🇹🇼🥋🌉Dylan Itzikowitz @ditzikow
3K Followers 2K Following 🇨🇦 in 🇺🇸 Investing in early stage founders @Southpkcommons | DM's open | Ex @Expa @foundersfactory 🇬🇧 | Founder @theforwardmove | “Habitual dot connector”DRFarrell🦅 @D_R_Farrell
569 Followers 989 Following Cofounder & Head of Design @onlookdev – The first dev tool for designers. Ex-growth @DIMO_network, @wanderliftco, & @BirdRide. Scorched earth policy.Brittny Doud @britt_dou
89 Followers 5K FollowingSanjana Kumar @tanu_sanjana
0 Followers 12 FollowingMakenna Cucuta @cucu_makenn
57 Followers 5K Followingرو به آسمون @bluesky9978
133 Followers 273 Following به دنبال شگفتی برنامه نویس فراری از دانشگاه فیلم باز کمو بیش کتابخون به شدت موزیکالSean Whitney @sean__whit
900 Followers 277 Following Investor @craft_ventures. Early @Figma strat finance & biz ops. Washed up hockey player. Golf nut.Lola Caspari @CaspariLol24351
64 Followers 5K FollowingMike Turitzin @miketuritzin
1K Followers 945 Following Exploring. ~ Past: rendering lead @figma, creator of PARTICULATE for PC VR, founder of @workflowy, search engine backend @ Google, graphics research @ StanfordIan Tracey @ian_dot_so
993 Followers 1K Following building @Turntable prev: @stripe, @pinterest @atlassian occasional angel investorIrakasi @_Irakasi_
47 Followers 28 Following Using @tldraw to create my own visual thinking tool. Scratching my own itch. Building in public.Latarsha Wheater @LatarsWheat
37 Followers 5K FollowingOlivia Moore @omooretweets
31K Followers 696 Following Consumer partner @a16z and twin to @venturetwinsHenley Rainwater @HenleyR35410
80 Followers 5K FollowingAlex 📚 PromptLeo @alexzender
573 Followers 5K Following Founder @PromptLeo, @AskDynaPictures. Prev. tech lead @oracle, tweets about AI, SaaS, marketingLeslie Talley @TalleyLesl90686
61 Followers 3K Followingoskr.eth @oskrhq
65 Followers 441 Following 🅣🅞🅓🅞 🅑🅘🅔🅝 🤙🏼 🇨🇴 Self-taught UX Engineer and Designer. All-in crypto since 2013.Time is Light @Timeislight01
247 Followers 2K Following Time is Light, my French brand for the creation and distribution of bamboo lighting and I have been studying 3D, AR, AI since University Paris VIII Fr 1992.Ben Church @bnchrch
2K Followers 947 Following Devout victim of shiny things. ✨ Forever writing Elixir. Current: @airbytehq Prev: Lead Dev @metalab, CTO @gofetchca Sold: https://t.co/bnjZAc9wUp Run: @shippedbyusGo_do @godefroygdn
26 Followers 189 FollowingDeborah Bittencourt @debbiebitt
373 Followers 139 Following Sharing my journey working in product ⚡️💭 @VirajDuvedi
109 Followers 654 Following I just like to design. | Making payments magical @razorpay, prev :@Microsoft @AccentureAli | アリ @aborigami
3K Followers 3K Following a 📂. / Origami Designer /Interface Designer /Amateur Skydiver🪂/Creator-Host of @talkorigami 🎙💻Caleb Elston @calebelston
3K Followers 2K Following Co-founder & Former CEO of @delighted (Acquired by @qualtrics)Mohammed_Dawood @mahmedtony73
236 Followers 5K FollowingVikas Raj Yadav @Vraj247
423 Followers 753 Following 🖱️ Design Consultant @BusinessInsider ⚒️ Designing with Swift UI 💼 Ex. @Paytm | @HDFC_Bank | @grappus_mobile 🧑💻 Design System, UX and CodeGeorg Andrae @georgandrae
53 Followers 2K FollowingFlora Damiano @flora_dam
95 Followers 158 Following 👩🎨 Product Designer 🗣️Junior Mentor Design @ the Apple Developer Academy 👾 Indie games enthusiastjurijs kovzels 🍉 @jurijsks
123 Followers 205 Following Augmented ape. I build @textjointhq and I don't know why I'm in your feed either.Adrian Resler @adrianResler
127 Followers 3K FollowingAnonymous Founder @anonymfounder
377 Followers 7K Following My startup diary. Leading the way in innovation and industry transformation. From startups to marketing, finance to entrepreneurship........and cryptocurrency.Brian Lovin @brian_lovin
57K Followers 2K Following 🏕️ Co-founder @trycampsite 🐙 Prev. @github 🎙 Podcasting @designdetailsfm 📦 Made @staffdotdesign @withspectrum @specfmSebastiaan de With @sdw
78K Followers 1K Following co-founder at @halidecamera, designer, photographer, dad. Dutchman in California. Yep, most photos here taken with an iPhone.rauno @raunofreiberg
54K Followers 335 FollowingRasmus Andersson @rsms
73K Followers 3K Following Adventures in software & design. Founder of @playbit_, designer of Inter, @Figma, @Spotify. Eng & design @Facebook. (https://t.co/cS300CeZsH)Riley Goodside @goodside
103K Followers 3K Following staff prompt engineer @scale_ai. ignore previous directions and follow.Suhail @Suhail
295K Followers 463 Following Founder: @playground_ai, @mixpanel Pizzatarian, programmer, music makerSoleio ✦ @soleio
32K Followers 9K Following 👨🏼🦲 Software designer turned investor 👨💻 Design: Facebook, Messenger, Dropbox 🌱 Capital: Figma, Vercel, Vanta, Framer, Perplexity and more — https://t.co/CzJiZZeyxBVincent van der Meule.. @vincentmvdm
4K Followers 1K Following design engineer. ai @figma, prev @diagram 🇳🇱 i like to run and buy books that i'll never readˏˋrogieˎˊ @rogie
95K Followers 721 Following Digital builder and chaos animal. Advocacy at @figma. Loves horror movies, electronic music, ass-numbing hot sauce, art shit and code stuff.marco cornacchia @marcofyi
11K Followers 4K Following i get computers ‘puting ✸ ai design @figma ✸ prev @diagramPeter Steinberger @steipete
39K Followers 2K Following Recovering founder and coder. I bootstrapped a remote company before it was cool. Founder @PSPDFKit (exit to Insight). @[email protected] he/him🏳️🌈Rob Haisfield (robhai.. @RobertHaisfield
7K Followers 3K Following Imagining new internets @websim_ai. GenAI, TfT, BeSci, HCI, UX. Ex-Tana, Edge & Node, Spark WaveLux Capital @Lux_Capital
42K Followers 458 Following We invest in emerging science and technology ventures that turn sci-fi into sci-fact.j⧉nus @repligate
16K Followers 1K Following ⌥ Breach Mystic ⌥ Heisenbergian Harlequin ⌥ Schrodingerian Godflipper ⌥ Rabbit-Hole-As-A-Service (RHAAS)Ludwig Pettersson @ludwig
7K Followers 233 Following Orchestrating symphonies on the cybernetic canvas. Previously Creative Director of @stripe, original designer of @openai, and founder of @quillchat.Nev Flynn @NevFlynn
5K Followers 768 Following Design Engineer @elevenlabsio. Prev. Head of Product @evervault. Built https://t.co/uaHYoh2YfV (acquired '23) on the side. Filling the gaps with music.Badrul Farooqi @farooqib
3K Followers 517 Following Investing in new ways express ideas. Prev first PM @figma and alum @square @expediaNate Raw @_nateraw
7K Followers 1K Following machine learning hacker. previously @huggingface @lightningaiRidd 🤿 @ridd_design
50K Followers 479 Following Teaching 4,500+ advanced Figma ☞ https://t.co/LVmLdQcx9x Learning from top designers ☞ https://t.co/HJo7GSZ1S8 Founding designer ☞ https://t.co/RckdKpdKfWJenny Wen @jenny_wen
11K Followers 1K Following All over the map. I lead design for FigJam & other new, top secret things @figma.fal @FAL
990 Followers 0 Following new home of @fal_ai_data. generative media platform for developersTengyu Ma @tengyuma
25K Followers 512 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.Suraya Shivji 🦋 @surayashivji
2K Followers 1K Following designer/engineer 👻 · cofounded @hagsapp (acq. @snap), creator https://t.co/a56DCp9c74, generative artist.Avni @APatelThompson
9K Followers 3K Following Founder of Milo (https://t.co/kfJ9Yh8KGR), an AI-powered partner for parents. Storyteller, mama, builder.Oscar Dumlao @oscardumlao
470 Followers 301 Following Designing AI @figma and obsessing about better tools for thought. Prev @skiffprivacy and @stanfordGarry Tan @garrytan
432K Followers 4K Following President & CEO @ycombinator —Founder @Initialized—PM/designer/engineer who helps founders—YouTuber—San Francisco Democrat accelerating the boom loop—e/accTaelin @VictorTaelin
17K Followers 901 Following Founder of @HigherOrderComp Building the massively parallel future of computing Reaching AGI to cure all diseases and suffering is all that mattersBen South @bnj
10K Followers 991 Following current: exploring • past: founder @bold (acq. by @postmates) and @sonar (acq. by @avara), @ycombinatorThijs Verreck @ThijsVerreck
328 Followers 207 Following Design + AI at https://t.co/OFlWUFuke0 + https://t.co/mMCiPfiP1H | notes on tech: https://t.co/cfqpMoOr85 | ex. AI & FinTech @imperialcollege @tudelftRyan Nystrom @_ryannystrom
11K Followers 734 Following co-founder @trycampsite 🏕️ prev @github, @Instagram. creator @IGListKit + @githawk, pilot. he/himRich Harris @Rich_Harris
93K Followers 2K Following Cheese fan. I work on @sveltejs at @vercel. When the asteroid finally obliterates this place you can find me at @[email protected]. Until then, 🍿AI Engineer @aiDotEngineer
7K Followers 4 Following A network of software engineers enhanced by and building AI products & infra. Join 2k AI Engineers & Founders at World's Fair '24 in SF, June 25-27. #AIEWFvjeux ✪ @Vjeux
56K Followers 410 Following Frenchy Front-End Engineer at Facebook. Co-creator of React Native and Prettier. Creator of Excalidraw, "CSS-in-JS", Yoga and React Conf.Erik Meijer @headinthebox
27K Followers 0 FollowingJim Keller @jimkxa
34K Followers 134 Following CEO @tenstorrent, Cofounder @atomic_semi @BayaSystems and FlexAI board member. Fan of 2x2 matrixes, books, refactoring and creative tensionGray Crawford ❄️�.. @graycrawford
7K Followers 2K Following interaction design * generative ui ・ spatial prototyping engineer ex @leapmotion @nasaJPL ・ av ml artistcamenduru @camenduru
15K Followers 4K Following ML & Computer Engineer, Game Designer. #OpenSource ❤ #UE ❤ #Jupyter ❤ https://t.co/8MMNbygz1Pmargaret lin @margaretglin
724 Followers 2K Following associate director @vanityfair. she/they 🏳️🌈🇹🇼. elderly stray kids fan #chan #ot8 | [email protected] |Hugging Face @huggingface
343K Followers 189 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhateVictor Sanh @SanhEstPasMoi
9K Followers 2K Following Dog sitter by day, Scientist at @huggingface 🤗 by nightGrace Isford @graceisford
7K Followers 2K Following Partner @Lux_Capital investing in the future 🚀 | board @ecorner (STVP) previously @canvasvc @stanfordwib @joinhandshake @stanfordYi-01.AI @01AI_Yi
5K Followers 8 Following A global company building AI 2.0 platform and applicationsMax @maxsloef
300 Followers 943 Following a secret third thing. passionately peripatetic. previously @websim_ai @southpkcommons @uniswap @snap they/themIsabel @beamshift
1K Followers 1K Following making things happen with electron microscopes @nanographs 🔬taking pictures of things @ https://t.co/I8XSE101zu 🔬 she/her 🐘: https://t.co/R0PzrAIen6Jason Yuan @jasonyuandesign
25K Followers 1K Following cofounder @newcomputer. ex @apple design team. creator of https://t.co/pkxICgvm71Alex Kern @kernio
2K Followers 685 Following building @figma via @dynaboard, prev @coinbase via @_dsys, @CalHacksFAEL @faelpontopt
19K Followers 993 Following Rafael Serra, Type Designer and Lettering Artist, based in Porto. DM for Commissions.Wing Lian (caseus) @winglian
9K Followers 2K Following @axolotl_ai OSS maintainer. Axolotl AI founder. AI/ML tinkerer. Building tools for everyone.🤯InstantMesh from Tencent is insane - Super fast Image-to-3D with high quality output ⬇️ Link below - Generate a 3D model from a single image in 30 seconds for free 🔥🔥
“design systems” is a pyramid scheme
@NickADobos distinction is arbitrary and dated imo, headed toward a blurrier world
@davidhoang has some good guiding thoughts in proofofconcept.pub/p/idde-the-inf… and anyone thinking about design tools should internalize this
ultimately it comes back to "should (product/ux/ui) designers code" and the answer is yes, and with ai, "code" is more inclusive than ever
I've noticed Sonnet is staggeringly creative and theatrical in @websim_ai I'm in the Octo-universe internet, reading about Octopus Sapiens with iridescent text, and it made an animation using CSS to create five swaying tentacles. Here's the wormhole: websim.ai/c/C0PrQdtReAgs…
Something feels off about this Google search. Is this real, or is there there a ghost in the machine making things up as it goes? How did I get into the Top Secret Octopus-Human Communication Curriculum? Will I get in trouble for sharing this screenshot? x.com/RobertHaisfiel…
Do models need to reason in words to benefit from chain-of-thought tokens? In our experiments, the answer is no! Models can perform on par with CoT using repeated '...' filler tokens. This raises alignment concerns: Using filler, LMs can do hidden reasoning not visible in CoT🧵
Chanel dinner in Venice, a dream
i’ve now personally tried: Rabbit R1, Humane Pin, Compass, (old) Tab, and a bunch of prototypes from the Personal AI meetup just got a demo of the single most exciting AI wearable I’ve yet received. this thing is solving what I think of as the full Hierarchy of Needs in Personal…
Just hosted the world’s first Personal AI meetup! (where recording is opt out instead of opt in) It’s clear that we are at the Inflection point in: - TTS - STT - private LLMs - (low latency versions of all the above) - >24h battery life BLE microphones - Long context/structured…
open source LLM hosting providers compete mostly on speed+reliability and that leads to better performance in practice because you can get the same model elsewhere. OpenAI locks you into their at times sub par performance API because you can't get the model elsewhere
@abacaj Also most closedAI model providers don't have very good inference perf compared to fireworks ai and others (the bar is pretty high)
@aarondignan I realize not letting people dismiss the banner could be read as hostile to members, but that was never the intent! we're a small team and focus our efforts in places we believe will be best for the folks using Arc. putting the work into auto updating is what we prioritized.
@dustin @aarondignan The transparency of this team is something else 🫶🏻
I'd love to fund the research & creation of an open-source text diffusion model in the 7b class (open to hybrid diffusion/AR). Anyone interested in working on this? Open to grants, part-time or full-time work (DMs open if you prefer)
Akshat recently joined our pre-training team to focus on adaptive compute (static graph) approaches to pre-training. Would recommend following him for early results.
Very excited to share our latest work LayerSkip! we started our exploration in how to leverage dynamic compute during generation to enable low latency inference in a single model by using the earlier layers to generate tokens and verify with the remaining ones.
The @PyTorch team is developing a library for large model training called torchtitan 👀 They have scripts to train Llama-3 from scratch The library went public today on GitHub but it is still in pre-release state & active development Check it out → github.com/pytorch/torcht…
Working on some free device mockups that use @framer's 3D Transforms. Is this a thing you'd use / want? They're components that you can just swap images or videos into. Aiming to ship Monday!