Parallel Software and Systems Group @hpc_group
The Parallel Software and Systems Group is a research group @UofMaryland @umdcs, directed by Prof. @bhatele. Research on HPC, Vis. and ML. RTs ≠ endorsements. pssg.cs.umd.edu College Park Joined April 2020-
Tweets134
-
Followers362
-
Following90
-
Likes79
We are on a roll, second successful dissertation defense in a week (March 28)! Congratulations to @siddharth_3773 on becoming the second PhD graduate from PSSG!! Dissertation title: "Optimizing Communication in Parallel Deep Learning on Exascale-class Machines" #HPC #AI #HPC4AI
We present our very first newly minted Dr. Daniel Nichols (@DanielNichols10), who successfully defended his dissertation today. Congrats & best wishes for a bright future ahead!! Dissertation Title: "On Learning Behaviors of Parallel Code and Systems Across Modalities" #HPC #AI
We have a postdoc opening in our group on the intersection of HPC and AI, specifically on developing and applying Code LLMs to HPC software development. Please help us spread the word: umd.wd1.myworkdayjobs.com/en-US/UMCP/det… Position will remain open until filled. #HPC #AI
Come see our #NeurIPS2024 poster today on" Loki: Low-rank Keys for Efficient Sparse Attention" Paper: arxiv.org/abs/2406.02542 Code: github.com/hpcgroup/loki Loki is a sparse attention method that reduces the computational and memory costs of LLM inference! By exploiting the…
Come see our #NeurIPS2024 poster today on" Loki: Low-rank Keys for Efficient Sparse Attention" Paper: arxiv.org/abs/2406.02542 Code: github.com/hpcgroup/loki Loki is a sparse attention method that reduces the computational and memory costs of LLM inference! By exploiting the…
Want to learn about our findings around the low-rank structure of attention keys, and how to use it to improve sparse attention? Come to our poster at #NeurIPS2024 tomorrow (Friday) at the East Exhibit Hall from 11-2 (Poster #2000)!
Want to learn about our findings around the low-rank structure of attention keys, and how to use it to improve sparse attention? Come to our poster at #NeurIPS2024 tomorrow (Friday) at the East Exhibit Hall from 11-2 (Poster #2000)!
Excited to present “Be Like a Goldfish: Don’t Memorize!” led by @ahans30 at NeurIPS, East Building #4709. In this work, we propose a simple yet effective loss function to reduce verbatim memorization. Stop by the poster and grab some goldfish crackers while you’re at it!
🏆 Researchers from the @UofMaryland received the HPC Innovation Excellence Award from @Hyperion_HPC for their work on AxoNN—a scalable framework that’s pushing the limits of Large Language Model (LLM) training! 🚀 💫 bit.ly/3CsmjKM 🏆 bit.ly/3V9HFTw
We are honored to receive an HPC Innovation Excellence Award for work done by @siddharth_3773 on scaling AxoNN to large-scale GPU supercomputers. #SC24 #HPC #AI
We are honored to receive an HPC Innovation Excellence Award for work done by @siddharth_3773 on scaling AxoNN to large-scale GPU supercomputers. #SC24 #HPC #AI
A sneak peek into what PSSG is going to be up to this week at @Supercomputing in Atlanta. Come and talk to us, we'll be giving away t-shirts, buttons and lots of stickers! #SC24 #HPC #AI
This work was spearheaded by graduate students @siddharth_3773 and @jwkirchenbauer in @umdcs. We are looking forward to presenting our work at @Supercomputing. #HPC #AI #HPC4AI #SC24
This work was spearheaded by graduate students @siddharth_3773 and @jwkirchenbauer in @umdcs. We are looking forward to presenting our work at @Supercomputing. #HPC #AI #HPC4AI #SC24
A @UofMaryland team led by @bhatele & @tomgoldsteincs is a finalist for the prestigious ACM Gordon Bell Prize! Their framework is accelerating AI model training on supercomputers, and setting new speed records while addressing privacy concerns. Read more: go.umd.edu/1tn1
We will be training new Code LLMs with large context lengths, looking at multiple modalities and agents, with a goal to revolutionize HPC software development using AI. Stay tuned! 🚀🧑💻 #HPC #AI #HPC4AI #AI4HPC
Supported by $1M from the U.S. Dept. @ENERGY, @tomgoldsteincs & @bhatele are tackling AI’s limitations in high-performance computing. They aim to enhance LLMs for complex parallel tasks, boosting software developer productivity by tenfold. Read more: go.umd.edu/1t71
We've been scaling/benchmarking our DL framework, AxoNN, on NVIDIA & AMD platforms. We recently ran AxoNN on Alps @cscsch with H100 GPUs and achieved an unprecedented 1.42 Exaflop/s (BF16). More exciting news to come in the coming months, so stay tuned! cc: @umdcs @UMDscience
It was great talking to @sophurky about Frontier and its role in advancing science, and specifically our use of Frontier for scaling LLM training/fine-tuning/inference and for actual AI/ML research. This is joint work with @tomgoldsteincs' group. #HPC #AI #HPC4AI #LLMs #AMD
Todd Gamblin / @tgamb... @tgamblin
4K Followers 5K Following Dev tools, open source, HPC, systems, parallel computing @Livermore_Lab. @spackpm guy. Setting up https://t.co/MHhbvakyFO. Opinions mine. he/him.
Tom Goldstein @tomgoldsteincs
27K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.
ALCF @argonne_lcf
2K Followers 583 Following ALCF is an @ENERGY/@doescience user facility at @argonne, providing supercomputing and AI resources to accelerate scientific discovery and innovation.
The HPC Garage @hpcgarage
3K Followers 493 Following The HPC Garage is a parallel computing research lab @GeorgiaTech @GTCSE. IG:@hpcgarage & @[email protected]
UMD Center for Machin... @ml_umd
2K Followers 257 Following The University of Maryland Center for Machine Learning uses powerful computing tools to tackle challenges in big data, computer vision, health care and finance.
Furong Huang @furongh
9K Followers 2K Following Associate professor of @umdcs @umiacs @ml_umd at UMD. Researcher in #AI/#ML, AI #Alignment, #RLHF, #Trustworthy ML, #EthicalAI, AI #Democratization, AI for ALL.
Tom Deakin @tjdeakin
542 Followers 523 Following 🎓Senior Lecturer in Advanced Computer Systems @bristolcs🪑Chair @SYCLstd WG 🎺Trumpet @BrassConsort 📚Prog GPUs w/ OpenMP 🚂https://t.co/K1xdbq5S3u
Ümit V. Çatalyürek @Catalyurek
357 Followers 209 Following
UMD Research @UMDResearch
6K Followers 3K Following The University of Maryland's Division of Research: A National Research Leader Located at the Center of the Nation's Federal Research Region. RTs≠endorsement
Sarah Neuwirth 🇪�... @NeuwirthSarah
192 Followers 376 Following Professor and Group Leader @uni_mainz, interested in HPC, Parallel File Systems, I/O, Networking. ~Simplicity is the ultimate sophistication.~
Exascale Computing Pr... @exascaleproject
3K Followers 765 Following The Exascale Computing Project is a U.S. Department of Energy multi-lab collaboration to develop a capable and enduring exascale ecosystem for the nation.
乔贤争 @QiaoZheng20904
0 Followers 8 Following
Architecture_Inductor @Hasan_Emre_Dinc
2 Followers 305 Following
天条 冬樹 @fuki_tenjo
2K Followers 7K Following 在野研究者・デジタルアーティスト。 専門は数論幾何、理論物理、高性能計算・人工知能。 その他、哲学・芸術・旅をこよなく愛しています。
Cem S. @bookhashira99
14 Followers 631 Following
etienne @etiennth
0 Followers 456 Following
JohnM @johnmo2001
2 Followers 94 Following
Jordan Boyd-Graber @boydgraber
4K Followers 2K Following Trivia Nerd, NLPer, Dad, Colorado native in Maryland exile Working on QA, negotiating/cooperating bots, ML explanations Exemplar for absent-minded professor
Shivraj Jamgade @jamgade_shivraj
4 Followers 156 Following TEE Engineer @SentientAGI | ex @Cisco | Master's @IIScCSA
DDudu @yi_xin3086
3 Followers 150 Following
Runzhou Tao @runzhou_tao
130 Followers 134 Following Assistant Professor @umdcs, Ph.D. @ColumbiaCompSci, Quantum PL & OS
Aldo Fathoni @realfathonix
91 Followers 3K Following Software developer, retrocomputing and Unix enthusiast, computer hobbyist in general.
Charles Highsmith @Highsmith_Chuck
345 Followers 5K Following Winston-Salem native. Poli Sci major from UNC-CH. Bank data processing from 1979 - thru 2015. Retired. Current focus is machine intelligence and robotics.
Stew of Randomness @tt_to_code
179 Followers 1K Following Things of interest. Cool pics, memes, politics, business and geeky content.
Hunter Ram @HunterRam271102
0 Followers 9 Following
Thomas Kelly @Thomasmarkelly
899 Followers 7K Following DYOR I see the issue now! I am humbled and super excited to announce that you are absolutely right! Rt not = agree
Franciszek Pajak @Franciszek64066
2 Followers 14 Following
Epic Plain @EpicPlain
555 Followers 3K Following #AgenticAI #GenerativeAI #GenAI #AI #ResponsibleAI #CyberSecurity #QuantumComputing #MachineLearning #LLMs #PQC #QuantumInternet #QuantumNetworking
Harshitha @HarshithaMenon
1 Followers 37 Following
brian zinman @brianzinman
2K Followers 4K Following
zhuiz @zhz_white
0 Followers 13 Following
VonVictor V Rosenchil... @CEOHubBucketInc
269 Followers 3K Following 🇺🇸 Founder/CEO HubBucket Inc / @HubBucketInc | U.S. Navy Intelligence Veteran | Former CTO CIO CISO COO | @HubBucketsOrg @HubBucketIncNYC @HubBucketTech
Hari vallabha Vishnub... @vvkharivallabha
4 Followers 421 Following
Perceptron @anuvanuvuu
1 Followers 83 Following
Pradeep N @npav5057
22 Followers 358 Following My interests are. Philosophy, Psychology & Criminology. Human Behavioural Biology. Literature, Music. Science-Technology-Engineering-Mathematics. ME IIT Mandi
Omid Nejati @Manzarii
213 Followers 2K Following PhD student @Concordia University | CV and ML researcher | interested in Medical Imaging
HubBucket Inc 21st Ce... @HubbucketInc
243 Followers 4K Following 🇺🇸 HubBucket Inc / @HubBucketInc is a Self-Funded Scientific Research Organization | @HubBucketsOrg @HubBucketTech @HubBucketIncNYC @CEOHubBucketInc
Chuanming @ChuanmingLiu
333 Followers 7K Following Ex-PhD student and alumni @sjtu1896 . Global citizen. Bootstrapping silicon-based life. Lifelong learning practitioner. Amateur triathlete and marathoner.
William Myrhang @wkmyrhang
2K Followers 6K Following PMM @AMD for Instinct GPUs. Passion for HPC, AI, DaaS/VDI, Cloud, Security, Consumer Electronics, PC Gaming, Xbox, & AV. Raising #Autism teen. Views My Own.
AruLee @JLee0629
7 Followers 380 Following
Marco Sanguinetti @marcsang01
5 Followers 222 Following
Attreyee Mukherjee �... @twtamuk
763 Followers 617 Following PhD CS Student @Purdue University | GitHub Campus Expert 🚩| Undergraduate CS'25
Mike Allton | AI for ... @mike_allton
51K Followers 8K Following AI for Creators & Solopreneurs | Automate your biz, reclaim your time. Host @ The AI Hat Podcast. Learn how below! 👇
Levent Serbesatik @gercekelebasi
2 Followers 42 Following
Praveen Vaddadi @Densebit
187 Followers 2K Following Low-level tinkerer, slow walker, slow thinker. UMD CS. AI, DBs, PLs. Making things faster, better, simpler. Occasional tweet-notes on topics of interest.
Bom Singiali @bom_singiali
14 Followers 282 Following
HPC Guru @HPC_Guru
28K Followers 89 Following "It takes a lot of knowledge to know what one does not know" 😎Tweets on things related to High Performance Computing -- systems, interconnects, storage, 🥭 ...
Todd Gamblin / @tgamb... @tgamblin
4K Followers 5K Following Dev tools, open source, HPC, systems, parallel computing @Livermore_Lab. @spackpm guy. Setting up https://t.co/MHhbvakyFO. Opinions mine. he/him.
Tom Goldstein @tomgoldsteincs
27K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.
LLNL Computing @Livermore_Comp
3K Followers 211 Following An official @Livermore_Lab sub-account Follows, RTs and mentions ≠ endorsements. ALT for banner photo: El Capitan supercomputer at LLNL
Glenn K. Lockwood @glennklockwood
6K Followers 321 Following #HPC and supercomputing enthusiast. Employed by @VAST_Data. My posts go to Bluesky these days.
UMIACS @umiacs
2K Followers 132 Following Official account of the University of Maryland Institute for Advanced Computer Studies.
ALCF @argonne_lcf
2K Followers 583 Following ALCF is an @ENERGY/@doescience user facility at @argonne, providing supercomputing and AI resources to accelerate scientific discovery and innovation.
SC25 @Supercomputing
19K Followers 544 Following Official Twitter for the SC Conference Series • SC25 • Nov 16–21, 2025 • America’s Center, St. Louis, MO
HPCwire @HPCwire
22K Followers 352 Following #HPCwire is your world-class news portal covering high performance computers. @TomTaborHPC @TiffanyTrader @JRussonHPC @OliverPeckham #HPC
The HPC Garage @hpcgarage
3K Followers 493 Following The HPC Garage is a parallel computing research lab @GeorgiaTech @GTCSE. IG:@hpcgarage & @[email protected]
Univ. of Maryland @UofMaryland
104K Followers 1K Following 2 Nobel laureates, 6 Pulitzer recipients, scores of Fulbright scholars, one cute turtle and a bike ride away from our nation's capital! RTs ≠ endorsements.
Furong Huang @furongh
9K Followers 2K Following Associate professor of @umdcs @umiacs @ml_umd at UMD. Researcher in #AI/#ML, AI #Alignment, #RLHF, #Trustworthy ML, #EthicalAI, AI #Democratization, AI for ALL.
Tom Deakin @tjdeakin
542 Followers 523 Following 🎓Senior Lecturer in Advanced Computer Systems @bristolcs🪑Chair @SYCLstd WG 🎺Trumpet @BrassConsort 📚Prog GPUs w/ OpenMP 🚂https://t.co/K1xdbq5S3u
Jeff Dean @JeffDean
367K Followers 6K Following Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
Satoshi Matsuoka @ProfMatsuoka
25K Followers 915 Following 理研計算科学研究センター長 Director RIKEN R-CCS, 東科大特定教授 Prof. Inst. Sci.. ACM/ISC/JSSST/IPSJ Fellows, IEEE Fernbach(2014)&Cray(2022) Awards, 令4紫綬褒章 Purple Ribbon Medal 2022
Ümit V. Çatalyürek @Catalyurek
357 Followers 209 Following
UMD Research @UMDResearch
6K Followers 3K Following The University of Maryland's Division of Research: A National Research Leader Located at the Center of the Nation's Federal Research Region. RTs≠endorsement
Lawrence Livermore Na... @Livermore_Lab
66K Followers 997 Following U.S. @ENERGY and @NNSAnews laboratory. We use science and technology to make the world a safer place. Verification: https://t.co/29pFxbpHmQ
Women in HPC @women_in_hpc
5K Followers 327 Following Working towards equal representation in HPC @[email protected]
Quentin Anthony @QuentinAnthon15
4K Followers 268 Following I make models more efficient. Google Scholar: https://t.co/kzVsAKPLgX
Siddharth Singh @siddharth_3773
853 Followers 247 Following Research Scientist @nvidia, CS Ph.D from UMD. I work on Systems for ML / parallel deep learning.
Prajwal Singhania @prajwal1210
67 Followers 128 Following CS PhD Student @ UMD | Ex - Sr. Associate @ AlphaGrep Securities | CSE-IIT KGP 2020
Jonas Geiping @jonasgeiping
4K Followers 803 Following Machine Learning Research at the ELLIS Institute & Max-Planck for Intelligent Systems// Excited about fundamental questions in Safety & Efficiency of modern ML
Pratap Tokekar @ptokekar
1K Followers 846 Following Associate Professor at @umdcs, @umiacs, and @amazon Scholar. Previously @vt_ece @grasplab @umncomputersci
Bhavya Kailkhura @bkailkhu
918 Followers 466 Following Principal Research Scientist spearheading AI security research @Livermore_Lab. Making AI robust & efficient for national security and scientific applications.
Rakrish Dhakal @RakDhakal
41 Followers 107 Following
SPRT @SPRT_RCCS
46 Followers 74 Following Hiring postdocs and/or researchers for Supercomputing Performance Research Team @ RIKEN R-CCS ( 理研 高性能計算モデリング研究チーム )
Randles Lab @RandlesLab
1K Followers 3K Following News and #Research from Amanda Randles's Biomedical Engineering Lab @DukeU. We are using #HPC to address #biomedical questions. #AcademicTwitter #innovation
Computational Epidemi... @comp_epi
107 Followers 69 Following NSF EXPEDITIONS in Computing: Global Pervasive Computational Epidemiology
Christopher D. Long �... @octonion
22K Followers 7K Following Data science and optimization. Ex-San Diego Padres, Detroit Tigers, Yankees, Arsenal, Houston Rockets. Google Foobar winner. He/him. [email protected]
Josh Davis @jhdavis_josh
64 Followers 133 Following NSF Fellow, PHD student at the University of Maryland. Member of @hpc_group, @umdcs
DOE CSGF @doecsgf
1K Followers 378 Following The community of the country's top computational scientists and engineers; est. 1991. Managed by @krellInst. Banner: https://t.co/gDTQcb2Qgg
Kenneth Hoste (mastod... @kehoste
2K Followers 4K Following HPC user support @ Ghent University (https://t.co/weDrJNDTke); EasyBuild BDFL (https://t.co/MNTREo6DDM); family guy; likes beer, loud music & FOSS
UMD Science @UMDscience
4K Followers 480 Following Science with an impact from the College of Computer, Mathematical, and Natural Sciences @UofMaryland. Follows/posts/reposts ≠ endorsements.
Mike Lam @lam2mo
108 Followers 84 Following #ComputerScience associate prof at @JMU with systems, #HPC, and PL interests. Teacher, researcher, tool developer. Also: husband, father, gamer.
David Van Horn @lambda_calculus
5K Followers 1K Following Prof at @umdcs and @umiacs. Co-director of @plumlab. BlueSky: https://t.co/Bwck1H9fXK Mastodon: @[email protected]
John ✈️ @chaostheoremhpc
163 Followers 540 Following Product RD @NVIDIA, HPC and AI at scale - opinions and content are my own, and do not reflect current or former employers
Global Computing Lab @TauferLab
305 Followers 146 Following
Kate Isaacs @8clique
270 Followers 306 Following associate professor @uuSCI @UtahSoC | data visualization | always trying to better understand and show what computing systems are up to
HDC Lab @hdc_arizona
26 Followers 8 Following Humans, Data, and Computers Lab at the Department of Computer Science, University of Arizona.
Ian @ianc650
22 Followers 118 Following
Benjie Miao @bjmiao
31 Followers 101 Following
GT-TDAlab @GTTDAlab
36 Followers 14 Following Translational Data Analytics (TDA) Lab is led by Dr. @Catalyurek, in the School of Computational Science and Engineering at Georgia Institute of Technology.
RookieHPC @RookieHPC
219 Followers 68 Following A website seeking to make HPC easier to learn. Contribution is now possible! :D Repository: https://t.co/Vwijxbouyu…
Fujitsu HPC @FujitsuHPC
3K Followers 5 Following Tweets from Fujitsu HPC team. See also: http://t.co/MeDgn08T4k
ACCESS @ACCESSforCI
3K Followers 1K Following Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support. Powered by @NSF | #NSFfunded
Name can be blank. @DavidFischak
544 Followers 3K Following
JP Lehr @jplehr
389 Followers 314 Following AMD, gpu, hpc, omp, dnd, vim, cpp, jpl, acc, etc, ... he/him/his opinions are my own.
Spack @spackpm
2K Followers 3K Following A flexible package manager designed to support multiple versions, configurations, platforms, and compilers. Join us at https://t.co/aT6zWYxXKz!
ACM SIGHPC @SIGHPC
3K Followers 84 Following Official feed for the ACM Special Interest Group on High Performance Computing.
TACC @TACC
7K Followers 988 Following The Texas Advanced Computing Center (TACC) @UTAustin designs and deploys powerful computing technologies to power discoveries that change the world.
NERSC @NERSC
11K Followers 313 Following Official Twitter of the National Energy Research Scientific Computing Center, @doescience’s primary scientific computing facility. HQ @ENERGY's @BerkeleyLab.
Intel HPC @intelhpc
14K Followers 1K Following High Performance Computing news, content and updates from experts at Intel.
HPE Cray @HPE_Cray
14K Followers 832 Following Hewlett Packard Enterprise brings together the power of AI, cloud, and networking to help organizations achieve more.
Andrew Jones @hpcnotes
8K Followers 1K Following 25 yrs using/researching/buying #supercomputers. Now an engineering leader for #supercomputing capabilities at Microsoft. Posts on #HPC #AI #cloud #F1 #travel
John A Gunnels @jagunnels
639 Followers 1K Following Father, Researcher/DE/Mgr/Coder, Dog Owner, NVIDIAN, Ex-{IBM,AWS}, HPC (Knowledgeable), AI (Competent), Math (Educated), and Quantum (Entangled). Opinions mine.
Pramod Kumbhar @pramodskumbhar
310 Followers 344 Following HPC, Parallel Programming, Performance Analysis and Profiling Tools!
Trends for United States
You might like
