MeasuringU @MeasuringU
User Experience Research & Software. Tweets by Jeff Sauro, Jim Lewis & MeasuringU Team: Authors of Quantifying the User Experience + 8 Other UX Books. measuringu.com Denver, CO US Joined January 2010-
Tweets31K
-
Followers26K
-
Following623
-
Likes30
6 Differences between B2B and B2C #Usability. bit.ly/2UcgGKV
Are top box scores a better predictive of behavior? We set out to find out. Here’s what we learned: bit.ly/3CJCnTS
An implication of Campbell’s Law is that mismanagement leads to mismeasurement. But there are strategies to avoid the corruption of high-stakes measures such as the Net Promoter Score. bit.ly/3hV0K8p
Simplifying the UMUX-Lite. bit.ly/3h6b2SI
In a way reminiscent of beer foam or the quantum foam from which matter is created at the edge of a black hole, the #usability problems that occur with some consistency across participants seem to float on a sea of usability problem foam. bit.ly/3istJ2S
Although it is possible that scale orientation could have a large effect on rating behaviors, that does not appear to be the case. At least, the effect is inconsistent. bit.ly/3u4uF3o
In current practice, study-based #UX #metrics include measures of satisfaction, loyalty, brand perception, usability/usefulness, delight, trust, visual design, and special-purpose questionnaires. bit.ly/3yTVVpa
Rating Scales: Myth vs. Evidence. bit.ly/3zj2cYu
When planning an unmoderated study, in the absence of historical data about the task, we generally recommend using a conservative estimate (e.g., the 75th percentile) for the planned research protocol (think-aloud, non-think-aloud, tree test). bit.ly/44ibVPp
In this article, we review how task success is assessed in moderated and unmoderated studies, then we provide guidance on how to approximate completion rates when they can’t be collected. bit.ly/3zj7mUm
Given Campbell’s Law, how might you avoid the corruption of high-stakes #metrics such as the NPS? Consider audits, education, third-party data collection, transparency, timing, and decoupling monetary incentives from subjective customer measures. bit.ly/3hV0K8p
Want to write clearer #survey questions? Keep them short, use simple language, use high-frequency words, match the respondents’ vocabulary, minimize the use of acronyms, avoid complex syntax, and generally avoid passive voice. bit.ly/3l35rPZ
Study-level #metrics are likely more generalizable than task-level metrics. bit.ly/3IepIL3
When asked to interpret cumulative graphs, we found that people often misinterpret them, and do so with confidence. bit.ly/36Tr2SC
Why #survey questions are answered incorrectly #3: Misinterpreting the question. bit.ly/3ykSIvM
Your Guide to Hamburger Menus. (Interaction Design Foundation) bit.ly/4cTauL4
Just because attitudes aren’t a perfect predictor of behavior (that’s an unrealistic bar) doesn’t mean they aren’t useful. Don’t be afraid to ask what people think or do (but know the limitation of asking versus observing). bit.ly/3eFQX4G
Why interview target respondents when crafting #survey questions? The interview step provides the opportunity to validate that the people taking the survey will understand the words and phrases you plan to use. bit.ly/37mcUBI
When planning unmoderated #usability tests, researchers should be aware that think-aloud tasks will usually take more time than non-think-aloud, and tree test tasks are much faster than non-think-aloud tasks. bit.ly/44ibVPp
A review of five studies that compared the effect of think-aloud and non-think-aloud protocols on task completion times found all three possible outcomes (no difference, faster completion with TA, and slower completion with TA). bit.ly/3DPPwfE
Nielsen Norman Group @NNgroup
116K Followers 41 Following User advocates offering evidence-based user experience (UX) research, training, consulting. Visit our website for free UX articles. #nnguxPatrick Neeman @usabilitycounts
98K Followers 727 Following Mostly Head of UX. Sometimes VP of UX. Occasional UX Instructor. Always whiskey drinker. Data influenced since '99. Opinions are mine.Doug Collins @DougCollinsUX
46K Followers 12K Following #UX and #Design #Leadership | Author of “The UX Design Field Book” | Prev. @WesternUnion, @CACIIntl, @etrade, @Broncos, @everdriven | All tweets mineRosenfeld Media @RosenfeldMedia
69K Followers 17K Following Helping you design great experiences with thoughtfully curated UX resources, featuring the experts driving the industry forward.Alba Villamil @albanvillamil
6K Followers 3K Following Sociological User Researcher. Equity Design. Talks ethics at @HmntyCntrd. Dreams of retiring as a food blogger. She/her. Same on BlueSky & LinkedIn.BlatzChatz @BlatzChatz
3 Followers 14 FollowingAbdulah Rashed @MdAbdulahRashed
64 Followers 1K Followingnexinnovat @nexinnovat
2 Followers 47 Following Provide valuable qualitative and quantitative research solutions to make data-informed product decisions & breakthrough technology awareness.محمود @mahmoudxsaid
662 Followers 833 FollowingTanvir Shuvo @TanvirShuvo_01
0 Followers 4 FollowingSaravanakumar Kandasa.. @dezinebee
1K Followers 2K Following UI is not UX #UX #ProductDesign #Madrasters https://t.co/bS8Yv4saeqPink Freud - Est. 201.. @PinkFreudTWalsh
82 Followers 628 Following Pink Freud, The Walsh - The Me Must Go dOn - El Yo debe Seguir - Le Je Doit Continuer𝕏Services And Tech.. @MicrosoftLinced
373 Followers 3K Following I am a top-performing Designer for social networks such as Twitter(X) and LinkeDin, I offer high-quality content for my audienceGiorgio Venturi @gventuri
360 Followers 324 Following Head of Design @transreportuk. He/him. Dad. Tenaciously connecting the dots between human behaviour, culture, technology and services. Opinions my own.babajide.raji @babajide_raji24
1 Followers 33 FollowingSandra Lewis @SandraLewi72340
0 Followers 14 Followingpiwew 🦷 @lawrencqt
209 Followers 474 Following Geekin' out on #MobileDev #UX 🎭 | Bangkit 2023'2 MD graduate :DAshwin Singh @Ashwin_derePu
0 Followers 110 FollowingNalini Sharma @UXDAutie
0 Followers 17 FollowingJay Kay @JanKurpjoweit
41 Followers 531 FollowingMusa Idris @MusaIdris480009
26 Followers 441 FollowingACOVIDCALIPSIS NOW @AcovidcalipsisN
86 Followers 889 Following “All my life I wanted a mission and because of the Covid they finally gave me one" #AcovidcalipsisNow @SoundCloud #donofrionistext #UnclePotomac @GCBAJoshua Moorghen @Moorghs
0 Followers 14 Followingqian h @qianhsen
54 Followers 592 FollowingMoazzam Safdar Randha.. @safdar_moazzam
2 Followers 44 Followingsirchancellor @sirchancellor
87 Followers 364 Following Air quality advocate, parent, researcher, makerSrinag K A @_srinag
10 Followers 31 FollowingAbhishek𝕏 @ElevateDesigner
156 Followers 2K Following Digital Designer and Creative Director, specializing in UI/UX/CX design, brand identity, visual storytelling, and motion graphics to enhance user experiences.Maudy Mabika @MaudyMabika
623 Followers 1K Following『 ᑌ᙭.ᒎᗴƳ�.. @JeyakumarpMe
26 Followers 280 Following Enthusiast in UX Design | Freelancer | Interested to Learn Multi Languages for Getting More Connection without Hesitate! | Trying to Socialize Myself 😅TARGA @TARGA_AI
1 Followers 6 Following TARGA is revolutionizing the leader experience with our AI-powered collaboration enablement platform. learn more: https://t.co/7k3kv5pTvqOlufunmilayo Fati @OlufunmilayoFat
18 Followers 364 FollowingJessica Blasko @JessicaBlasko
1 Followers 3 FollowingContent Archer @ContentArcher
3 Followers 16 FollowingKSD @kiriadjan
26 Followers 44 FollowingKristen Reyes @KRey0625
1 Followers 12 FollowingJohn Guenther @JohnGuenth35936
1 Followers 11 FollowingVee @2418vps
37 Followers 69 FollowingJOSUE @JOSUE851909
34 Followers 775 FollowingZoran Simonovic @ZoranSimonovic6
228 Followers 520 Followingrwoieriioewr @mcmsmcmlhcjx
10 Followers 125 FollowingDesign @thisdesignfucks
0 Followers 6 FollowingVanya Srivastava @VanyaSriv
3 Followers 41 FollowingTheRealOyeniy @therealOy3
25 Followers 126 FollowingBiswas Tapan Kanti @biswastapa82031
40 Followers 313 Following let's have fun. Before that be let's know each other.Jared Spool @jmspool
120K Followers 2K Following Maker of Awesomeness at @CenterCentre – @UIE. Guiding orgs to deliver well-designed products & services. (He/Him) Former @USDS.Nielsen Norman Group @NNgroup
116K Followers 41 Following User advocates offering evidence-based user experience (UX) research, training, consulting. Visit our website for free UX articles. #nnguxNick Finck @nickf
49K Followers 2K Following User experience & product design leader, advisor, coach, + speaker. Founder of @CraftAndRigor. Loves pizza & D&D. Past: Meta, AWS, Deloitte, Ubermind. He/him.Luke Wroblewski @LukeW
217K Followers 83 Following Managing Director, Sutter Hill Ventures, Founder: Polar (Google acquired) Bagcheck (Twitter acquired) Wrote: Mobile First, Web Form Design Pre: NCSA eBay Yahoo!Alan Cooper @MrAlanCooper
44K Followers 2K Following @[email protected] Trying to be a Good Ancestor. Founder of @Cooper, 'Father of Visual Basic,' inventor of design personas, blowhard curmudgeonRosenfeld Media @RosenfeldMedia
69K Followers 17K Following Helping you design great experiences with thoughtfully curated UX resources, featuring the experts driving the industry forward.UX Links @uxlinks
65K Followers 31 Following Massively increase your UX skills and knowledge with our daily resources, tutorials and insights. Join our thriving community and stay ahead in UX.Indi Young (she/her) @indiyoung
20K Followers 778 Following Data Science that Listens. Author of Time to Listen.Vinay Prasad MD MPH @VPrasadMDMPH
287K Followers 4K Following Prof @ucsf, Physician-Scientist, IG @vprasadmdmph @vkprasadlab @plenary_session, YouTube, #vpzd podcast & @Sensible__Med; Views minePANDA @PanData19
53K Followers 1K Following Empowering society through independent thinking and responsible decision making. Subscribe: https://t.co/Irdzl4eechMonal Chokshi @MonalChokshi
2K Followers 294 Following Head of Research @Dropbox. Previously at Lyft, SoundCloud, Intuit, Yahoo, Trilogy. I like people, technology, and good design.Charlie Bilello @charliebilello
595K Followers 144 Following Chief Market Strategist @ Creative Planning Investor | Writer | Reader | Thinker Trying to become a little wiser every day.Youyang Gu @youyanggu
73K Followers 649 Following Data Scientist. Creator of https://t.co/ByO92M3ceQ and https://t.co/k9yZN1fORq. Presenter of unbiased takes. Realist. @MIT '15.el gato malo @boriquagato
72K Followers 204 Following you like to pretend that you don't like bad cats, but deep down, you know you do. prolonged exposure likely to give you toxoplasmosis.VISIT DENVER @visitdenver
129K Followers 2K Following Official Twitter channel for VISIT DENVER. Love The Mile High City? We do too, and we want to tell the world! Show us your love for the city by tagging #denver.James R. (Jim) Lewis @drjimnfl
93 Followers 73 Following Distinguished UX Researcher at @MeasuringU --specialist in usability/UX testing/metrics and VUI design/evaluationNassim Nicholas Taleb @nntaleb
1.0M Followers 2K Following Flaneur: probability (philosophy), probability (mathematics), probability (real life),Phoenician wine, deadlifts & dead languages. Greco-Levantine.Canaan. #RWRIFred Reichheld @FredReichheld
2K Followers 87 Following Bain Fellow, Creator of Net Promoter, Board Member Rackspace and FirstSevice, speaker and author, latest book: The Ultimate Question 2.0Adar Poonawalla @adarpoonawalla
1.4M Followers 86 Following CEO and Owner, @seruminstindia, Chairman, @poonawallafinco, Founder, @CleanCityPune, Passionate about vaccines, horse racing and public health.Star Control @starcontrolgame
21K Followers 31 Following Explore the galaxy, investigate new worlds, contact new civs & battle hostile aliens! Join us on Discord https://t.co/tFFEN37SgEJUS @UXPAJournal
320 Followers 47 Following The Journal of Usability Studies is a peer-reviewed, international, online publication dedicated to promote the practice, research, and education of UXEric Boyles @esboyles
1K Followers 2K Following VP Global Digital Strategy @Medtronic. Into #leadership #digitaltransformation #marketing #healthcare #cx #IoT #AI #ML as #CDO #CMO - All views my ownFake Jakob Nielsen @fakeuseit
239 Followers 132 Following Usability tests, telling people intranets are important, and puppies. https://t.co/eid1iqaENhChristian Rohrer @christianrohrer
914 Followers 327 Following Author, Comp/Cog Scientist, Designer, Researcher, Stanford PhD; led UX teams at Yahoo!, eBay, Move, CDO at McAfee/Intel, VP of Design/Research at Capital OneCatherine Courage @ccourage
2K Followers 225 FollowingJustin Mifsud @justinmifsud
21K Followers 21K Following User Experience (UX) Specialist; Lecturer @UniofHerts; Founder of @UsabilityGeek; Expert Reviewer @SmashingMag. More- https://t.co/JI7dVbRxA6Molly Malsam @MollyMalsam
164 Followers 169 Following User experience researcher, mother of two children who are already smarter than I am, love music and outdoors.UXmas @merryuxmas
2K Followers 319 Following A digital advent calendar for UX folk. Curated by @uxmastery & @thirststudios.cassyrowe @cassyrowe
170 Followers 69 Following Head of UX for @TakeScoop. Nerd, startup aficionado and student of human behavior.Vex @RTHarris_UX
144 Followers 249 FollowingDon Norman @jnd1er
91K Followers 57 Following Design thinker, company advisor, professor, columnist, author, ... Latest book: Design of Everyday Things, Revised and Expanded.Giles Colborne @gilescolborne
6K Followers 564 Following CEO of @cxpartners, Head of Proposition and Practice @soprasteria_UK I help orgs perform better by becoming customer centred. Author of @SimpleAndUsable.Gautam Ghosh @gautamghosh57
60 Followers 95 FollowingUXPA @UXPA_Intl
133 Followers 33 FollowingNet Promoter @NetPromoter
3K Followers 1K Following Net Promoter® is both a loyalty metric and a discipline for using customer feedback to fuel profitable growth in your business.Evolve UX @evolveux
462 Followers 352 Following A design agency focused on creating the next evolution of powerful, user-focused websites and applications. Creating strategic user experience interfaces.Leonardo De La Rocha @delarocha
719 Followers 646 Following Engineer turned pixel pusher turned design exec. Design leadership @spotify. Formerly @intuit. @facebook, @yahooReturnPath from Valid.. @returnpath
15K Followers 4K Following Return Path is now part of Validity. Stay on top of best practices and trends in email deliverability by following @TrustValidity.BetterUserExperience @BUXofficial
1K Followers 591 Following Insights on #UX #UserExperience, #Usability #InternetMarketing #UserTesting #WebDesign #UI #SEO #Marketing by 3 web nerds @littlewingowl, @newman5 & @jennacurryLean UX Conference @leanUXDenver
145 Followers 30 Followingsabrinamach @sabrinamach
332 Followers 292 Following Head of Customer Experience, Product & Design @ ThoughtWorks GermanyMichael Summers @ez2use
258 Followers 4 Followingjamespage @jamespage
526 Followers 574 Following Building and developing remote usability testing toolsForeSee @ForeSee
5K Followers 2K Following Using proven science, we help companies measure customer experience and link improvements to business outcomes. #CX #CustExp #VOCTimothy Whalin 👊 @TimothyWhalin
12K Followers 1K Following UX Designer working at Google. Accessibility advocate, wine-lover, uke player, and foodie-wannabe.AnswerLab @AnswerLab
1K Followers 779 Following Answering #UX challenges with research. Delivering trusted customer insights that help create experiences people love. #UXresearch #UXdesigncxpartners @cxpartners
4K Followers 1K Following cxpartners helps the world’s best companies to become truly customer-centred and thrive. Part of @soprasteria_uk.Larry Freed @larryfreed
4K Followers 4K Following CEO of Give and Take Inc. Former CEO and Founder of ForeSee. Founder of 2nd Stage Partners. Author of Innovating Analytics. https://t.co/Qn4NWrTkGnRobert @baratus2
1K Followers 30 FollowingTim Harford @TimHarford
198K Followers 1K Following Author How To Make The World Add Up (UK) / The Data Detective (US). Cautionary Tales podcast. Undercover Economist at the FT. BBC More or Less. Views my own.Josh Clark @bigmediumjosh
24K Followers 1K Following Founder of Big Medium. UX design leader (design systems, AI, mobile, web, IoT); Designing for Touch author; Couch to 5K creator; Maine's 11th strongest man.@albanvillamil @leeloowrites All behind NDAs. So, sorry, I don't give a shit what you think Jared if I can't validate your methodology myself. The biggest mistake UX made IMO was breaking off from human factors and the strong research culture. Now no one knows anything and management rules all.
My new essay is out in @tabletmag Masking school kids is based on the lowest level of evidence imaginable. Contradicted by data from Spain. It is astonishing we have done this for 2+ years, and run 0 cluster RCTs. History will judge us poorly tabletmag.com/sections/scien…
When the history books are written, we will look worse than our ancestors who survived the great plagues of Europe Because their superstition did not disproportionately harm kids My new essay in @tabletmag tabletmag.com/sections/scien…
Some people like to boost 80 year olds in nursing homes Others like to mask 2-7 year olds I prefer to boost 80 year olds just because I like to do things that actually work But you do you tabletmag.com/sections/scien…
putting this out there bc 1) it’s really important to understand this while looking at all of these covid 19 studies, or any public opinion polling currently happening and 2) it’s relevant to my talk that went up today, for anyone looking for further reading
The problem of confounded variables has affected research in a variety of areas, including social policy (wire vs. terry cloth mothers for monkeys), ergonomic keyboards (split vs. standard), and survey design (labeled vs. unlabeled item response options). ow.ly/toZY50zWDV7
Way too many misleading stories like these based on one day's worth of figures. Wisconsin reported 22 deaths on Wednesday but that was after three very slow days (3, 4, 3) Sunday thru Tuesday, which likely reflected lags because of the 3-day weekend. nbcnews.com/news/us-news/w…
There are still *way* too many stories about big spikes in cases when the cause of those spikes was a big increase in tests. And remember, it's a good thing when states start doing more tests!
People are having trouble with this, so let me explain. If a caseload in a state is constant, and you test more people, you're going to appear to get more cases. If it's declining and you test a *lot* more people, same effect. 7/6
Peter's corrections are spot on but I will say this about him... he is way too polite. The trend of national reporters dripping out stats without context is lazy at best and pandering for apocalypse dollars at worst.
Another mistake is not understanding lags in the data. If someone gets infected, it will likely take ~2 weeks before they get symptoms, get tested, and the test shows up in the data. Yet many articles assume that cases will *instantly* rise when regulations are changed.
It's not a question of innumeracy because the math isn't complicated. It's more in the category of "too good to check", with not bothering to be rigorous when the surface (but perhaps misleading upon even mild scrutiny) interpretation of the data meets a certain narrative.
One basic mistake is in not accounting for tests. If a state doubles its testing it is going to see far more cases. Many articles about big spikes don't even bother noting when they were caused by tests increasing. The math isn't hard. It's a basic failure to provide context.
@DougCollinsUX @MeasuringU has a great quant masterclass I am planning to attend.
@alanklement @MeasuringU I guess Twitter isn’t a medium for reasoned or nuanced discussion. You can take a strong stance without demonizing those who disagree, so I’m not going to mudsling with you. I will just note that your claim is at odds with both classical test theory and item response theory.
@Laghari_UX @JeffSauro @MeasuringU It’s an excellent book! Enjoy!
@jmspool @Pasquale_Stella @MeasuringU @Luis_Parker I think almost all tools fall into this category: Interviews Focus groups Surveys Card Sorting Personas Mental Models Context Scenarios Requirements Frameworks Sprints User Testing All tools that can lead to good design that go horribly awry constantly.
@jmspool @CarolynHermanUX @MeasuringU @Luis_Parker ...and TBH, I don’t really see NPS as part of my UX toolkit, more a tool for marketers etc. I’m far more interested in PURE but I haven’t had enough time with it yet!
Note to self: Don't use an analogy when discussing metrics that @jmspool has a problem with. Very (very) long thread about how NPS is, in many (many) ways not like a scientific measurement of heat. 😂
Does the NPS predict future business metrics? We found some evidence (but not a lot). ow.ly/uMre30lNfo4
@jmspool @Luis_Parker @MeasuringU There have been studies comparing NPS with other satisfaction measures. This one found a pretty strong correlation: link.springer.com/chapter/10.100… …. I don't particularly like NPS, but if all you get are 1s and no 10s, I'm not sure how you can argue it's all noise and no signal.
GREAT #UX metrics article! Highly recommend. ⭐️⭐️⭐️⭐️⭐️ x.com/measuringu/sta…
#UX metrics typically vary between 3–10% depending on the panel, but in some cases can exceed 20%. ow.ly/gQLz30kpwAN