Mutable @bemutable

We pressure test and accredit the quality and reliability of your generative AI product on realistic scenarios and use cases to help you win user trust bemutable.io Joined January 2024

Tweets

39
Followers

20
Following

22
Likes

34

Chase Reid @perksofitall

a year ago

"Initiatives to standardize rigorous evaluation protocols and tools, including third-party systems that enable unbiased outside auditing of AI systems, will bolster accountability and transparency." @bcgx_ identifying the indispensability of @bemutable forbes.com/sites/sylvaind…

0 2 1 142 0

Mutable @bemutable

a year ago

👋

Mike Taylor @hammer_mt

a year ago

👋

0 1 1 1K 0

0 2 3 413 1

Mike Taylor @hammer_mt

a year ago

I wonder if there's some sort of business to be made creating a regularly updated private benchmark.

Aravind Srinivas @AravSrinivas

a year ago

I wonder if there's some sort of business to be made creating a regularly updated private benchmark.

18 18 338 72K 47

0 1 1 1K 0

Aravind Srinivas @AravSrinivas

a year ago

If there’s anything that needs to be closed source and secret and run only by a few trusted capable people, it’s good high quality evals. The closed nature is primarily to ensure training datasets don’t get contaminated. The “few” is to ensure we don’t have noise and low quality…

18 18 338 72K 47

Chase Reid @perksofitall

a year ago

@PaulMcLaughlin_ and I are building @bemutable because generative AI is notoriously unpredictable, enterprises have low risk appetites, and you need to overcome that in order to sell to them. And testimony/self-assessment aren’t robust and credible. medium.com/bemutable/pros…

1 2 9 172 0

Paul McLaughlin @_PaulMcLaughlin

2 years ago

The reality of generative AI is that it often makes mistakes, just like humans! But why would AI startups allow that to cause hesitancy for users considering adoption? Why would you price based on usage when you could price based on successful usage? Mutable validates outcomes.

Chase Reid @perksofitall

2 years ago

1 7 13 4K 0

1 3 7 499 0

Chase Reid @perksofitall

2 years ago

Seat-based pricing arose from software that (1) facilitated an outcome, but didn't promise or produce it (2) didn't carry the inherent propensity to underwhelm on or undershoot that promise. Software is evolving. Your pricing should, too. We can help @bemutable. DM me!

0 2 4 137 0

Chase Reid @perksofitall

2 years ago

Building in the chat/copilot space, think LLMs complicate pricing, and unsure what to do about it or how to resolve that dilemma? Probably a good sign that we should be talking. DM me to chat or, better yet, let’s hop on Zoom: calendly.com/chase-baseflow…

0 1 3 63 0

Chase Reid @perksofitall

2 years ago

Some pieces/people that have inspired our thinking here: sarahtavel.com/p/ai-startups-… from @sarahtavel batteryventures.substack.com/p/rethinking-s… from Jason Mendel and Patrick Hsu of @BatteryVentures towardsdatascience.com/navigating-the… from @koconder

1 1 3 808 0

Chase Reid @perksofitall

2 years ago

Much has been said and written about the evolution in business models and pricing that generative AI will enable and necessitate. Very little has been concretely offered about what evolution will entail. We think the answer is intuitive: medium.com/bemutable/saas…