You can now train your own decision model in our platform AC2! Jev-like models, custom fit for your use case :)
We implement decision models through a language-model backbone with a small learned output layer called a decision head. The backbone processes the input, question, and answer choices, and the head produces scores which are softmaxed to produce a probability distribution over answer choices.
Our software interface makes it easy to add a variable-sized decision head to frontier open-weight models. Choose any open source model, and train it as a decision model using Brier loss or cross-entropy loss. Training updates both the decision head and the language backbone.
We tried it on 50k sampled training datapoints from the Civil Comments dataset, starting from Perplexity’s pplx-decider-v1-27b, and F1 for detecting toxic comments increased from 0.482 to 0.677 on 20k sampled eval datapoints. The training job took less than an hour on four B300 GPUs.
Reach out to get started with your own classification task: docs.appliedcompute.com/platform/train…
🏆CAEDRELS WORLDS GIVEAWAY 2024🏆
30 PRIZES INCLUDING FULLY SIGNED WORLDS JERSEYS, 3000EURO GAMING PC AND MANY MORE
🌐Worldwide🌐
CLICK THE LINK BELOW TO ENTER SUPER EASY JUST FOLLOW THE STEPSSSSSSSS
caedrelworldsgiveaway.com
1.1M Followers 64 Followinghttps://t.co/A9eTFq6Xbx
https://t.co/3RHK5vqQo7
Posts are not investment advice or an advertisement for investment services. See https://t.co/nX2FtaLE06.
43K Followers 1K FollowingCEO and co-founder of @coreauto
former VP of RL @ OpenAI : reasoning models, o3, o1, GPT4, ChatGPT, Codex, RL for robots
cautious AI optimist
16K Followers 944 FollowingSenior Director & RS @Meta + Visiting Prof NYU | OG in LLMs | Pretrain+Finetune in 2008+ | 157k+ citations | Current: Self-Improving & Co-Improving AI