An interesting takeaway from the HELM benchmark is that the @CohereAI base models outperform most other base-models (GPT-3 davinci-1 etc). The models that beat Cohere are instruction tuned. Very curious to see the evaluations that also include Cohere instruct models!

nick frosst Retweeted

Edward Grefenstette

@egrefen

17h

Here's a 🧵 pointing to some of the longer responses on research-y topics from my

@CohereAI

AMA. Questions listed reflect the answers I give, and sometimes don't exactly match the question I was asked. (1/16)

Quote Tweet

Edward Grefenstette

@egrefen

18h

Last month, I did an AMA with @CohereAI, wherein I discuss lofty topics like "does AGI make sense?", or "can we solve language with transformers?", and less lofty ones like which DL framework to use. Check it out to also learn my favourite

flavour. youtube.com/watch?v=WSXm0L

New song out this Friday :)

Quote Tweet

Good Kid

@goodkidband

Jan 23

NEW SONG OUT THIS FRIDAY

Here is the official artwork for our newest single “First Rate Town” coming out on Jan 27th! Artwork by the incredibly talented Gabriel Altrows

Pre-save by voting for the next mayor of First Rate Town (link in bio)

nick frosst

@nickfrosst

Jan 22

Sweet to see people building with our tech!

Quote Tweet

Harish Garg

@harishkgarg

Jan 22

I built a command-line AI chatbot in less than 10 mins using @CohereAI 's new chat endpoint (currently in Alpha) Try it yourself. Here is the code - github.com/harish-garg/co @nickfrosst

nick frosst Retweeted

Luis Serrano

@luis_likes_math

Jan 19

Have you ever wondered how computers understand human language? The answer lies in sentence embeddings, the bread and butter of language models. Check my latest post about it at the

@CohereAI

blog!

txt.cohere.ai

What Are Word and Sentence Embeddings?

Sentence and word embeddings are the bread and butter of language models. Here is a very simple introduction to what they are.

426

nick frosst

@nickfrosst

Jan 18

Oh shit

Quote Tweet

Should we release?

Should we release?

159

Quote Tweet

Okay, our jobs are safe!

#ChatGPT (via @FeraSY1)

196

nick frosst Retweeted

Sara Hooker

@sarahookr

Jan 17

One of the goals of Cohere For AI

@forai_ml

is to create more entry points into machine learning research. This year, something I want to support is more community research projects. Announcing it here, partly as a way to hold myself accountable for my new years resolutions. 🎉

207

It’s been an absolute privilege to get to work with you Joanna! Now go make some AI drug discovery work!!! 🥲

Quote Tweet

Joanna Yoo

@_joanna_yoo

Jan 16

… which means that I made a bittersweet goodbye at @CohereAI

These past three years at Cohere have been beyond amazing - I feel extremely lucky to have joined Cohere early on and witnessed / participated in the growth of this wonderful place.

Show this thread

nick frosst

@nickfrosst

Jan 15

cool blog post on expanding the grounded question answering bot released in

@CohereAI

's sandbox a few months ago! talkingdrums.info/engineering/20 the

@boelger

adds in the question validity verification!

nick frosst

@nickfrosst

Jan 14

Diffusion models exhibit the thatcher effect!

Quote Tweet

Cursed AI

@AI_Cursed

Jan 12

creating upside down images in AI is great, the tool can't handle it. try flipping this image over! #mario #midjourney #stablediffusion #aiart

nick frosst Retweeted

Aidan Gomez

@aidangomezzz

Jan 14

best learning rate

759

nick frosst Retweeted

cohere

@CohereAI

Jan 10

There are big things happening in NLP right now – we’re excited to be at the forefront. Shoutout to

@jon_victor_

for sharing our story and showcasing the broader industry’s strong momentum. 💪 Check out Jon’s article in

@theinformation

theinformation.com

Six OpenAI Rivals Google and Microsoft Are Watching

Microsoft’s big bet on OpenAI, whose ChatGPT software can understand and generate conversational text, is starting to look like a stroke of genius. Microsoft plans to use OpenAI’s tech to improve...

Seems like our command model has done a pretty good job of learning morphology of english! This is honestly my favorite part of building LLMs; i am frequently surprised by what they can do! This new model is coming out soon, try it out at os.cohere.ai/playground/! 11/11

now im not actually a good enough english linguist to know if these made up words have roots related to the definitions the model came up with. But they all feel right to me. Like "karboid" definitely sounds violent and "woined" definitely sounds friendly. 10/11

i would have gone with an explosion for karboid but it is certainly a percussive word. 9/11

woine sounds nice 8/11

soinoir sounds vaguely medical 7/11

i'll try a bunch of different made up words that all have different tones to them, and see what the model thinks they mean when presented in the exact same sentence. Florum definitely sounds kinda silly 6/11

i have always liked this example because it also demonstrates the morphology of english words. Removed from context, "scrom" still sounds like a violent word. So let's see if the model can pick up on morphology / roots / word sound cues as well! 5/11

using "she scromed him with the feather" also results in "hit" 4/11

it turns out Geoff has actually said this enough that you can find it online, so this sentence is probably somewhere in our model's training set, so let's use a different sentence so we are not just testing on the train set. 3/11

I got

's new command model (releasing soon) to write a definition for "scrom" based on that sentence, and just like most people, it picks up that "scrom" means "hit" 2/11

What excites me about this eval is that among base webtext models (not trained on human feedback) Cohere beats Facebook’s OPT with 1/3rd the params. We have a beta command model (trained on human feedback) available now but it’s yet to be evaluated. Stay tuned for new versions!

Quote Tweet

Percy Liang

@percyliang

Jan 3

Announcing Holistic Evaluation of Language Models (HELM) v0.2.0 with updated results on the new @OpenAI, @AI21Labs, and @CohereAI models. HELM now evaluates 34 prominent language models in a standardized way on 42 scenarios x 7 metrics.

Show this thread

nick frosst

@nickfrosst

Jan 2

I definitely can’t read anything close to a book a week, but this year I read: - fire and blood - a world of ice and fire - the Silmarillion - the deficit myth - 3/4 of slaughterhouse five I really enjoyed the fantasy histories; diving deep into fantasy worlds is relaxing :)

nick frosst Retweeted

I'm testing

in #CodeGPT and it's working great! Would you like to add Cohere inside VSCode to improve your code?

@code

#cohere #vscode #codegpt #ai

marketplace.visualstudio.com

Code GPT - Visual Studio Marketplace

Extension for Visual Studio Code - Use the Official OpenAI API inside VSCode

nick frosst

@nickfrosst

Dec 31, 2022

Friendly is what we aim for :) thanks for trying it out!

Quote Tweet

Greg Mallable

@GMallable

Dec 31, 2022

Replying to @CohereAI

Cohere people were very friendly and encouraging to this newbie, def. recommend

new

colab just dropped. Talking representation models and the absolute hodgepodge that is embeddings evaluations.

Quote Tweet

Jay Alammar

@JayAlammar

Dec 20, 2022

Sentence Transformers and Embedding Evaluation with @Nils_Reimers youtube.com/watch?v=apuDey Watch it now on YouTube! Topics: Neural Search, embeddings evaluation, SetFit, @CohereAI's multilingual embeddings, and experience building Sentence Transformers.

nick frosst Retweeted

Shubham Saboo

@Saboo_Shubham_

Dec 14, 2022

Unlock the global market with multilingual AI models. Support 100+ languages and delivers 3X better performance than existing AI models. (A thread)👇🧵

174

very excited to work with you Martin!! :)

Quote Tweet

Aidan Gomez

@aidangomezzz

Dec 13, 2022

I am so thrilled to welcome Cohere’s new President and COO, Martin Kon. Formerly CFO of YouTube, Martin will play a crucial role in helping @CohereAI to empower businesses of all sizes to harness the power of NLP. Welcome to Cohere, Martin. txt.cohere.ai/martin-kon

nick frosst

@nickfrosst

Dec 13, 2022

this hairstyle actually makes

@kaledivergence

a better ml engineer. twitter.com/CohereAI/statu

This Tweet is unavailable.

nick frosst Retweeted

IT’S FINALLY HERE! 🎉

and I are so excited to announce the launch of our

@CohereAI

multilingual text understanding model. This new model is the first to be trained on authentic data. 🇺🇲🇨🇳🏴󠁧󠁢󠁥󠁮󠁧󠁿🇪🇸🇫🇷🇪🇬🇦🇪🇵🇹🇮🇩🇧🇩🇯🇵🇧🇷

txt.cohere.ai

Bonjour. مرحبا. Guten tag. Hola. Cohere's Multilingual Text Understanding Model is Now Available

Develop, test, and experiment with the industry’s first multilingual text understanding model that supports 100+ languages Humans speak over 71001 languages, yet the majority of language models only...

203

Today

and

put out a blog announcing

@CohereAI

's new multilingual embedding model :) It can embed 100 different languages and outperforms models currently available! Multilingual neural semantic search is the future! txt.cohere.ai/multilingual/

nick frosst

@nickfrosst

Dec 7, 2022

we do indeed behest it.

Quote Tweet

Edward Grefenstette

@egrefen

Dec 7, 2022

Ahead of tomorrow’s Zoom AMA, I’ll be doing an AMA on Reddit’s r/iAMA today from 3–5pm GMT, at the behest of my corporate master @CohereAI. Come ask embarrassing or meaningful questions. I’ll answer both kinds.

nick frosst

@nickfrosst

Dec 6, 2022

this is a unique opportunity to ask

@egrefen

about the surprising number of teddy bear t-shirts he owns, or anything for that matter!

Quote Tweet

Edward Grefenstette

@egrefen

Dec 6, 2022

Hi everyone, catch me on Thursday, 12pm EST for an AMA session via Zoom! Sign up here- short.cohere.ai/AMAwithEd Have questions? Drop them here and I will answer them live- forms.gle/RcbhQwbaZCiyZp