Tweets
- Tweets, current page.
- Tweets & replies
- Media
You blocked @lmthang
Are you sure you want to view these Tweets? Viewing Tweets won't unblock @lmthang
-
Pinned Tweet
Introducing
#MeenaBot, a 2.6B-param open-domain chatbot with near-human quality. Remarkably, we show strong correlation between perplexity & humanlikeness! Paper: https://arxiv.org/abs/2001.09977 Sample conversations: https://github.com/google-research/google-research/tree/master/meena … https://twitter.com/GoogleAI/status/1222230622355087360 …pic.twitter.com/3xNSV4r4uB
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
Happy
#PalindromeDay 02 02 2020 This is the first time in over 900 years (since 11/11/1111) the date is palindromic no matter the date format. It’s also the 33rd day of the year with 333 days left!pic.twitter.com/0hYP0p6mEaThanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
#MeenaBot@Imthang@GoogleAI These are incredibly interesting to read.pic.twitter.com/paG4E6iQzz
Thanks. Twitter will use this to make your timeline better. UndoUndo -
I chatted with
#MeenaBot about the#coronavirus and her advice is to see a doctor sooner rather than later. I guess it's not a bad one & hope everyone is well! On the other hand, Meena is also excited about technology, especially VR!pic.twitter.com/pKRxfFxp38
Thanks. Twitter will use this to make your timeline better. UndoUndo -
Highly recommend watching this 8-minute video https://youtu.be/STrrlLG15OY on
#MeenaBot & the paper, with details not included the blog such as SSA vs humanlikeness correlation, sample-and-rank, removing cross-turn repetition. (Blog: https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html …)https://twitter.com/CShorten30/status/1222655686980644864 …Thanks. Twitter will use this to make your timeline better. UndoUndo -
Meena was simply a name that
@xpearhead dreamt of, but if you'd like an acronym, here's mine: "May End-to-End Neural-network be AGI"! thanks to all great collaborators, David,@jamie_hall,@nfiedel,@ThoppilanRomal, Zi,@ImAKulshreshtha,@gnemade15,@yifenglou, and@quocleix!https://twitter.com/JeffDean/status/1222253733016268800 …
Thanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
New paper: Towards a Human-like Open-Domain Chatbot. Key takeaways: 1. "Perplexity is all a chatbot needs" ;) 2. We're getting closer to a high-quality chatbot that can chat about anything Paper: https://arxiv.org/abs/2001.09977 Blog: https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html …pic.twitter.com/5SOBa58qx3
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
Implications from the
#MeenaBot project: 1. Perplexity might be "the" automatic metric that the field's been looking for. 2. Bots trained on large-scale social conversations & pushed hard for low perplexity will be good. 3. Safety layer is needed for respectful conversations!pic.twitter.com/WHrcstcgltShow this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
We design a new human evaluation metric, Sensibleness & Specificity Average (SSA), which captures key elements of natural conversations. SSA is also shown to correlate with humanlikeness while being easier to measure. Human scores 86% SSA,
#MeenaBot 79%, other best chatbots 56%.pic.twitter.com/I7NKl2b9Tl
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
#MeenaBot is based on the Evolved Transformer (ET, an improved Transformer) & trained to minimize perplexity, the uncertainty of predicting the next word in a conversation. We built a novel "shallow-deep" seq2seq architecture: 1 ET block for encoder & 13 ET blocks for decoder.pic.twitter.com/Mv2d4Los3k
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
Google Dataset Search is now officially out of beta. "Dataset Search has indexed almost 25 million of these datasets, giving you a single place to search for datasets & find links to where the data is." Nice work, Natasha Noy and everyone else involved!https://blog.google/products/search/discovering-millions-datasets-web/ …
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
My grandpa passed away a few years ago. We didn’t get to say goodbye to him. Yesterday we found out google maps finally drove through his farm and as we were curious going through it, where the road ends, there is my grandpa, just sitting there.
pic.twitter.com/CbwRTkCKrZShow this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
tf.keras in
@TensorFlow 2.1 adds TextVectorization layer to flexibly map raw strings to tokens/word pieces/ngrams/vocab. An image is just a matrix of numbers but text always needs extra work and it‘s cleaner having preprocessing inside the model
https://github.com/tensorflow/tensorflow/releases/tag/v2.1.0 …Thanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
Okay yeah I'm convinced: it's not actually weird to have MT as an example problem, even if it's not most people's end-goal. Someone else pointed out that the datasets are actually available too, which is a big consideration I didn't think of. Thanks all!https://twitter.com/lmthang/status/1215047953989038082 …
Thanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
.
@stanfordnlp people’s#ICLR2020 papers #2—ELECTRA:@clark_kev and colleagues (incl. at@GoogleAI) show how to build a much more compute/energy efficient discriminative pre-trainer for text encoding than BERT etc. using instead replaced token detection https://openreview.net/forum?id=r1xMH1BtvB …pic.twitter.com/lFAr6XYSWx
Thanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
Vim finally usable on a smartphone.https://twitter.com/ValaAfshar/status/1214280917528694784 …
0:31Thanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
Throw back at
#vietaisummit last month, over 500 attendees, renowned speakers@lmthang (Google Brain), CEO@KambriaNetwork Thuc Vu, CMU prof & CEO@TRIAD_Global James Kuffer, Principal scientist@QatarComputing Preslav Nakov,@chipro & many more! Recap: https://facebook.com/notes/vietai/event-recap-vietai-summit-2019-ai-for-the-future/2090687904366925/ …pic.twitter.com/VO0wN21RTN
Thanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
He did wrong, knows it, and has apologised. I forgive Siraj, and I hope you will as well. If you are unsure whether you can forgive, consider your own faults and be grateful they aren’t on the front page of Reddit. Let’s live in a world where imperfect people can grow.https://twitter.com/sirajraval/status/1208952858663669760 …
Thanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
At the start of 2019, I wrote down every lesson I learned throughout the year. Some are personal, others professional. Some are small, others bigs. But they were all learned from experience, not clipped from a book. Here are a few.
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo -
Thang Luong Retweeted
Proof that for Fibonacci numbers F²₁+F²₂+...+F²ᵢ=FᵢFᵢ₊₁
































































































Thanks. Twitter will use this to make your timeline better. UndoUndo
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.