Meta AI’s new “BlenderBot”: The next generation!
Meta AI said a couple of days ago that it released a new version of its advanced BlenderBot chatbot that is able to remember previous interactions and learn from them.
In a blog post, Meta AI researchers said the upgraded chatbot can search the internet for information so it can chat about almost any topic, while improving its conversational skills through natural conversations and feedback “in the wild.”
According to Meta AI, BlenderBot 3 is said to be the world’s first 175 billion-parameter, publicly available chatbot that comes complete with model weights, code, datasets and model cards.
The original BlenderBot, which Meta AI launched two years ago, had the ability to blend skills such as empathy, knowledge and personality into a complete AI system. One year after that, Meta AI launched BlenderBot 2, in which researchers had added a long-term memory capability that enabled it to hold more engaging and sophisticated conversations on virtually any topic.
Meta AI’s long-term goal is to build more realistic AI systems that can interact with humans in more intelligent, useful and safer ways, and to do this it says it must adapt the models that power them to our ever-changing needs.
The unit claims that BlenderBot 3 delivers superior performance to any chatbot because it’s based on its publicly available OPT-175B language model, which is 58 times larger than the model that powered BlenderBot 2.
“Most previous publicly available datasets are typically collected through research studies with annotators that can’t reflect the diversity of the real world,” Meta AI explained.
Through a live, public demo, so far only available in the U.S., BlenderBot 3 can learn from interactions with anyone. The experience it gains from these conversations will enable it to hold longer and more diverse conversations, Meta AI said, and provide more varied feedback. For instance, those who chat with it can provide feedback to each response with a thumbs up or down, specifying what they didn’t like about each negative comment, such as because it was off-topic, rude, spamlike, nonsensical or something else.
BlenderBot 3 also takes steps to address the reality that not everyone who is using it will have good intentions. To that end, it incorporates learning algorithms aimed at distinguishing between helpful and harmful feedback.
“We hope this work will help the wider AI community spur progress in building ever-improving intelligent AI systems that can interact with people in safe and helpful ways,” the researchers said.
The next generation of BlenderBot
As the first in the series of BlederBot was just a toy, the second one was a step forward, with long-term memory and the vocabulary, which had grown to 200k words. And now, BlenderBot 3 has long-term memory capacity and even the ability of self-learning.
That means that the next generation of BlenderBot will possibly have cognitive architecture: knowledge of facts about the environment; being able to learn from interactions with people in real time; models of perception and cognition based on data from external sources; personality and emotions with parameters that can vary depending on circumstances.
In addition, the next generation of BlenderBot will be able to interact with people based on its ability to generate something more than just a preset answer, such as demonstrating a sense of humor.
On the other hand, Google’s Brain Team have announced Imagen, a text-to-image AI model that can generate photorealistic images of a scene given a textual description and DALL·E 2, which is a new AI system that can create realistic images and art from a description in natural language.