Google's AI based Vision-Language-Action robot ready, capable of performing various tasks


In today's world of technology, many innovations are being discovered every day. Technology is currently developing beyond our thoughts. Google has demonstrated its first Vision-Language-Action (VLA) model for robot control, which can act on many common commands with robotic data and semantic and visual understanding.

What does this model do?

This can include interpreting new commands and acting on users' commands based on a priori logic, such as reasoning about object categories or high-level details.

What is Robotic Transformers 2?

Robotic Transformer 2 (RT-2) is a new vision-language-action (VLA) model that learns from both web and robotics data and translates this knowledge into generic instructions for robotic control. RT-2's flexible approach enables the robot to vary how it works its arms to pick up a cube, another toy, for example.

Work will understand the need of the person

According to one official, incorporating chain-of-thought reasoning allows the RT-2 to perform multi-stage semantic reasoning, such as determining which object can be used as an improvised hammer or which type of energy drink a tired person needs. to do

Successful after 6,000 robotic trials

The model is based on the latest robotic Transformer 1 that was trained on a multi-task demonstration. The team conducted a series of quantitative and qualitative experiments on RT-2 models over 6,000 robotic trials. As the RT-2 model demonstrates, vision-language models can be transformed into powerful vision-language-action models, which can directly control a robot by combining VLM pre-training with robotic data.

What is RT-2?

Google DeepMind's RT-2 is not just a simple and effective modification of existing VLM models, but demonstrates the creation of a general-purpose physical robot that can perform logic, problem solving, and information interpretation to perform a wide range of tasks in the modern world.

Comments

Popular posts from this blog

What does Apple say to care for a soaked phone?

100 km in the last layer of Arctic ice. Long pit scary for the world

Alert! If you do this mistake then understand dead, WhatsApp will be hijacked, then don't say that data is leaked.

Do-Not Disturb Mode in WhatsApp

Are you also tired of slow internet on phone? So make this change in immediate setting, the speed will increase

New beta versions of Android, iOS launched

Nokia won the case against Oppo and OnePlus, cannot sell the phone in this country

App-cab companies hide their secret data from police

Know, how likely is Vikram Lander and Pragyan Rover to be operational again?

Russia's cyber-attack threat to scientists working on corona vaccine: report