Google's DeepMind AI enables robots to perform novel tasks

Source: IANS

Google has demonstrated its first vision-language-action (VLA) model for robot control that showed improved generalization capabilities and semantic (the understanding of words and sentences), and visual understanding beyond the robotic data it was exposed to.

This includes interpreting new commands and responding to user commands by performing beginner-level reasoning, such as reasoning about object categories or high-level descriptions.

The Robotic Transformer 2 (RT-2) is a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalized instructions for robotic control, according to Google DeepMind, the tech giant's artificial intelligence subsidiary.

A robot that can perform multiple tasks

A traditional robot can pick up a ball and stumble when picking up a cube. RT-2's flexible approach enables a robot to train on picking up a ball and can figure out how to adjust its extremities to pick up a cube or another toy it's never seen before.

"We also show that incorporating chain-of-thought reasoning allows RT-2 to perform multi-stage semantic reasoning, like deciding which object could be used as an improvised hammer (a rock), or which type of drink is best for a tired person (an energy drink),” said the team behind it.

The latest model builds upon Robotic Transformer 1 (RT-1) that was trained on multi-task demonstrations.

The team performed a series of qualitative and quantitative experiments on RT-2 models, on over 6,000 robotic trials.

The potential of vision-language models

The RT-2 model shows that vision-language models (VLMs) can be transformed into powerful vision-language-action (VLA) models, which can directly control a robot by combining VLM pre-training with robotic data.

"RT-2 is not only a simple and effective modification over existing VLM models, but also shows the promise of building a general-purpose physical robot that can reason, problem solve, and interpret information for performing a diverse range of tasks in the real -world,” said Google DeepMind.

(Source: IANS)

-Edited for style

For more such updates and news on the go, follow us on

Instagram | YouTube | Facebook

Comments

Post a Comment

Popular posts from this blog

Five decades after man's arrival, 'moon trip' difficult, 60 out of 146 missions fail

Image
India tried to land on the moon in 2019 which failed. In 2023, India's space agency ISRO successfully landed on the moon. India is the first country to successfully land on the South Pole of the Moon unscathed. This success of India is also big because so far a total of 146 lunar missions have been launched out of which 60 have failed. Only four countries made a soft landing on the lunar surface According to Dr. Gail Isles of RMIT University, Australia, the Moon is the only celestial body other than Earth where humans have set foot. It also makes sense to go there first as it is our closest object at about four kilometers away. Interestingly, only four countries have made a soft landing on the surface of the moon so far. On the other hand, its South Pole is still mysterious, where only India has been able to reach. So many countries have failed Even Russia, the first country to make a soft landing on the moon 60 years ago, recently failed to land Luna-25 on the moon's sout...
Read more

If you are interested in astronomy due to solar eclipse, let us know about an app to install in your phone.

Image
A cosmological app in the palm of your hand! An exciting event took place in space yesterday - a circular solar eclipse or say 'Ring of Fire' solar eclipses! The spread of the corona virus has disrupted daily life on Earth, but everything in space is moving at a steady pace! Yesterday's solar eclipse was the result of such a fixed, fixed, annual cycle of events! We all know that the various planets in our universe revolve around the immovable sun, these planets have their own satellites. The earth itself rotates on its axis, tilted slightly, and at the same time revolves around the sun. If we talk only about the earth, due to the orbit of the earth around the sun, the motion of the earth on its own axis and the orbit of the moon around the earth, various exciting astronomical events are created. One of them is this kind of annual annular solar eclipse. Such a solar eclipse occurs when the Sun, Moon and Earth are in a straight line, all three on almost the same surfac...
Read more

The transmission power of Corona virus sticking to the surface decreases after 5 days - research

Image
London, 10, June, 2020, Wednesday It is common knowledge that the corona virus is spread from person to person through sneezing and nasal and oral droplets, as well as if the corona virus is spread on a plastic metal or other surface. There has been a lot of research on how long the corona virus survives on which surface, but the research done by the University College London in Britain is shocking. According to research published in the Journal of Hospital Infections, corona viruses can live on any surface for up to five days at most. It can spread to a large area within the first 10 hours when the transmissible power of the corona virus, which landed on the surface on the fifth day, was reduced. Observed after 10 hours, it spread to every corner of the ward. During the experiment Corona used a virus to infect artificial plants with a virus for a patient's breath that could not infect a man. Both viruses were then found in a drop of water and left on the bed railing. The viru...
Read more

Meta Accounts Center: Have you checked it out?

Image
Settings for Meta Company's various apps can be done from one place, now adding new features Facebook, Instagram, Twitter, LinkedIn, Snapchat, YouTube... all these social media sites are focused on one or the other. Some have a focus on text posts, some on latest news, some on images, some on professional networking, some on brand promotion, etc. Therefore, the audience of each site is also different. People who are active on social media for a specific purpose often choose a social site that best suits their purpose and stay more active on it. But many people continue to browse all these sites with increasing frequency throughout the day. People doing digital promotion especially for their own or client's business have to be active on all these sites. Of these, if you're active on various sites owned by the original Meta company, it's now easier to connect all those apps and manage their settings. Companies like Google, Apple, Microsoft keep the settings of all th...
Read more

For the first time, NASA is sending a drone helicopter to Mars

Image
New delhi date. Thursday, July 30, 2020 Man has always been experimenting and inventing new things. It has always been interesting to know about the different planets in space. Mars is the most special of these, as it is believed that if there is any planet other than Earth that could be habitable by humans, it is Mars. There is also ample evidence of the existence of water here. The search is still on. The US space agency is launching the Mars mission. The peculiarity of this mission is that for the first time NASA will also send a drone helicopter to Mars along with the rover. For this reason the mission is named Perseverance Mars Rover and Ingenuity Helicopter. According to NASA, the rover will collect information by walking on the surface of Mars while the helicopter will receive information by flying. The Mars rover weighs 1000 kg while the drone helicopter weighs two kg. The rover is also fitted with a Mars Environmental Dynamics Analyzer which will get information about the t...
Read more

Solid evidence of flowing water on Mars, the red planet of the Solar System: Images of pebbles and rocks found

Image
- Amazing exploration of NASA's Perseverance rover - Rocks and pebbles found at Castel Henlez, near Jezero Ulcakund, must have been washed up by stormy river floods in the past. Washington/Mumbai: The mysteries and wonders of our solar system, including the infinite universe, are also being discovered. Earth's neighbor and the red planet of the Solar System, Mars, has strong evidence of past flowing water. The Perseverance rover of the American space research organization National Aeronautics and Space Administration (NASA), which is researching on Mars, has found strong evidence of water flowing on the surface of Mars in the past, i.e. millions of years ago. Evidence has been found. Now, based on all these evidences, there is also a strong indication that if there was flowing water on this red planet in the past, there must have been a phase of life there. NASA sources informed that our Perseverance rover has landed in the vicinity of Jezero meteorite on Mars on February ...
Read more

How were the Himalayas formed? One minute breathtaking video, find out how long it took…

Image
Himalaya : How did our Himalayan mountain range come into existence, do you have any idea? If not then you will find this report very useful. A video is currently going viral on social media, by seeing which you will get an idea of ​​the creation of the Himalayas. India was an island. Then he approached Asia and collided with him. It is claimed that the Himalayas were created by this collision. You will get to see this entire story in a one minute video. When did this process start? India moved towards Asia 8.80 million years ago. India was then a huge island. At that time the world's tectonic plates were very small. When these plates started sliding, they started colliding with each other. It created Mahatapu. The Indian plate collided with the Eurasian plate. It must have created a very intense pressure. The Tethys was a sea in place of the Himalayas This pressure created a mountain range of high peaks. It is said that the Himalayas exist here today. There used to be a sea ...
Read more

Did dinosaurs that could fly in the sky live on earth?

Image
Washington, October 31, Saturday The research of Dr. yanasora research goes beyond the nitanavi information. The dinosaurs of the species called pterosaurs were the first creatures to know the art of flying in the sky. The age called Triassic lasted from 23 to 190 million years ago. Many gigantic animals existed at that time. Fossil scientists are still gathering information about reptiles that can fly in pairs. These dinosaurs preceded the T-Rex, Triceratops and Cretaceous-era dinosaurs. However, according to numerical methods, biophysical models and fossil records, terosaurs could fly superbly 150 million years ago. In the report, Joanna Baker, a professor at the University of Reading, says the pterosaur was indeed a unique creature. Gradually his flying ability was constantly increasing and improving. Scientists have discovered dozens of fossils of pterosaurs that were scattered all over the earth. The fossils of this creature range from sparrows to giraffes. The spread of its ...
Read more

Govt orders social media platforms to remove ads on all fraud loan apps and betting apps within a week

Image
In this age of technology, cyber crimes are also increasing rapidly. Cases of online fraud and scams are coming up every day. Now the government has become strict about online fraud. The central government is constantly taking new steps to curb it. Central government has taken major action on fraudulent loan apps and betting apps. These apps are being banned. On Tuesday, the ministry ordered the removal of illegal loan apps and betting apps. Union Minister Rajeev Chandrasekhar said that we are working on stopping the advertisements of fraudulent loan apps. This is how fraud loan apps are advertised on some platforms. Fraud loan apps ad removal warning The Ministry of Electronic and Information Technology has warned all social media platforms including Facebook, Instagram and Google to remove advertisements of fraudulent loan apps from their platforms within a week. The IT Ministry has made it clear that social media platforms that advertise these apps on their platforms will be held...
Read more

IIT researchers develop real-time underwater marine robot, eases deep-sea surveillance

Image
image : Envato and Twitter Real-time underwater marine robot: Indian Institute of Technology (IIT) Mandi and Palakkad have achieved a tremendous achievement in developing real-time underwater marine robot for underwater surveillance. The function of this robot will be close underwater monitoring and verification. Its level of efficacy would be very high, risk would be extremely low and it would likely be cost-effective, the researchers said. Jagdish Kadian, assistant professor at the Center for Artificial Intelligence and Robotics at IIT Mandi, said that learning about the ocean's internal currents from history led to the conclusion that only by placing instruments on research ships deep can one gain more insight into the ocean. Kadian, a co-author of the study, said that a typical cruise ship stays on the surface for a month or two, limiting the possibility of producing a comprehensive report on the sea. So it has often been said that changes in the sea do not wait for a ship ...
Read more