Google's DeepMind AI enables robots to perform novel tasks

Source: IANS

Google has demonstrated its first vision-language-action (VLA) model for robot control that showed improved generalization capabilities and semantic (the understanding of words and sentences), and visual understanding beyond the robotic data it was exposed to.

This includes interpreting new commands and responding to user commands by performing beginner-level reasoning, such as reasoning about object categories or high-level descriptions.

The Robotic Transformer 2 (RT-2) is a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalized instructions for robotic control, according to Google DeepMind, the tech giant's artificial intelligence subsidiary.

A robot that can perform multiple tasks

A traditional robot can pick up a ball and stumble when picking up a cube. RT-2's flexible approach enables a robot to train on picking up a ball and can figure out how to adjust its extremities to pick up a cube or another toy it's never seen before.

"We also show that incorporating chain-of-thought reasoning allows RT-2 to perform multi-stage semantic reasoning, like deciding which object could be used as an improvised hammer (a rock), or which type of drink is best for a tired person (an energy drink),” said the team behind it.

The latest model builds upon Robotic Transformer 1 (RT-1) that was trained on multi-task demonstrations.

The team performed a series of qualitative and quantitative experiments on RT-2 models, on over 6,000 robotic trials.

The potential of vision-language models

The RT-2 model shows that vision-language models (VLMs) can be transformed into powerful vision-language-action (VLA) models, which can directly control a robot by combining VLM pre-training with robotic data.

"RT-2 is not only a simple and effective modification over existing VLM models, but also shows the promise of building a general-purpose physical robot that can reason, problem solve, and interpret information for performing a diverse range of tasks in the real -world,” said Google DeepMind.

(Source: IANS)

-Edited for style

For more such updates and news on the go, follow us on

Instagram | YouTube | Facebook

Comments

Post a Comment

Popular posts from this blog

Five decades after man's arrival, 'moon trip' difficult, 60 out of 146 missions fail

Image
India tried to land on the moon in 2019 which failed. In 2023, India's space agency ISRO successfully landed on the moon. India is the first country to successfully land on the South Pole of the Moon unscathed. This success of India is also big because so far a total of 146 lunar missions have been launched out of which 60 have failed. Only four countries made a soft landing on the lunar surface According to Dr. Gail Isles of RMIT University, Australia, the Moon is the only celestial body other than Earth where humans have set foot. It also makes sense to go there first as it is our closest object at about four kilometers away. Interestingly, only four countries have made a soft landing on the surface of the moon so far. On the other hand, its South Pole is still mysterious, where only India has been able to reach. So many countries have failed Even Russia, the first country to make a soft landing on the moon 60 years ago, recently failed to land Luna-25 on the moon's sout...
Read more

Nokia wins case against Oppo and OnePlus, can't sell phones in this country

Image
Ahmedabad, 12 July 2022, Tuesday Oppo and One Plus, the smartphone giants that dominate the Indian market, have been hit hard. The companies have lost a lawsuit against Nokia and will no longer be able to sell their phones in Germany. The shocking news came after Nokia's decision in the case. The court has ruled in favor of Nokia in the patent dispute. After this, the smartphones of Oppo and OnePlus have stopped here. Nokia has filed 9 separate cases against Oppo. Oppo and One Plus will not be able to sell 4G and 5G phones in Germany as the patent rights of OPO and One Plus are invalidated in today's verdict. Nokia claims that Oppo and OnePlus violate EP 29 81 103 and EP 32 20 562. This is not the first time Oppo has been shocked by the court. Earlier Oppo was also shocked in the EP 17 04 731 patent case. Now the court said that this patent also belongs to the same family in which the decision has been given earlier by the court. In such a situation, this decision also goes...
Read more

For the first time, NASA is sending a drone helicopter to Mars

Image
New delhi date. Thursday, July 30, 2020 Man has always been experimenting and inventing new things. It has always been interesting to know about the different planets in space. Mars is the most special of these, as it is believed that if there is any planet other than Earth that could be habitable by humans, it is Mars. There is also ample evidence of the existence of water here. The search is still on. The US space agency is launching the Mars mission. The peculiarity of this mission is that for the first time NASA will also send a drone helicopter to Mars along with the rover. For this reason the mission is named Perseverance Mars Rover and Ingenuity Helicopter. According to NASA, the rover will collect information by walking on the surface of Mars while the helicopter will receive information by flying. The Mars rover weighs 1000 kg while the drone helicopter weighs two kg. The rover is also fitted with a Mars Environmental Dynamics Analyzer which will get information about the t...
Read more

If you are interested in astronomy due to solar eclipse, let us know about an app to install in your phone.

Image
A cosmological app in the palm of your hand! An exciting event took place in space yesterday - a circular solar eclipse or say 'Ring of Fire' solar eclipses! The spread of the corona virus has disrupted daily life on Earth, but everything in space is moving at a steady pace! Yesterday's solar eclipse was the result of such a fixed, fixed, annual cycle of events! We all know that the various planets in our universe revolve around the immovable sun, these planets have their own satellites. The earth itself rotates on its axis, tilted slightly, and at the same time revolves around the sun. If we talk only about the earth, due to the orbit of the earth around the sun, the motion of the earth on its own axis and the orbit of the moon around the earth, various exciting astronomical events are created. One of them is this kind of annual annular solar eclipse. Such a solar eclipse occurs when the Sun, Moon and Earth are in a straight line, all three on almost the same surfac...
Read more

Gaganyaan's four astronauts are 400 km from Earth. He will go far and see the universe

Image
- The first leg of the space journey: the countdown begins All four are fighter pilots of the Indian Air Force and have extensive experience of two to three thousand hours of flying modern technology aircraft. - Astronauts will remain in space for 72 continuous hours in their main crew module Thumba/Mumbai: Today, February 27, 2024, Tuesday will be an important day in the history of India's space research. All India's eagerness to know who are the astronauts of Gaganyaan project and their names etc. details is over today. Prime Minister Narendra Modi today announced the names of the first four astronauts of India's ambitious Gaganyaan project at the Indian Space Research Organization's (ISRO) Vikram Sarabhai Space Center (VSSC--Thumba). All four Gaganyaan astronauts are Indian Air Force fighter pilots. All four astronauts have extensive experience of 2,000 to 3,000 hours flying various types and advanced technology aircraft of the Indian Air Force. The names of t...
Read more

A sign that life is possible on Mars! Lake found below the surface

Image
New delhi date. 30 September 2020, Wednesday A new update on the search for life on Mars has been revealed. The US space agency NASA has claimed that scientists have discovered three lakes beneath the surface of Mars. Two years ago, scientists discovered a large reservoir beneath the icy surface of Mars. Saltwater lakes have been found before A paper in the environmental magazine Nature Astronomy claims that researchers have discovered three lakes beneath the surface of Mars in addition to the previously discovered saltwater lake. Radar data from the European Space Agency has been used for this discovery. The lake is spread over 75,000 square kilometers The report cites a paper by Elena Patinelli of the University of Rome. "We have found a reservoir below the icy surface but we have also found three other lakes," it said. The lake is spread over 75,000 square kilometers. The largest lake is 30 kilometers long, while the three smaller lakes are only a few kilometers wide....
Read more

Be careful!! Woman lost eyesight due to excessive use of smartphone

Image
Image: Envato Smartphone has become a necessity of everyone nowadays. But do you know that you can also lose your eyesight due to excessive use of smart phones. Recently one such case has come up. A woman used to use smart phone excessively for a long time. Due to this he has lost the vision of his eyes. The doctor who studied the case gave this information himself. He said this disease is called smartphone vision syndrome. However, it can be avoided. The doctor made many tweets about this one after the other. The doctor said that when the woman wakes up late at night, suddenly her vision has stopped. He also started having trouble reaching the washroom. Doctor Sudhirkumar said that the woman then approached the doctor. The eye specialist told her some remedies after which the woman benefited. The name of this female patient was Manju. She even quit her job as a beautician to take care of her son. After that he had this kind of problem. She said that she used to use the mobile pho...
Read more

The mystery of the world's largest 'red desert', formed 13000 years ago, is solved

Image
Image Twitter Earth Largest Desert Mystery Solved By Scientists: Scientists have solved the mystery of the world's largest 'red desert'. Shocking information about his age has come to light. This desert is part of the Sahara Desert and is in Morocco, Africa. In Morocco it is also called the Hill of Lala Laliya. This desert was formed about 13 thousand years ago The age of this largest and most complex desert on Earth has been calculated by scientists. This desert is about 100 meters high and 700 meters wide. According to scientists about its age, this desert must have been formed about 13 thousand years ago. It was the same for the first 8,000 years, but then its shape began to grow rapidly. A Wonderful 3-Night Camel Trek In Merzouga Sahara Desert 3 Nights Camel Trekking Sahara Merzouga is one of the best Morocco Camel trekking options for those who want to feel the magic of the Sahara Desert and live in the desert for several days as nomads. https://t.co/wDEHRWngL2 ...
Read more

Voice typing will become easier and faster

Image
Ahmedabad. 11 November 2020, Wednesday With the help of Google Assistant in Gboard, typing can be done without touching the screen. The way we type in all our smartphones also changes over time. With PCs and laptops having relatively large keyboards, we didn't need any of its alternatives, but most people don't like typing on a small screen in a smartphone, even on a small keyboard. That's why tech companies are trying to make smartphone keyboards smarter and easier to use. Keyboards like Google's Gboard and Microsoft's Swiftkey have come a long way in this direction. Adding either of these keyboard apps to your smartphone can make your typing much faster and more convenient, just be prepared to learn new ways of typing by scrolling across different alphabets on the screen without lifting a finger from the keyboard. Without such preparation, voice typing is now becoming more convenient. Many people have a habit of sending voice messages instead of messing aroun...
Read more

Is a solar storm moving towards the earth at a speed of 12 lakh km per hour?

Image
New York, October 16, 2021, Friday With the development of space science, new information about space and planets is coming out. According to the information received, a tremendous solar storm is moving towards the earth. Solar storms could hit Earth in a matter of hours, according to a new US warning. Researchers are divided over what effect this will have on the Earth, but some believe it could have an adverse effect on power supplies, GPS systems and mobile signals. Scientists have warned that Northern Lights from space could also appear in the US and UK. The U.S. National Oceanic and Atmospheric Administration says a solar storm could cause lightning in many parts of the earth. Magnetic force can also be felt in some places. This can also damage the power grid. The storm, which started on October 11, has intensified since October 15. It is moving at a speed of 12 lakh km per hour. The last time such a dangerous storm occurred was in 19. However at that time there was no promoti...
Read more