Google's DeepMind AI enables robots to perform novel tasks

Source: IANS

Google has demonstrated its first vision-language-action (VLA) model for robot control that showed improved generalization capabilities and semantic (the understanding of words and sentences), and visual understanding beyond the robotic data it was exposed to.

This includes interpreting new commands and responding to user commands by performing beginner-level reasoning, such as reasoning about object categories or high-level descriptions.

The Robotic Transformer 2 (RT-2) is a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalized instructions for robotic control, according to Google DeepMind, the tech giant's artificial intelligence subsidiary.

A robot that can perform multiple tasks

A traditional robot can pick up a ball and stumble when picking up a cube. RT-2's flexible approach enables a robot to train on picking up a ball and can figure out how to adjust its extremities to pick up a cube or another toy it's never seen before.

"We also show that incorporating chain-of-thought reasoning allows RT-2 to perform multi-stage semantic reasoning, like deciding which object could be used as an improvised hammer (a rock), or which type of drink is best for a tired person (an energy drink),” said the team behind it.

The latest model builds upon Robotic Transformer 1 (RT-1) that was trained on multi-task demonstrations.

The team performed a series of qualitative and quantitative experiments on RT-2 models, on over 6,000 robotic trials.

The potential of vision-language models

The RT-2 model shows that vision-language models (VLMs) can be transformed into powerful vision-language-action (VLA) models, which can directly control a robot by combining VLM pre-training with robotic data.

"RT-2 is not only a simple and effective modification over existing VLM models, but also shows the promise of building a general-purpose physical robot that can reason, problem solve, and interpret information for performing a diverse range of tasks in the real -world,” said Google DeepMind.

(Source: IANS)

-Edited for style

For more such updates and news on the go, follow us on

Instagram | YouTube | Facebook

Comments

Post a Comment

Popular posts from this blog

These special glasses of the Chinese police will identify criminals on sight

Image
Image: Twitter Different techniques are used all over the world to catch criminals. A special technology has been developed in China to catch criminals. Chinese police have been given special glasses that will make it easier to catch criminals. These glasses are linked to a central database, where records of all criminals are kept. Whenever a policeman wearing glasses sees a suspect, all his personal information such as name, caste, religion, address, criminal record, etc. is captured on the glasses. Chinese police facial recognition glasses can identify car plates and human faces & more...and automatically match them with police database, to search and arrest anyone considered as enemy of the State. https://t.co/ahXj7T3Fwv pic.twitter.com/ugYep6rkES — Songpinganq (@songpinganq) March 22, 2023 An alarm will sound as soon as the culprit appears When a criminal comes in front of these glasses, it scans it and immediately activates the alarm mode and the message reaches all th...
Read more

These countries are now farming in space, watch the video

Image
Image Source: NASA New delhi date. 2 June 2023, Friday As the population increases in the country, the land for agriculture is getting less and less on earth. Recently, a report from the University of Colorado Boulder has come out, in which it has been said, how farms are rapidly being depleted around the world. Perhaps this is the reason why scientists from some of the world's major countries are turning to farming in space. There is a huge difference between the atmosphere of space and the atmosphere of Earth, but still there is cultivation. In fact, seeds sent into space remain in microgravity and are exposed to large amounts of cosmic rays, a process that greatly accelerates plant growth and transformation. This process is called space mutagenesis. Due to which the plant is ready to face any kind of situation. China is growing many crops China is growing a variety of crops in space. It contains Luan 502 wheat. These wheat seeds are now being brought from space and are als...
Read more

GMT : A wonderful invention to remove the confusion of railways, a village with the time of which the world sets its clock!

Image
History of Time Zone: The clock and our lives are completely intertwined. Ever wondered what would happen if all clocks in the world were set to the same time? So there will be a big mess right? Because the earth is so big that if there is morning in our country, then there will be night, somewhere evening, somewhere afternoon and somewhere different time on this earth. A single place was fixed for each day from which the whole world could set its clock time. Also know why the whole world time is set with GMT? What does GMT stand for Greenwich Mean Time? How was this time zone determined and how did the world determine its day before that? When did the clock start? Clocks were invented as early as the 16th century, and until the 18th century, time around the world was observed and measured based on the sun. But the world got time zones after the Industrial Revolution in Europe in the 18th century. In the early 19th century, local time in cities was determined by the sun. So, differ...
Read more

Why is it necessary for a baby to cry at birth... This is the reason

Image
New delhi date. 26 March 2023, Sunday Do such a question also come in your mind that why a newborn baby cries as soon as it is born, why the baby does not smile. No one knows the true answer to this matter. To get the correct answer to this question, here we will tell you the reason by studying both science and scriptures. Reasons for crying after birth according to medical science According to medical science, when the baby is in the womb of the mother, it is enclosed in a packet and inside that packet there is a special liquid. The baby's lungs are formed but they are not functioning because at that time the baby does not need to breathe through the mouth or nose to survive, so this fluid fills the baby's lungs. When the baby is born, this fluid that keeps it alive in the womb can cause the baby to die. As soon as the baby is born, it is hung upside down by its legs, this causes the fluid in its lungs to come out and the baby starts to breathe. As the fluid comes out of ...
Read more

More than 36 lakh WhatsApp accounts banned at the behest of the Indian government

Image
The news of receiving fake calls through WhatsApp in India is increasing day by day. People are getting voice and video calls from random international numbers and scammers are targeting people. To crack down on such fake numbers, the Indian government has asked WhatsApp to ban accounts that are involved in fraudulent activities. India bans more than 36 lakh WhatsApp accounts Union Telecom Minister Ashwini Vaishnav said during the launch of the Telecom Department's Sanchar Sathi website that more than 36 lakh WhatsApp accounts have been banned in India and WhatsApp is also helping to protect people. Government efforts to stop WhatsApp call scam Union Telecom Minister Ashwini Vaishnav was asked about the government's efforts to curb the growing issue of WhatsApp call scams in the country. In response to a question, he said, "We are actively engaged with WhatsApp and WhatsApp has also agreed with customer protection. All OTT platforms are ready to deregister users who a...
Read more

Now launched the N95 Mask with Wireless Earphones connection

Image
New delhi date. 24 September 2020, Thursday The Covid-19 epidemic has forced people to stay indoors and people have started using various items like UV sterilizers, disinfectants, pulse oximeters, infrared thermometers etc. It also becomes necessary to wear a mask when you go out of the house. Now tech companies are experimenting with masks as well. Hubble Connected has now launched a maskphone. It is equipped with a voice activation feature which means that the user can use Alexa, Siri and Google Assistant. What's so special about this maskphone? The maskphone is basically a facemask, but it has earphones and a microphone connected so the user can listen to the song and attend the call. The company has used elastic neoprene earhooks in the maskphone. It uses medical-grade replaceable PM 2.5 and N95 / FFP2 filters, IPX5 fabric, which can also be washed with water. This mask offers up to 12 hours of playtime once charged. You can attend the call if you want or even enjoy music...
Read more

It was day on the moon but Vikram Lander did not wake up, is Chandrayaan-3 mission complete?

Image
The sun has risen over the moon's south pole and it is hoped that ISRO will re-connect with the lander Vikram and the rover Pragyan. However, no contact has been made with the lander and rover by ISRO so far. ISRO is making all efforts to contact the lander and rover. Some people are also thinking that the lander and rover will no longer be able to communicate. Will there be re-contact with the lander and rover? ISRO has been continuously sending messages to the lander Vikram since September 22. ISRO will continue its efforts to contact him for a few more days. But now somewhere it seems that the success of India's Chandrayaan-3 has come to an end. India has shown as much as it had to show to the world and has collected the information it had to collect. ISRO's mission successfully completed its work Successful landing of Vikram Isro drove the Pragyan rover for 105 meters Vikram lander jumps to show the craters on the moon Confirmation of the presence of essential g...
Read more

Fear of a terrible solar storm could damage the Internet on Earth

Image
Half the country was in darkness for nine hours when a grid failed during Canada's 1989 hurricane. New York: A solar storm is a coronal mass emanating from the sun. It is quite dangerous and harmful. Scientists have recently warned that such a terrible storm will come in the future. This can have a profound effect on the Internet. This means that the entire world's Internet may be shut down or blocked for several days. The study was conducted on the Internet by Sangeeta Abdu Jyoti, a researcher at the University of California. He presented his study to scientists at the Sigcom 2021 Data Communication Congress last week. According to the study of music, there will be less impact on the internet system at the local level. The reason is that it runs primarily on fiber optics. Fiber optics are not directly affected by geomagnetic currents. But it could also have an impact on Internet cable spread around the world. This cable connects different countries of the world. Many count...
Read more

Despite being rejected 39 times, did not give up, eventually landed a job at Google

Image
New delhi date. 27 July 2022, Wednesday "Manjil unhi ko millati hai, jinke sapnomen jan hoti hai, pankho se kuch nahi hota, haunsalo se udan hoti hai," One should be persistent and determined to do any work only if that work changes in its results. This saying has been proved by one person. Many people dream of getting a job in GOOGLE company, but despite hard work and ability, a person gets sad when they don't get a job. Then a person whose efforts will inspire everyone. Tyler Cohen applied for the tech giant job not once but 39 times. He continued his efforts without giving up. Job found on 19 July Tylon Cohen, who lives in San Francisco, shared his efforts in the form of a screenshot with Google when he finally got the job. He made a total of 39 job applications to the company, which were in the mail. Of which he took a screenshot and shared it with Google. Tylan Cohen previously worked as an associate manager at DoorDash. 39 application viral A fine line betwe...
Read more

Like Telegram, Instagram also added a broadcast channel

Image
If you've been active on Instagram for a long time and follow a lot of people, you'll have experienced that a lot of content posted by those people is out of your sight - even if you want to see it. Like Facebook, what we see on Instagram is largely determined by algorithms. Those social sites themselves decide what we like to see. As a result, what we really want to see remains out of our sight. On the other hand, no algorithm works in services like WhatsApp or Telegram. For example, if we join a group in WhatsApp, whatever is posted in it will reach us. Telegram has channel facility. In that too whatever the creator of that channel posts will reach us. It's a different matter that we ourselves don't see everything posted in a WhatsApp group or a particular Telegram channel, but it does reach us. It often happens in Facebook and Instagram that not all the things we are interested in seeing reach us. This is just as bad for us as it is for content creators. Even if th...
Read more