Google's DeepMind AI enables robots to perform novel tasks

Source: IANS

Google has demonstrated its first vision-language-action (VLA) model for robot control that showed improved generalization capabilities and semantic (the understanding of words and sentences), and visual understanding beyond the robotic data it was exposed to.

This includes interpreting new commands and responding to user commands by performing beginner-level reasoning, such as reasoning about object categories or high-level descriptions.

The Robotic Transformer 2 (RT-2) is a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalized instructions for robotic control, according to Google DeepMind, the tech giant's artificial intelligence subsidiary.

A robot that can perform multiple tasks

A traditional robot can pick up a ball and stumble when picking up a cube. RT-2's flexible approach enables a robot to train on picking up a ball and can figure out how to adjust its extremities to pick up a cube or another toy it's never seen before.

"We also show that incorporating chain-of-thought reasoning allows RT-2 to perform multi-stage semantic reasoning, like deciding which object could be used as an improvised hammer (a rock), or which type of drink is best for a tired person (an energy drink),” said the team behind it.

The latest model builds upon Robotic Transformer 1 (RT-1) that was trained on multi-task demonstrations.

The team performed a series of qualitative and quantitative experiments on RT-2 models, on over 6,000 robotic trials.

The potential of vision-language models

The RT-2 model shows that vision-language models (VLMs) can be transformed into powerful vision-language-action (VLA) models, which can directly control a robot by combining VLM pre-training with robotic data.

"RT-2 is not only a simple and effective modification over existing VLM models, but also shows the promise of building a general-purpose physical robot that can reason, problem solve, and interpret information for performing a diverse range of tasks in the real -world,” said Google DeepMind.

(Source: IANS)

-Edited for style

For more such updates and news on the go, follow us on

Instagram | YouTube | Facebook

Comments

Post a Comment

Popular posts from this blog

One year into the ONDC system: How far has the e-Cormus initiative come?

Image
The Open Network Core Digital Commerce (ONDC) project was launched in India in April last year. Amazon and Flipkart currently have a duopoly in the e-commerce sector in India and both of these companies are foreign-owned. The ONDC project has been implemented by the Government of India so that various companies and small and large businesses in India can take full advantage of e-commerce and instead of the entire system being in the hands of just one or two companies, it also gets democracy. The way Unified Payment Interface (UPI) has revolutionized online transactions in India. Something similar is likely to happen in the e-commerce sector due to ONDC. After its launch in April last year, the network was seeing 30-40 transactions per day in the month of September , which has now reached 600 transactions per day. Given the prevalence of online commerce in India, this number is still very low. However, the number of merchants connected to the network has increased significantly. Af...
Read more

Is there a relationship between smartphone use and hypertension?

Image
Have you noticed that your own or a family member's behavior has changed in the last few days ? Have you noticed that their temperament has become irritable or awkward in conversation ? It may be that excessive use of smartphones is responsible for it! Various experts around the world are conducting studies to check the possible relationship between smartphone use and hypertension. In this regard , according to a new study published in the European Heart Journal, if the total time spent talking on the phone exceeds 30 minutes per week, it greatly increases the likelihood of high blood pressure. Pay attention that here the talk is only about the conversation on the smartphone! It is different whether the phone is constantly playing games , watching videos or browsing. However, many experts also say that more research is needed in this direction before coming to a definite conclusion. But ' ati sarvatra varjayet ' means that if there is an excess of anything, ...
Read more

Increase in character limit of tweets, now users can tweet in 10,000 characters

Image
New delhi date. 15 April 2023, Saturday Elon Musk is constantly trying to update Twitter. Elon Musk announced in March that he will soon increase the character limit of tweets on Twitter to 10,000. Due to which Twitter has made a big change in its content policy. After the new change, now Twitter users will be able to tweet in 10,000 characters instead of 280. Apart from this, the facility of text formatting will also be made available on Twitter. However, this service will be available only to users who have already subscribed to Twitter Blue. Increase the character limit Experts say that with the increase in character limit on Twitter, people will now be able to express their feelings better and clearly. However, it was not revealed at the time whether the feature would be exclusive or available to general users, after users tweeted at length. But now it has become clear that only Blue subscribers will be able to avail this facility. Twitter said, “We're improving the writi...
Read more

Real-time video sharing has been introduced in WhatsApp

Image
WhatsApp now has the facility to share videos in real time. Currently, the way we can start a chat in WhatsApp and record the voice and send a voice message, or we can turn on the camera from the chat box from WhatsApp itself , capture an image and share it , exactly the same way we can capture a video and share it. Till now we could shoot videos by opening the camera app outside of WhatsApp and then share it in WhatsApp. Now that work can be done directly from WhatsApp. Of course there will be a limit of 60 seconds. The advantage of direct video sharing from WhatsApp is that the video message will also be end-to-end encrypted. This feature has started rolling out.
Read more

Climate change: Fresh water demand increases, river valley system will change, startling fact

Image
New delhi date. 26 November 2022, Saturday If the glaciers located in the high Himalayan areas of the state melt faster in the future due to climate change, it may have serious consequences. Future planning will be done from now on to deal with this problem. Rapidly melting glaciers will change entire ecosystems of lowland river basins, while demand for fresh water continues to rise. A stakeholder meeting on glacio-hydrological modeling and IWRM planning for the Bhagirthi basin and its sub-basins was held on Friday by the Swiss Agency for Development and Cooperation (SDC). SDC is working on 'Strengthening Climate Change and Adaptation in the Himalayas (SCA-Himalaya) Project' during 2020-24. It also includes state directorate of environment protection and climate change. In the meeting, the officials emphasized that the demand for water in all sectors including agriculture, industrial and domestic will increase in the future. So to maintain its continuity, scientific aspects...
Read more

Does a particular chemical cause the locusts to attack the crop?

Image
New York, August 17, 2020, Monday The infestation of locusts in the fields has been on the rise for some time now. The locusts are traveling in millions and attacking the crops of the field, clearing the crops. Locals in Gujarat, Rajasthan, Maharashtra and Uttar Pradesh were not spared. To repel the swarms of locusts, farmers use traditional methods such as playing the plate, playing music, and shouting, but according to a new research, locusts can also be detected with a special type of chemical. Scientists have discovered a chemical released by locusts that causes locusts to form. This chemical is found in various species of locusts, especially in traveling locusts due to climate change. Researchers have named this chemical ૪ vinelanson. It is also known that this chemical comes out of the feet of the locusts. The rest of the locusts detect this chemical through the antenna and feel the smell. According to information published in the journal Nature, this particular chemical attr...
Read more

Moon Mission: Where on the Moon - Where will water be found? Map prepared by NASA

Image
New delhi date. 22 March 2023, Wednesday For the first time, scientists have created a map of water on the moon. In which the possibility of having water on the moon has increased. According to the information, scientists have prepared a map of the presence of water in the moon through NASA's Stratospheric Observatory for Infrared Astronomy. With the help of this map, we have tried to show how the movement of water takes place in the moon. The map of water in the moon that scientists have prepared has focused on the south pole of the moon, i.e. the South Pole. Scientists believe that the creation of this map is a big step in the search for water on the moon. This map is made of the Earth side of the Moon. Experts say that this map is going to be very useful. Scientists presented the map at the 2023 Lunar and Planetary Science Conference. Giving information about the map, the expert said that the mountain can be easily seen in this map and the difference between night and day ...
Read more

Living for 20 years, this seabird flies a total of 3 lakh km in its lifetime

Image
London, September 8, 2020, Tuesday The 6-meter-long-winged albatross will protect fishermen from pirates and illegal fishing at sea. The peculiarity of this bird is that it can fly up to 10,000 km in a single flight. During a long life span of 8 to 20 years, it flies about 3 lakh km. With the flying power of the albatross, London's marine explorers want to catch pirates. The albatross is a special type of bird that can also protect ships if trained. Thus there is an armed force to protect the ship but often the pirates do not even let the smell of attack come to the security but now they will not be able to escape from the albatross. Sea food and especially fishing is a big business in the sea. When fishermen set their nets to catch fish, they catch fish as well as sea creatures and birds. This problem, known as buy-catching in fisheries, kills thousands of birds each year. According to the international rule, by-catching baroque continues at the international border after the ...
Read more

The use of long addresses on YouTube had to be shortened after protests!

Image
If you are a heavy user of YouTube then you must be tired of the plethora of ads. In some videos, we can skip the ads that appear at the beginning after a certain second, but some ads have to be watched all the way through. It also caused an uproar on YouTube last week. Because YouTube platform started showing long ads before starting some videos and such ads could not be skipped. Not only that, before some videos, such 10-10 long ads had to be watched! People fed up with this admara on YouTube took to Twitter and other social platforms to protest against it. Now YouTube has announced that it was just an experiment and has now been discontinued. According to YouTube, this experiment was conducted to see how people respond to long videos by showing more ads at the beginning instead of having ad breaks in between. But after massive public outcry, YouTube has clarified that now each ad will be only six seconds long and only some videos will show multiple ads simultaneously , not all.
Read more

June recorded the fifth highest temperature in 15 years

Image
New York, July 24, 2021, Friday Even though the monsoon started in June this year, it is not wrong for anyone to experience high temperatures. According to a report released by the National Center for Environmental Information, the last six months have seen the highest temperature in 10 years, with June recording the fifth-hottest temperature in 15 years. While the year 2021 is the 5th hottest year in all these years. According to NOA data, the average temperature in June was 0.6 degrees Celsius higher than the average of the 20th century. Temperatures are rising both on land and at sea. The increase in temperature from the surface of the earth is 1.6 degrees higher than the average temperature of the 20th century. The reason for the warm month of June is the high temperature in the Northern Hemisphere during June. In the current year the heat and loo in the U.S. and Canada treated black care. June was also a hot month for North America. For the North American continent, the curren...
Read more