Google's DeepMind AI enables robots to perform novel tasks

Source: IANS

Google has demonstrated its first vision-language-action (VLA) model for robot control that showed improved generalization capabilities and semantic (the understanding of words and sentences), and visual understanding beyond the robotic data it was exposed to.

This includes interpreting new commands and responding to user commands by performing beginner-level reasoning, such as reasoning about object categories or high-level descriptions.

The Robotic Transformer 2 (RT-2) is a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalized instructions for robotic control, according to Google DeepMind, the tech giant's artificial intelligence subsidiary.

A robot that can perform multiple tasks

A traditional robot can pick up a ball and stumble when picking up a cube. RT-2's flexible approach enables a robot to train on picking up a ball and can figure out how to adjust its extremities to pick up a cube or another toy it's never seen before.

"We also show that incorporating chain-of-thought reasoning allows RT-2 to perform multi-stage semantic reasoning, like deciding which object could be used as an improvised hammer (a rock), or which type of drink is best for a tired person (an energy drink),” said the team behind it.

The latest model builds upon Robotic Transformer 1 (RT-1) that was trained on multi-task demonstrations.

The team performed a series of qualitative and quantitative experiments on RT-2 models, on over 6,000 robotic trials.

The potential of vision-language models

The RT-2 model shows that vision-language models (VLMs) can be transformed into powerful vision-language-action (VLA) models, which can directly control a robot by combining VLM pre-training with robotic data.

"RT-2 is not only a simple and effective modification over existing VLM models, but also shows the promise of building a general-purpose physical robot that can reason, problem solve, and interpret information for performing a diverse range of tasks in the real -world,” said Google DeepMind.

(Source: IANS)

-Edited for style

For more such updates and news on the go, follow us on

Instagram | YouTube | Facebook

Comments

Post a Comment

Popular posts from this blog

Nokia wins case against Oppo and OnePlus, can't sell phones in this country

Image
Ahmedabad, 12 July 2022, Tuesday Oppo and One Plus, the smartphone giants that dominate the Indian market, have been hit hard. The companies have lost a lawsuit against Nokia and will no longer be able to sell their phones in Germany. The shocking news came after Nokia's decision in the case. The court has ruled in favor of Nokia in the patent dispute. After this, the smartphones of Oppo and OnePlus have stopped here. Nokia has filed 9 separate cases against Oppo. Oppo and One Plus will not be able to sell 4G and 5G phones in Germany as the patent rights of OPO and One Plus are invalidated in today's verdict. Nokia claims that Oppo and OnePlus violate EP 29 81 103 and EP 32 20 562. This is not the first time Oppo has been shocked by the court. Earlier Oppo was also shocked in the EP 17 04 731 patent case. Now the court said that this patent also belongs to the same family in which the decision has been given earlier by the court. In such a situation, this decision also goes...
Read more

For the first time, NASA is sending a drone helicopter to Mars

Image
New delhi date. Thursday, July 30, 2020 Man has always been experimenting and inventing new things. It has always been interesting to know about the different planets in space. Mars is the most special of these, as it is believed that if there is any planet other than Earth that could be habitable by humans, it is Mars. There is also ample evidence of the existence of water here. The search is still on. The US space agency is launching the Mars mission. The peculiarity of this mission is that for the first time NASA will also send a drone helicopter to Mars along with the rover. For this reason the mission is named Perseverance Mars Rover and Ingenuity Helicopter. According to NASA, the rover will collect information by walking on the surface of Mars while the helicopter will receive information by flying. The Mars rover weighs 1000 kg while the drone helicopter weighs two kg. The rover is also fitted with a Mars Environmental Dynamics Analyzer which will get information about the t...
Read more

Five decades after man's arrival, 'moon trip' difficult, 60 out of 146 missions fail

Image
India tried to land on the moon in 2019 which failed. In 2023, India's space agency ISRO successfully landed on the moon. India is the first country to successfully land on the South Pole of the Moon unscathed. This success of India is also big because so far a total of 146 lunar missions have been launched out of which 60 have failed. Only four countries made a soft landing on the lunar surface According to Dr. Gail Isles of RMIT University, Australia, the Moon is the only celestial body other than Earth where humans have set foot. It also makes sense to go there first as it is our closest object at about four kilometers away. Interestingly, only four countries have made a soft landing on the surface of the moon so far. On the other hand, its South Pole is still mysterious, where only India has been able to reach. So many countries have failed Even Russia, the first country to make a soft landing on the moon 60 years ago, recently failed to land Luna-25 on the moon's sout...
Read more

If you are interested in astronomy due to solar eclipse, let us know about an app to install in your phone.

Image
A cosmological app in the palm of your hand! An exciting event took place in space yesterday - a circular solar eclipse or say 'Ring of Fire' solar eclipses! The spread of the corona virus has disrupted daily life on Earth, but everything in space is moving at a steady pace! Yesterday's solar eclipse was the result of such a fixed, fixed, annual cycle of events! We all know that the various planets in our universe revolve around the immovable sun, these planets have their own satellites. The earth itself rotates on its axis, tilted slightly, and at the same time revolves around the sun. If we talk only about the earth, due to the orbit of the earth around the sun, the motion of the earth on its own axis and the orbit of the moon around the earth, various exciting astronomical events are created. One of them is this kind of annual annular solar eclipse. Such a solar eclipse occurs when the Sun, Moon and Earth are in a straight line, all three on almost the same surfac...
Read more

Voice typing will become easier and faster

Image
Ahmedabad. 11 November 2020, Wednesday With the help of Google Assistant in Gboard, typing can be done without touching the screen. The way we type in all our smartphones also changes over time. With PCs and laptops having relatively large keyboards, we didn't need any of its alternatives, but most people don't like typing on a small screen in a smartphone, even on a small keyboard. That's why tech companies are trying to make smartphone keyboards smarter and easier to use. Keyboards like Google's Gboard and Microsoft's Swiftkey have come a long way in this direction. Adding either of these keyboard apps to your smartphone can make your typing much faster and more convenient, just be prepared to learn new ways of typing by scrolling across different alphabets on the screen without lifting a finger from the keyboard. Without such preparation, voice typing is now becoming more convenient. Many people have a habit of sending voice messages instead of messing aroun...
Read more

Is a solar storm moving towards the earth at a speed of 12 lakh km per hour?

Image
New York, October 16, 2021, Friday With the development of space science, new information about space and planets is coming out. According to the information received, a tremendous solar storm is moving towards the earth. Solar storms could hit Earth in a matter of hours, according to a new US warning. Researchers are divided over what effect this will have on the Earth, but some believe it could have an adverse effect on power supplies, GPS systems and mobile signals. Scientists have warned that Northern Lights from space could also appear in the US and UK. The U.S. National Oceanic and Atmospheric Administration says a solar storm could cause lightning in many parts of the earth. Magnetic force can also be felt in some places. This can also damage the power grid. The storm, which started on October 11, has intensified since October 15. It is moving at a speed of 12 lakh km per hour. The last time such a dangerous storm occurred was in 19. However at that time there was no promoti...
Read more

Solid evidence of flowing water on Mars, the red planet of the Solar System: Images of pebbles and rocks found

Image
- Amazing exploration of NASA's Perseverance rover - Rocks and pebbles found at Castel Henlez, near Jezero Ulcakund, must have been washed up by stormy river floods in the past. Washington/Mumbai: The mysteries and wonders of our solar system, including the infinite universe, are also being discovered. Earth's neighbor and the red planet of the Solar System, Mars, has strong evidence of past flowing water. The Perseverance rover of the American space research organization National Aeronautics and Space Administration (NASA), which is researching on Mars, has found strong evidence of water flowing on the surface of Mars in the past, i.e. millions of years ago. Evidence has been found. Now, based on all these evidences, there is also a strong indication that if there was flowing water on this red planet in the past, there must have been a phase of life there. NASA sources informed that our Perseverance rover has landed in the vicinity of Jezero meteorite on Mars on February ...
Read more

Impact of global warming: The country's last 4,000-year-old iceberg also collapsed

Image
Toronto, Ta. 09 August 2020, Sunday Much of the final iceberg in Canada has collapsed due to warmer climates and rising global temperatures, turning it into vast iceberg islands. An iceberg is a floating piece of ice formed by the erosion of a glacier or glacier from the ground to the surface of the ocean. According to scientists, Canada's 4,000-year-old iceberg on the northwest corner of Ellesmere Island was the country's last intact iceberg by the end of July. Adrian White, an ice analyst at the Canadian Snow Service, found that 43 percent of the images taken by satellite were broken. He said this is an event around July 30 or July 31. White said the iceberg had broken into two huge icebergs as well as smaller ones, and that the iceberg had already begun to float. The largest glacier is about the size of Manhattan i.e. 55 square kilometers and this is 11.5 kilometers long. While its thickness is 230 to 260 feet. He said this is a huge, very large piece of ice. "If a...
Read more

Successful landing of private company Intuitive's Odysseus spacecraft on the South Pole of the Moon

Image
- After 50 years, America again on the lunar soil - Now the future human settlement on the moon will be prepared according to the Artemis program: NASA scientists in the lander Washington: Today America has returned to the moon after 50 years. Today, Thursday, February 23, 2024, at 6:2 pm (US time), the lander Odysseus of America's first private company, Intuitive Machines (Houston), has landed safely on the South Pole of the Moon. The Odysseus lander touched down on the lunar surface at 4:30 a.m. Indian time on Friday. America's space research organization National Aeronautics and Space Administration (NASA) administrator Bill Nelson has expressed his happiness on this historic occasion by showing such enthusiasm. Intuitive Machines Company has developed such a Commercial Lunar Payload Services (CLPES) program with technical and financial support from NASA. NASA's Apollo-17 spacecraft was launched on December 7, 1972. Then, after exactly 13 days of space travel, Apoll...
Read more

What do you know about the world's most poisonous tree growing on the south coast of India?

Image
Chennai, July 30, 2020, Thursday Every plant and herb on earth has some medicinal properties. Life without vegetation is unimaginable. However, in some countries of South East Asia, including India, it has been nicknamed the Suicide Tree because of the poisonous tree called Sarbera odolam. This tree is as dangerous as it looks green and attractive. In addition to its fruits, flowers and leaves, the seeds also contain a toxic element called cerberine which can kill a person instantly. Even a normal dose of it can cause stomach upset, pain, and vomiting. The heartbeat seems to be irregular. In addition, no medication or treatment is effective. It is as if the poison is injected into the body. The most surprising thing is that if one eats the fruit by mistake, the medical examination does not even notice it. Botanists and researchers believe that this is the most dangerous tree in the world. The venom of this tree has been compared to the venom of a cobra. Every month 4 people die from...
Read more