IT news

ChatGPT has learned how to control robots and drones. This is already starting to scare. (2 videos)


Microsoft has expanded the capabilities of ChatGPT foroperated multiple platforms such as robotic arms, drones and assistant robots. In one experiment, an AI was asked to take a selfie from a drone, and ChatGPT directed the drone to a mirror to take a photo with the camera. In such a situation, willy-nilly, you begin to remember the movie "Terminator" and Skynet.

Microsoft believes that ChatGPT can simplifythe process of programming commands to control various robots such as mechanical arms and drones. During the experiment, the researchers previously indicated to the neural network which functions from the high-level library could and could not be used. As usual with ChatGPT, in case of ambiguous requests, he began to ask clarifying questions, and then synthesized complex code to control the machine. Interestingly, for the AI ​​system, it was not so important where the controlled robot works: in reality or in a simulation.


As a result, the chatbot coped with all the settasks. For example, one of the tasks was to lay out the Microsoft logo from colored wooden cubes using a robot arm, and the other was to get a filming drone to take a selfie in the mirror. Both were completed without error.


While research shows the potentialChatGPT in robotics, the approach still has a major drawback: a chatbot can only write computer code for a robot based on an initial "hint" or text query that a human gives it. That is, a “curator” will inevitably be required, who will explain in detail to AI the mechanisms of the application programming interface.

Source: microsoft