New artificial intelligence already identifies objects by sight and touch

Artificial Intelligence demonstrates more and more new opportunities put into it by the human genius, which is truly inherent in the development engineers working in this area. Recent developments in this direction, made by researchers at the Massachusetts Institute of Technology’s Informatics and Artificial Intelligence Laboratory (MIT CSAIL), have revealed a completely new artificial intelligence to the world. Its originality lies in the fact that it can identify various objects simply by looking at their picture, but at this also identifies the sensation of touching them. This means that the AI calls the subject by touching it. According to TNW, researchers added a tactile sensor GelSight to the hand of the already existing KUKA android, developed by Ted Adelson’s team at CSAIL. Then, work was carried out to accumulate tactile experience with artificial intelligence: he was provided with 200 household objects (fabrics, tools, household items) to feel, and each AI described his feelings, conveying his tactile and visual sensations. This procedure was repeated more than 12 thousand times, and already from this data a set of 3 million visual-tactile images, called VisGel developers, was derived. After such training, AI was able to create the external outline of the object only from the tactile data that it reproduces itself by touching the subject under study. The reverse process is also subject to him – by examining the image of the object, to suggest what this object is to the touch. CSAIL graduate student Yunzhu Li, who wrote an article about a novelty in the field of artificial intelligence development, so designated the significance of the latest developments: “Combining tactile and visual sensations can expand the capabilities of the robot and to reduce the amount of data that may be needed to perform tasks related to the manipulation and capture of objects. \

Sam Richards

Add comment

Follow us

Don't be shy, get in touch. We love meeting interesting people and making new friends.