Clearing up a robot’s fuzzy memory

MIT researchers developed UQ-DAAAM, a memory system that quantifies a robot's uncertainty about object descriptions by comparing multiple viewpoints and fusing them into more accurate captions, resolving ambiguities for about 92 percent of objects with only two additional captions each. The system improved object description accuracy by 5 percent over the state of the art and produced more accurate answers about objects, their locations, and when they were seen. The work, led by senior author Luca Carlone with co-lead authors Harry Zhang and Nicolas Gorlo, will be presented at the Conference on Neural Information Processing Systems.