Can’t Find Your Keys? Ask Your Kinect Where They Are

If you’re prone to misplacing items around the house and also a Kinect owner, computer science researchers at the University of Virginia have an interesting new solution for you. A recent paper from the university details household object tracking system, paired with Microsoft’s Kinect camera, that can accurately keep track of the items you use most, pinpointing their last location within 13 cm.

Kinsight is a non-intrusive tracking system that uses 3D scanning to extract images from the environment and compare them to sample images in order to keep track of the objects most used in key household areas. Over time the system can even learn where a particular object is most likely to be, and what the object is by how you interact with it. Researchers envision a final product where you can simply ask the Kinect where a particular object is within the household and it will accurately pinpoint its location for you.

Instead of tracking every object in the room at all times, the Kinsight system only tracks an object when a human interacts with it, remembering the last location once the action has been completed. Because humans only interact with so many objects at a given time, this method prevents the Kinsight system from being overloaded with a room full of stationary objects.

University of Virginia researchers successfully tested the tracking system in two separate multi-person households. A total of three Kinect cameras were used, one in the kitchen, living room, and dining room, to track common objects like wallets, silverware, and remote controls. Researchers analyzed activity during sessions of cooking and cleaning to test out the accuracy of the tracking software.

Virginia researchers concede that object distance and line of sight limitations may be the biggest problem for the current system – one that could be fixed by adding additional cameras to cover more area. The developers believe the amount of attention Microsoft’s 3D camera has received will push other manufacturers to create more advanced 3D cameras like it in the future.

Corey Cummings: Corey is a graduate of the University of Wisconsin in Madison where he received degrees in English and Creative Writing. He currently lives in Chicago and enjoys alternately obsessing over video games that aren't out yet and crazy gadgets he can't afford.

View Comments (4)

  • Line of sight is a MAJOR limitation. It basically requires that the misplaced object be in the same room as Kinect. When you consider how many rooms are in a house, the odds that Kinect will be in that room are minor. This also presumes that the object ->IS<- in the person's home... and not left out in the car or at work... or dropped somewhere during the day.

    •  @search53 I think I'd still find this very useful. If it isn't in the room with the Kinect, at least you know not to waste time looking there! And if it is in that room, even better. 

      •  @RachelTaylorChi Great point, Rachel. The process of elimination is valuable, especially considering most Kinects are in the living room or family room - that's a large space to look through. I'd be happy just knowing I can avoid the couch cushions!

  • We help you get matched with Best College, Online University, Online College, Community college for online programs and campus programs. We  offer Educational Information about various Education level like Associate degree, Bachelor degree, Masters degree, Doctorate/PhD. It covers vast  array of Study Programs like Business programs, Nursing programs, Psychology programs, Education programs, Medical programs, MBA programs,  IT/Computer programs and many more.. http://www.SchoolandUniversity.com