Can’t Find Your Keys? Ask Your Kinect Where They Are

BY: | June 11, 2012

If you’re prone to misplacing items around the house and also a Kinect owner, computer science researchers at the University of Virginia have an interesting new solution for you. A recent paper from the university details a household object tracking system, paired with Microsoft’s Kinect camera, that can accurately keep track of the items you use most, pinpointing their last location within 13 cm.

Slide image for KinsightKinsight is a non-intrusive tracking system that uses 3D scanning to extract images from the environment and compare them to sample images in order to keep track of the objects most used in key household areas. Over time the system can even learn where a particular object is most likely to be, and what the object is by how you interact with it. Researchers envision a final product where you can simply ask the Kinect where a particular object is within the household and it will accurately pinpoint its location for you.

Instead of tracking every object in the room at all times, the Kinsight system only tracks an object when a human interacts with it, remembering the last location once the action has been completed. Because humans only interact with so many objects at a given time, this method prevents the Kinsight system from being overloaded with a room full of stationary objects.

University of Virginia researchers successfully tested the tracking system in two separate multi-person households. A total of three Kinect cameras were used, one in the kitchen, living room, and dining room, to track common objects like wallets, silverware, and remote controls. Researchers analyzed activity during sessions of cooking and cleaning to test out the accuracy of the tracking software.

Virginia researchers concede that object distance and line of sight limitations may be the biggest problem for the current system – one that could be fixed by adding additional cameras to cover more area. The developers believe the amount of attention Microsoft’s 3D camera has received will push other manufacturers to create more advanced 3D cameras like it in the future.

  • Facebook
  • Twitter
  • LinkedIn
  • Reddit
  • StumbleUpon
Corey Cummings

Corey Cummings

Corey is a graduate of the University of Wisconsin in Madison where he received degrees in English and Creative Writing. He currently lives in Chicago and enjoys alternately obsessing over video games that aren't out yet and crazy gadgets he can't afford.

COMMENTS:

Post comment as twitter logo facebook logo
Sort: Newest | Oldest
search53 5 pts

Line of sight is a MAJOR limitation. It basically requires that the misplaced object be in the same room as Kinect. When you consider how many rooms are in a house, the odds that Kinect will be in that room are minor. This also presumes that the object ->IS<- in the person's home... and not left out in the car or at work... or dropped somewhere during the day.

RachelTaylorChi 19 pts

 search53 I think I'd still find this very useful. If it isn't in the room with the Kinect, at least you know not to waste time looking there! And if it is in that room, even better. 

jennifer beese 40 pts

 RachelTaylorChi Great point, Rachel. The process of elimination is valuable, especially considering most Kinects are in the living room or family room - that's a large space to look through. I'd be happy just knowing I can avoid the couch cushions!