3D California

We had several questions lately, about the use of QR Codes and how it is similar or different to usual augmented reality markers. A couple of elements here may help understand better the topic.

QR Codes are used to spread strings, like URLs

What is a QR Code?

Characters in a text can be coded as bits – zeros and ones – that can then be printed as black and white. Following a specific pattern, we can encode a full string of characters as a set of small black and white squares. This is QR Code (see one example in the picture)

If you want to read a QR Code, some mobile applications will help you do that. Your cell phone camera will read a QR Code and output a string (usually the URL of a website you may visit). Such an app will execute a 2D image analysis, finding the 4 corners of the QR Code which are always the same, and deducing the position of all the squares in the QR Code. There’s no 3D computing, only 2D image analysis.

QR Code or AR Marker?

A QR Code is not an augmented reality (AR) marker. They can look quite the same, but usually AR markers have fewer black and white squares and they are bigger. The aim of AR markers is not to convey a string. An AR application will have the position and orientation of the marker analyzed by a camera, in 3D. The computation is very different. With a QR Code, we read the value of the black and white squares but we don’t assess its position, and we want it to be still during the computation. With AR markers, we recognize a known marker in a set of previously learned ones, plus we get its position and orientation in real time as it moves. Then we usually play interactive 3D animations in real time according to the very position of the marker.

This is an AR Marker with its position outlined in red

Why would a QR Code not be a good AR marker?

A QR Code is usually small. Therefore, the camera needs to be close if we want to read the coded string. The QR Code reading algorithm is very sensitive to movement. Once you stay still for a short moment, and the coded string is recognized, the QR Code has done its job. You don’t want to track it while moving.

AR markers are usually bigger and can be easily tracked with good augmented reality solutions. You don’t have to read or decode it. All you need is to recognize it and then track its movements to render interactive 3D animations accordingly, and in real time. Recent augmented reality advanced solutions have been enabling Markerless Tracking, which does not exactly mean there is no marker at all, but lets us use any image as a marker, like the logo of a company, or a picture, instead of a black and white AR Marker.

What if I want to use a QR Code?

There are plenty of solutions, for example, you could have your Mobile demo downloadable online, and use a QR Code to spread the URL. The actual demo could use any other marker to work with.

Thank you again, and we hope you will have plenty of ideas for projects using computer vision and natural interface technologies. And don’t forget … Zest you ideas with 3D !

Surimpose information from computer to visual fied in real time become a reality in Japan. The goal is to improve and enriched the shopper experience. Several firms are testing such devices.
Toppan Printing Co Ltd provide a dedicated terminal, allowing for example to improve signage and items information, or even to locate a store around. It’s very simple : the consumer has just to show his product in front the Terminal cam, which recognize the product package and return a 3D augmented display of the product with its description.
Supplementary application making the link between physical and virtual world : the QR code technology
You can shoot the QR codes with your mobile phone and you have just to show QR at camera (the one of the Toppan dedicated terminal) to get, some samples of associated product.

Other example with Sony Music Communications Inc and Sky&Road Co Ltd, they propose an “interactive show-window”; you have just be on stand in front the terminal (fitted with cam ) and a virtual image (representing a pattern or decoration…) is surimposed on the real one of you.

Finally, with the two previous companies, we note the “Magic mirror” which can be a major innovation in field of clothing.
Imagine you’re wearing a long sleeve shirt and you want to know what you would look like with short sleeves shirt; so you have just to be on stand in front of the mirror and the computer generate a nude pair of arms; we realize easily the scope such applications in clothing area and elsewhere.
the actual application are developped with the AR development kit of Total Immersion.