Friday, April 2, 2010

"So close and yet..."

Hmmm... The good news or the bad news? Well here's both.

As you can see, the ladybug2 can now talk directly to Max... But it's green and unhappy. There are two major problems, one which I couldn't have foreseen, the other I'm an idiot for not considering.

First: We were lucky enough not to have the Bayer filters included in Libdc1394v2, to try and decode the RGGB that the ladybug is outputting but as you see it doesn't work as expected. Our theory is that the code is expecting the image to be upright, but as you can see, our image directly out of memory is 90ยบ from where it should be. So why don't we just rotate the image before processing? Well, as it is we are copying the matrix once, from memory, to the outlet. This image is huge, a whopping 4608x1024. That's 6x768x1024. So of course that brings me to the second problem. Under no circumstances have I ever been amazed with the framerate of an incoming image in Max at 1024x768. Let alone 6 of them simultaneously. So is this even a good idea? Perhaps there's just too much visual information to process to be useful at all. Not one to give up too easily, I may have another solution. If we output the raw image into a jit.slab and crunch it all on the GPU (which is what they do at Point Grey if I'm not mistaken anyways), then maybe we can get the performance up to something halfway decent. Definitely open to suggestions.

Finally something to contribute to the Max Community after a long time. Thanks to Rob and Andrei from York and Rand at Intersense. Download at futurecinema.ca/arlab

Follow the instructions in the top corner of the .maxhelp patch to get the dylib installed and get you up and running. Sorry but I think the object only works on OS X 10.5 (Leopard) and up.

Wednesday, March 3, 2010

Looking Back at Almost perfect...


Hey I'm on TV.... ;)

Ladybug Woes on a Mac




http://sourceforge.net/projects/libdc1394/files/

Been working with the Libdc1394 version 2 library thanks to a tip (thanks Louis!) and am trying to get the ladybug working with Max/MSP. The OSX port of Libdc seems fine until you try to capture a series of images and I get a "bus Error". Tried posting to the forums, no luck, but I solved it, it seems there's an error in the "BASENAME" string in the Sprintf function. If you change:
sprintf(filename,"%s-%05d-%d-%d.jpg",BASENAME,i,cam,k);
to
sprintf(filename,"%04d-%d-%d.jpg",i,cam,k);

AND
sprintf(filename,"%s-%05d.raw",BASENAME,i);
to
sprintf(filename,"%04d.raw",i);

Tah-Dah, it works (though it drops all your frames in your current folder... sorry about that). Will try and figure out how to get that running soon, and then, on to getting it running with Max/MSP.

Thursday, April 2, 2009

Wrapping up the Year

The year ends with one of my favorite things (something I'm terrible
at). I haven't had to solder much in my life. I must have seen it
done a hundred times. I even went out an bought a soldering iron for
the AR Lab to swap LEDs for infrared emitters in dollar store
booklights. The picture is of Stefan at Brock showing me how it's
done. He really had the knack but I think I held my own pretty well.
The component is a Parallax RFID reader, I'll post the code I got from
the arduino playground and the Max/MSP patch I've been using from the
forums.

Thursday, January 15, 2009

IASC Media Tools for Interactivity

I've been keeping busy since I've been back in Ontario.  I've been teaching part time at Brock University in St. Catherines.  The course is Media Tools for Interactivity as part of the Interactive Arts and Sciences program.  It's a course on graphical programming languages and peripheral devices framed by a survey of New Media Art  History.  It's teaching students to explore digital art and interactivity as practitioners.  It's loosely based on programs that I took in the Digital Media stream of Fine Arts Cultural Studies at York University though the focus on graphical programming languages as their own entity is an important part of the course.  And of course there will be good fun with Arduino boards.

It's got me thinking about what sort of courses I'd be interested in pursuing.  I'm definitely still interested in taking a course on 3D Modeling and perhaps one on C programming (I'm kind of getting anxious to program for platforms like the iPhone).  But what to do about a Masters or PhD?  While taking more interactive art programs such as ITP in New York sound great, I can't help but think I still want to pursue Augmented Reality as a field of research (both practical and theoretical).  I'm not sure yet what courses are better suited to that kind of research.