Hi all,

I ported the wiigee 3D accelerometer gesture recognition library to android. This lib lets you make 3D gestures in the air using an accelerometer enabled device. Currently you need to use buttons to check for gestures and gestures can't be saved, but it's a start . For more info check the wiigee site.

I've tested it with a wiimote and the OpenIntents.org SensorSimulator and it seems to work. But I get an ANR when the lib is analyzing the data. But this happens in andgeetest I suspect it's not an andgee problem but an andgeetest problem. Probably the analyzing should be done in a seperate thread.

see: http://code.google.com/p/andgee/

Great! Thanks

I contacted the developers of wiigee and they have some interesting stuff planned, which will definately be part of andgee.

I'll have to buy some compatible bluetooth adapter...
I tried some time ago to do it with one little usb adapter, but unluckily it wasn't compatible.

You have to find the bleusoleil bleutooth stack.

hey mr. snowflake,

great library you have there. In the first place I had some trouble with the HardwareProvider that stores the properties. Is your andgee build for a 0.9 Android SDK? Anyway I changed some calls and it works on 1.0 now.

Now that the app runs, I am curious how to use it. I connected to the SensorSimulator Tool
(that was running on another machine) and created some easy input while holding the "T" Key.

On logcat:
----
10-31 15:18:04.362: INFO/Andgee.AccelerationStreamAnalyzer(172): Training started!
10-31 15:18:04.393: INFO/AndgeeTest(172): StateReceived learning
10-31 15:18:06.782: INFO/Andgee.AccelerationStreamAnalyzer(172): Finished recording (training)...
10-31 15:18:06.782: INFO/Andgee.AccelerationStreamAnalyzer(172): Data: 5
10-31 15:18:14.501: INFO/Andgee.AccelerationStreamAnalyzer(172): Recognition started!
10-31 15:18:14.501: INFO/AndgeeTest(172): StateReceived Recognizing
10-31 15:18:16.231: INFO/Andgee.AccelerationStreamAnalyzer(172): Finished recording (recognition)...
10-31 15:18:16.241: INFO/Andgee.AccelerationStreamAnalyzer(172): Compare gesture with 0 other gestures.
10-31 15:18:16.241: INFO/Andgee.AccelerationStreamAnalyzer(172): Recognizing gesture...
10-31 15:18:16.241: INFO/AndgeeTest(172): StateReceived Unknown 0
10-31 15:18:16.251: INFO/Andgee.AccelerationStreamAnalyzer(172): ######
10-31 15:18:16.251: INFO/Andgee.AccelerationStreamAnalyzer(172): No gesture recognized.
10-31 15:18:16.251: INFO/Andgee.AccelerationStreamAnalyzer(172): ######
----

I do worry a bit about "Compare gesture with 0 other gestures."
It says that all the time. Is it for my bad training or could there be a programatical problem behind it? Maybe I am unsing the wrong sensors for training.

It somewhat works now, but the lib doesn't support loading and saving of gestures. I mailed the original developer and he said a newer version will support saving and loading, so I stopped developing this version. The recognition isn't 100%, but it was a start... .

thanks for pointing that out!
I am working on multimodal application developement on android,
that's why this lib is very interesting for me.

MrSnowflake wrote:It somewhat works now, but the lib doesn't support loading and saving of gestures.

Do you mean that it runs but can't yet recognize gestures? Or is there a predefined set of gestures that i could use for testing?

MrSnowflake wrote:The recognition isn't 100%, but it was a start... .

It's a good start, I hope to see more of that!

janosch wrote:

MrSnowflake wrote:It somewhat works now, but the lib doesn't support loading and saving of gestures.

Do you mean that it runs but can't yet recognize gestures? Or is there a predefined set of gestures that i could use for testing?

I does recognize gestures, but not very acurately, but you have to train 1 gesture at least 10 times. But as I said, for the moment it's not usable, because gestures can't be saved.

Great work with andgee by mrsnowflake! [i'd seen wiigee sometime back and wanted to use for an android project too]

The issue I faced while using Andgee with the emulator was that the buttons needed to be kept pressed while doing the training and recognition.
I saw a post above where the sensor simulator can be run on a different machine to do the gestures (which is a neat idea!) but I wanted to programatically change this behavior so instead of keeping the buttons pressed, i can click the button once to start the training and click again to stop training (and same for recognition).

I've made some code changes in AndgeeTest and tested my changes by training and recognizing gestures, and it works well. I could share the code for this if anyone wants to use it as well.

My next step is to allow this to be done through the options menu instead without pressing keys but the problem is that andgee expects key events and the menu selections do not generate any events. Is there a simple way to generate key events in the activity itself or would this require changes in the andgee core?

Thanks,
Gautam

The main problem is that WiiGee can't save and load gestures. AndGee is now just a proof of concept. When WiiGee supports loading and saving, I will imediately begin porting it to Android and then such functions as button less recognition will be implemented.

I've been playing with Andgee to train some gestures.
Everytime I train a gesture that has tilt-like action, I see output on the logcat saying: Data: 4 etc.
Basically, that it saved many data points.

But when I do a gesture like a movement (say moving the phone up and down), all i get is Data: 1

I've tried this multiple times, and tilt-based gestures get trained and recognized but the movement gestures do not.

Any tips on what could be going wrong?

Gautam