ftm - User contributions [en]

Gesture Follower

2008-11-04T11:29:59Z

Bevilacq: /* Credits and Aknowledgements */

== What is the ''gesture follower'' ? ==

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

== What is a ''gesture'' anyway ? ==

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

== Download, license and referencing==
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

== Getting help and disclaimer ==
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

== References==

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

== Getting started ==

=== LCD example===

==== 1st step : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

====2nd sep : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd step : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

== Examples ==

In the version [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3], the following examples can be found:
* writing
* Wii
* audio parameters (pitch, periodicity, energy)
* voice (mfcc)

== Links ==

== Credits and Aknowledgements==
Real Time Musical Interaction - Ircam - CNRS STMS

Frédéric Bevilacqua, Rémy Muller, Norbert Schnell, Fabrice Guédy, Jean-Philippe Lambert, Aymeric Devergié, Anthony Sypniewski, Bruno Zamborlin, Donald Glowinski (thanks the scree captures!)

Download

2008-06-30T10:33:33Z

Bevilacq: /* Current version */

== Current version ==

FTM & Co 2.3
* [http://ftm.ircam.fr/downloads/ftm2.release.txt FTM 2 Release Notes]

Max 4.6 on Mac OS X
* [http://ftm.ircam.fr/downloads/FTM.2.3.5-Max46ub.dmg FTM 2.3.5 binaries for Max/MSP 4.6 (UB) on Mac OS X]

Max 4.6 on Windows
* [http://ftm.ircam.fr/downloads/FTM.2.3.4.BETA-Max46.exe FTM 2.3.4.BETA binaries for Max/MSP 4.6 on Windows]

''Known issue:''

Attention: FTM is still not entirely thread-safe. Messages or expressions that are executed in different threads (alarm, GUI/main, UDP input, etc) and simultaneously modify FTM data structures (objects) can cause crashes. The easiest way to avoid this is to reschedule congruent accesses to FTM object into the same thread. The externals "pipe" or "ftm.schedule" (that now is thread-safe) with a 0 delay time would always output in the alarm ("high priority") thread while "defer" and "deferlow" can be used to reschedule messages in the Max main application (GUI) thread.

== Older versions ==

Max 4.6 on Mac OS X
* [http://ftm.ircam.fr/downloads/FTM.2.3.4.BETA-Max46ub.dmg FTM 2.3.4.BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.3.2.BETA-Max46ub.dmg FTM 2.3.2.BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.3.1.BETA-Max46ub.dmg FTM 2.3.1.BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.3.0.BETA-Max46ub.dmg FTM 2.3.0.BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.2.4-Max46ub.dmg FTM 2.2.4 binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.2.3.BETA-Max46ub.dmg FTM 2.2.3 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.2.2.BETA-Max46ub.dmg FTM 2.2.2 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.2.1.BETA-Max46ub.dmg FTM 2.2.1 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.2.0.BETA-Max46ub.dmg FTM 2.2.0 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.1.4.BETA-Max46ub.dmg FTM 2.1.4 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.1.3.BETA-Max46ub.dmg FTM 2.1.3 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.1.2.BETA-MAX46ub.dmg FTM 2.1.2 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.2.1.1.BETA-Max46ub.dmg FTM 2.1.1 BETA binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.1.7.13-Max46ub.dmg FTM 1.7.13 binaries for Max/MSP 4.6 (UB) on Mac OS X]
* [http://ftm.ircam.fr/downloads/FTM.1.7.12-Max46ub.dmg FTM 1.7.12 binaries for Max/MSP 4.6 (UB) on Mac OS X]

Max 4.5 on Mac OS X
* [http://ftm.ircam.fr/downloads/FTM.2.2.0.BETA-Max45.dmg FTM 2.2.0 BETA binaries for Max/MSP 4.5 (ppc) on Mac OS X] (last release for Max 4.5, works for Mac OS X 10.3)
* [http://ftm.ircam.fr/downloads/FTM.1.7.11-Max45ppc.dmg FTM 1.7.11 binaries for Max/MSP 4.5 (PPC only) on Mac OS X]

Max 4.6 on Windows
* [http://ftm.ircam.fr/downloads/FTM.2.3.2.BETA-Max46.exe FTM 2.3.2.BETA binaries for Max/MSP 4.6 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.3.1.BETA-Max46.exe FTM 2.3.1.BETA binaries for Max/MSP 4.6 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.2.4-Max46.exe FTM 2.2.4 binaries for Max/MSP 4.6 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.2.2.BETA-Max46.exe FTM 2.2.2 BETA binaries for Max/MSP 4.6 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.2.1.BETA-Max46.exe FTM 2.2.1 BETA binaries for Max/MSP 4.6 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.1.2.BETA-Max46.exe FTM 2.1.2 BETA binaries for Max/MSP 4.6 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.1.7.12.BETA-Max46.exe FTM 1.7.12 BETA binaries for Max/MSP 4.6 on Windows]

Max 4.5 on Windows
* [http://ftm.ircam.fr/downloads/FTM.2.3.2.BETA-Max45.exe FTM 2.3.2.BETA binaries for Max/MSP 4.5 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.3.1.BETA-Max45.exe FTM 2.3.1.BETA binaries for Max/MSP 4.5 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.2.4-Max45.exe FTM 2.2.4 binaries for Max/MSP 4.5 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.2.2.BETA-Max45.exe FTM 2.2.2 BETA binaries for Max/MSP 4.5 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.2.1.BETA-Max45.exe FTM 2.2.1 BETA binaries for Max/MSP 4.5 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.2.1.2.BETA-Max45.exe FTM 2.1.2 BETA binaries for Max/MSP 4.5 on Windows]
* [http://ftm.ircam.fr/downloads/FTM.1.7.12.BETA-Max45.exe FTM 1.7.12 BETA binaries for Max/MSP 4.5 on Windows]

* [http://ftm.ircam.fr/downloads/ftm.release.txt FTM 1.7 Release Notes]

Gesture Follower

2008-06-11T12:48:36Z

Bevilacq: /* Getting started */

Gesture Follower

2008-06-11T12:18:53Z

Bevilacq: /* Examples */

== What is the ''gesture follower'' ? ==

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

== What is a ''gesture'' anyway ? ==

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

== Download, license and referencing==
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

== Getting help and disclaimer ==
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

== References==

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

== Getting started ==

=== LCD example===
====overview ====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st step : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

====2nd sep : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd step : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

== Examples ==

In the version [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3], the following examples can be found:
* writing
* Wii
* audio parameters (pitch, periodicity, energy)
* voice (mfcc)

== Links ==

== Credits and Aknowledgements==
Real Time Musical Interaction - Ircam - CNRS STMS

Frédéric Bevilacqua, Rémy Muller, Norbert Schnell, Fabrice Guédy, Jean-Philippe Lambert, Aymeric Devergié, Anthony Sypniewski, Bruno Zamborlin

Gesture Follower

2008-06-11T12:17:41Z

Bevilacq: /* Examples */

== What is the ''gesture follower'' ? ==

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

== What is a ''gesture'' anyway ? ==

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

== Download, license and referencing==
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

== Getting help and disclaimer ==
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

== References==

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

== Getting started ==

=== LCD example===
====overview ====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st step : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

====2nd sep : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd step : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

== Examples ==

The the version, v0.3 here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]
examples can be found:
- writing
- Wii
- audio parameters (pitch, periodicity, energy)
- voice (mfcc)

== Links ==

== Credits and Aknowledgements==
Real Time Musical Interaction - Ircam - CNRS STMS

Frédéric Bevilacqua, Rémy Muller, Norbert Schnell, Fabrice Guédy, Jean-Philippe Lambert, Aymeric Devergié, Anthony Sypniewski, Bruno Zamborlin

Gesture Follower

2008-06-11T12:15:17Z

Bevilacq: /* Credits and Aknowledgements */

== What is the ''gesture follower'' ? ==

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

== What is a ''gesture'' anyway ? ==

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

== Download, license and referencing==
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

== Getting help and disclaimer ==
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

== References==

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

== Getting started ==

=== LCD example===
====overview ====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st step : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

====2nd sep : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd step : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

== Examples ==

== Links ==

== Credits and Aknowledgements==
Real Time Musical Interaction - Ircam - CNRS STMS

Frédéric Bevilacqua, Rémy Muller, Norbert Schnell, Fabrice Guédy, Jean-Philippe Lambert, Aymeric Devergié, Anthony Sypniewski, Bruno Zamborlin

Gesture Follower

2008-06-11T12:14:03Z

Bevilacq: /* Credits and Aknowledgements */

== What is the ''gesture follower'' ? ==

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

== What is a ''gesture'' anyway ? ==

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

== Download, license and referencing==
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

== Getting help and disclaimer ==
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

== References==

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

== Getting started ==

=== LCD example===
====overview ====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st step : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

====2nd sep : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd step : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

== Examples ==

== Links ==

== Credits and Aknowledgements==
Real Time Musical Interaction - Ircam - CNRS STMS
Frédéric Bevilacqua
Norbert Schnell
Fabrice Guédy
Jean-Philippe Lambert
Rémy Muller
Bruno Zamborlin
Anthony Sypniewski
Aymeric Devergié

Gesture Follower

2008-06-11T12:09:17Z

Bevilacq:

== What is the ''gesture follower'' ? ==

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

== What is a ''gesture'' anyway ? ==

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

== Download, license and referencing==
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

== Getting help and disclaimer ==
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

== References==

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

== Getting started ==

=== LCD example===
====overview ====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st step : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

====2nd sep : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd step : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

== Examples ==

== Links ==

== Credits and Aknowledgements==

FTM&Co

2008-05-28T15:29:22Z

Bevilacq:

__NOTOC__
FTM is an extension for [http://www.cycling74.com/ Max/MSP] and [http://puredata.info PureData] providing a small and simple real-time object system and a set of optimized services.

The [http://puredata.info/ PureData] version of FTM is under development.

* [[About | Read more about FTM]]
* [[Download | Download FTM]]
* [http://listes.ircam.fr/wws/info/ftm Join the FTM mailing-list]

* [[Credits]]

== Documentation ==
* [[Documentation]]
* [[Packages]]
* [[FAQ]]
* [[Examples]]

== [[Applications]] ==
* [http://imtr.ircam.fr/index.php?CataRT CataRT]
* [[Gesture Follower]]

== Development ==
* [http://trac.ircam.fr/projects/ftm-and-co Bug reports, feature requests]
* [http://sourceforge.net/projects/ftm/ FTM @ SourceForge.net]

MnM

2008-02-10T21:36:40Z

Bevilacq: /* Mapping is not Music */

== Mapping is not Music ==
[[MnM]] is a set of Max/MSP externals based on [[FTMlib]] providing a unified framework for various techniques of classification, recognition and mapping for motion capture data, sound and music.

Features currently implemented in MnM include:
* Hidden Markov Models, see for example [[Gesture Follower]]
* Principal Components Analysis
* Singular Value Decomposition, LU and QR decompositions
* Non-negative Matrix Factorization and sparse decomposition
* multi-dimensionnal M to N mapping based on examples
* Multi-dimensioannal autocorrelation
* Matrix/Vector Statistics (min, max, mean, std, histogram, mahalanobis distance)

The MnM package is released within the [[Download | FTM distributions]].

== Publications ==
{{:MnM Publications}}

Gesture Follower

2007-11-09T10:12:11Z

Bevilacq: /* Download, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesture_follower_v0.3.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== LCD example====
=====overview =====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st step : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd sep : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd step : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

=== Examples ===

=== Links ===

=== Credits and Aknowledgements===

Gesture Follower

2007-11-09T00:12:32Z

Bevilacq: /* References */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/GestureFollower.v03.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== LCD example====
=====overview =====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st step : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd sep : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd step : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

The messages used the various modules are listed here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

=== Examples ===

=== Links ===

=== Credits and Aknowledgements===

Gesture Follower

2007-11-09T00:12:11Z

Bevilacq: /* References */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/GestureFollower.v03.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== LCD example====
=====overview =====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st step : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd sep : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd step : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

The messages used the various modules are listed here[http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/gesturefollower-reference.01.pdf ref]

=== Examples ===

=== Links ===

=== Credits and Aknowledgements===

File:Gesturefollower-doc01.pdf

2007-11-09T00:08:18Z

Bevilacq:

Gesture Follower

2007-11-08T23:22:43Z

Bevilacq: /* Download, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http://recherche.ircam.fr/equipes/temps-reel/gesturefollower/GestureFollower.v03.zip v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== LCD example====
=====overview =====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st step : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd sep : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd step : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

=== Examples ===

=== Links ===

=== Credits and Aknowledgements===

Gesture Follower

2007-11-08T23:08:08Z

Bevilacq: /* Download, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

The latest version, v0.3 can be downloaded here [http:// v0.3]

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== LCD example====
=====overview =====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st step : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd sep : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd step : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

=== Examples ===

=== Links ===

=== Credits and Aknowledgements===

Gesture Follower

2007-11-08T23:05:57Z

Bevilacq:

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== LCD example====
=====overview =====
(Note: The pictures are related to a previous release of the follower, there have been some changes
in the graphic design)
Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st step : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd sep : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd step : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

=== Examples ===

=== Links ===

=== Credits and Aknowledgements===

Gesture Follower

2007-11-07T11:19:37Z

Bevilacq:

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

==== LCD example====
=====Tutorial Workspace : overview =====

Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st STEP : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd STEP : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd STEP : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

=== Examples ===

=== Links ===

=== Credits and Aknowledgements===

Gesture Follower

2007-11-07T11:18:53Z

Bevilacq:

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

==== LCD example====
=====Tutorial Workspace : overview =====

Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st STEP : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd STEP : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd STEP : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

Gesture Follower

2007-11-07T11:18:28Z

Bevilacq:

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

==== LCD example====
==== ==Tutorial Workspace : overview ==== =

Get an overview of the interface functions.
[[Image:Example.jpg]]

===== 1st STEP : Record gestures =====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

=====2nd STEP : Compare =====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

===== 3rd STEP : Observe =====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

===== Connection Avec EyesWeb XMI =====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

Gesture Follower

2007-11-06T21:53:46Z

Bevilacq: /* Download, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved. Copyrights 2004-2007 IRCAM - Centre Pompidou.

If appropriate please cite the Real Time Interaction Team, IRCAM or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:52:23Z

Bevilacq: /* Getting help and disclaimer */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the [http://listes.ircam.fr/wws/info/ftm FTM list].

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:51:06Z

Bevilacq: /* What is the ''gesture follower'' ? */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (beginning, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the FTM list.

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:50:34Z

Bevilacq: /* Getting help and disclaimer */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the FTM list.

Nevertheless, ...this is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:49:48Z

Bevilacq: /* Getting help and Disclaimer */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the FTM list.

Nevertheless, ...
==== Disclaimer ====
This is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:49:15Z

Bevilacq: /* Disclaimer */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Getting help and Disclaimer ===
Any type of feedback, problem, bug report, feature request are welcome and we will try our best to help you.
Please post any message/questions directly to the FTM list.

Nevertheless, ...
==== Disclaimer ====
This is work in progress!!! Use this software at your own risk. We do not assume any reponsability for possible problems caused by the use of this software.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:42:39Z

Bevilacq: /* Dowload, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Download, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:41:26Z

Bevilacq: /* What is the ''gesture follower'' ? */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a ensemble of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to get parameters from the comparison between a performance and an set of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:39:42Z

Bevilacq:

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

=== Getting started ===

==== The simplest patch ====

=== References===

=== Examples ===

=== Links ===

=== Aknowledgements===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:38:05Z

Bevilacq: /* Dowload, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

=== Getting started ===

==== The simplest patch ====

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:37:50Z

Bevilacq:

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.
Thanks!

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

=== Getting started ===

==== The simplest patch ====

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:36:51Z

Bevilacq: /* Disclaimer */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.
Thanks!

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:36:08Z

Bevilacq: /* Dowload, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.
Thanks!

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

The ''gesture follower'' is primerly aut
Then two options
==== I just want to know how to use the patch====
1.
2.

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:35:40Z

Bevilacq: /* Dowload, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of [[http://ftm.ircam.fr/index.php/Download FTM]], in the folder .../MnM.BETA/examples/gesture_follower/. Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proceedings of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

Thanks!

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

The ''gesture follower'' is primerly aut
Then two options
==== I just want to know how to use the patch====
1.
2.

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:33:11Z

Bevilacq: /* Dowload, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of FTM, in the folder /MnM.BETA/examples/gesture_follower/
Note that you must have FTM installed, see [[http://ftm.ircam.fr/index.php/Download FTM]].

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.

If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proc. of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

The ''gesture follower'' is primerly aut
Then two options
==== I just want to know how to use the patch====
1.
2.

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:30:55Z

Bevilacq: /* Dowload, license and referencing */

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of FTM, see [[http://ftm.ircam.fr/index.php/Download FTM]].
Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.
If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua, F. Guédy, N. Schnell, E. Fléty, N. Leroy, [http://mediatheque.ircam.fr/articles/textes/Bevilacqua07a/ Wireless sensor interface and gesture-follower for music pedagogy], Proc. of the International Conference of New Interfaces for Musical Expression (NIME 07), New York,NY, USA, pp 124-12, 2007.

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

The ''gesture follower'' is primerly aut
Then two options
==== I just want to know how to use the patch====
1.
2.

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:27:36Z

Bevilacq: /* Dowload, license and referencing

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The current version of the ''gesture follower'' comes freely with the download of FTM, see [[http://ftm.ircam.fr/index.php/Download FTM]].
Note that you must have FTM installed.

This software is intended for artistic work and/or scientific research. Any commercial use is reserved.
If appropriate please cite the Real Time Interaction Team, IRCAM - Centre Pompidou or reference the following article:
F. Bevilacqua,

=== Disclaimer ===
This is work in progress. Use this software at your own risk. We do not assume any reponsability for possible problems.

The ''gesture follower'' is primerly aut
Then two options
==== I just want to know how to use the patch====
1.
2.

=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T21:09:12Z

Bevilacq:

=== What is the ''gesture follower'' ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a ''gesture'' anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit for the dimension of the gesture data (or number of sensor channel) other than what your computer can afford as a CPU load (for example 20 is generally no problem).

In Max/MSP the data feeding the ''gesture follower'' can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Dowload, license and referencing===
The gesture follower

First of all, you need to have FTM installed, see [[http://ftm.ircam.fr/index.php/Download FTM]].
Then two options
==== I just want to know how to use the patch====
1.
2.
=== Referecences===

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T20:59:51Z

Bevilacq: /* I just want to know how to use the patch */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit of the dimension of the gesture data (or number of sensor channel) other than the CPU load (for example 20 is no problem).
In Max/MSP the data can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

==== I just want to know how to use the patch====
1. You need to have FTM installed, see [[http://ftm.ircam.fr/index.php/Download FTM]]
2.

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T20:56:48Z

Bevilacq: /* I just want to know how to use the patch */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit of the dimension of the gesture data (or number of sensor channel) other than the CPU load (for example 20 is no problem).
In Max/MSP the data can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

==== I just want to know how to use the patch====
1. You need to have FTM installed, see [http://ftm.ircam.fr/index.php/Download
FTM]

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T20:54:51Z

Bevilacq: /* I want to know how it is buit to modifyit */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit of the dimension of the gesture data (or number of sensor channel) other than the CPU load (for example 20 is no problem).
In Max/MSP the data can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

==== I just want to know how to use the patch====

==== I want to know how it is built to modify it====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T20:54:06Z

Bevilacq: /* Documentation */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit of the dimension of the gesture data (or number of sensor channel) other than the CPU load (for example 20 is no problem).
In Max/MSP the data can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

==== I just want to know how to use the patch====

==== I want to know how it is buit to modifyit====

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T20:52:53Z

Bevilacq: /* What is a "gesture" anyway ? */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be at least 1 milisecond, but typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit of the dimension of the gesture data (or number of sensor channel) other than the CPU load (for example 20 is no problem).
In Max/MSP the data can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T18:06:41Z

Bevilacq: /* What is "the gesture follower" ? */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end of the gesture)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be larger then 1 milisecond. Typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit of the dimension of the data (other than CPU load that could augment dangerously, we did more than 20 with no problem).
In Max/MSP the data can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T18:05:40Z

Bevilacq: /* What is a "gesture" anyway ? */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end ...)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be larger then 1 milisecond. Typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

There is no technical limit of the dimension of the data (other than CPU load that could augment dangerously, we did more than 20 with no problem).
In Max/MSP the data can be taken from a list, for example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* any sensors data, etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T18:00:38Z

Bevilacq: /* What is a "gesture" anyway ? */

=== What is "the gesture follower" ? ===

The ''gesture follower'' is a set of Max/MSP modules to perform gesture recognition and following in real-time. It is integrated in the toolbox MnM of the library FTM (see dowload). The general idea behind it is to be able get parameters by comparing a performance with an ensemble of prerecorded examples.

The gesture follower can guess the two following questions:
* which gesture is it ? (if you don't like black and white answers, you can get "greyscale" answers: how close are you from the recorded gestures ? )
* where are we ? (begining, middle or end ...)

=== What is a "gesture" anyway ? ===

A gesture here can be any ''multi-dimensional temporal curve'', sampled at relatively low frequency compared to sound. With the current implementation in Max/MSP the frequency sampling period must be larger then 1 milisecond. Typically, 10-20 milisecond is recommended. There are no upper limit (if you have time...).

Technically, in Max/MSP the data can be taken from any flow of a list,fro example:

* sound parameters (pitch, amplitude, etc)
* mouse, joystick coordinates
* parameters from video tracking (EyesWeb, Jitter, etc)
* Wiimote
* MIDI
* etc...
* any combination of the above (you said multimodal ?)

=== Documentation ===

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-11-06T17:52:02Z

Bevilacq: /* Description */

Gesture Follower

2007-11-06T17:12:16Z

Bevilacq:

=== Description ===

The ''gesture follower'' is a set of Max/MSP modules integrated in the toolbox MnM of the library FTM. The development of the gesture follower is pursued with the general goal to compare in realtime a gesture with prerecorded examples. The comparison mechanisms we implemented, following and recognition are further explained in the next subsections.

=== Documentation ===

=== Examples ===

=== Links ===

=== Download ===

==== Tutorial Workspace : overview ====

Get an overview of the interface functions.
[[Image:Example.jpg]]

==== 1st STEP : Record gestures ====

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

==== 2nd STEP : Compare ====

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

==== 3rd STEP : Observe ====

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

==== Connection Avec EyesWeb XMI ====

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

Gesture Follower

2007-05-09T12:46:40Z

Bevilacq: /* Test */

Gesture Follower

2007-05-09T12:45:21Z

Bevilacq: /* Test */

== Gesture Follower tutorial ==

The gesture follower is a set of Max/MSP modules integrated in the toolbox MnM of the library FTM. The development of the gesture follower is pursued with the general goal to compare in realtime a gesture with prerecorded examples. The comparison mechanisms we implemented, following and recognition are further explained in the next subsections.

== Workspace : overview ==

Get an overview of the interface functions.
[[Image:Example.jpg]]

== 1st STEP : Record gestures ==

Let’s start with two simple drawings : a triangle and a circle.
[[Image:Example2.jpg]]

== 2nd STEP : Compare ==

Draw a figure and then see how similar it is with your two referent drawings.
[[Image:Example3.jpg]]

== 3rd STEP : Observe ==

Pay attention to the curves below. They represent the velocity in X and Y axis of the mouse trajectories. That give a useful temporal information on how you realize your drawing.
[[Image:Example4.jpg]]

== Connection Avec EyesWeb XMI ==

EyesWeb XMI, the open platform for real-time analysis of multimodal interaction, can be connected to Max/Msp throughout the OSC protocol (Open Sound Control). OSC is open, message-based protocol which was originally developed for communication between computers and sythesizers (cf. wiki).

== Test ==

<html>
<head>
<title>jit.matrix</title>
</head>
<body bgcolor=#F7F7F7 link=#000000 vlink=#000000>
<table><tr><td><a href="index.html"><img src="images/jitter_smallest.gif" border=0></a> </td></tr></table>
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC width=30% valign=bottom>
jit.matrix
</td>
<td bgcolor=#DDDDDD width=70% align=right>

The Jitter Matrix!

</td>
</tr>
</table>



The jit.matrix object is a named matrix which may be used to
matrix data storage and retrieval, resampling, and
matrix type and planecount conversion operations.


<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCDD><a href="group-attributes.html">Attributes:</a></td>
</tr>
</table>

<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC width=10%>Name</td>
<td bgcolor=#CCCCCC width=5%>Type</td>
<td bgcolor=#CCCCCC width=85%>Description</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>adapt</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


Matrix adaptation flag (default = 0 if matrix arguments are present, otherwise 1)
When the flag is set, the jit.matrix object will adapt to the incoming matrix planecount, type, and dimensions.

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>dimstride (get)</td>
<td bgcolor=#DDDDDD valign=top>int list[32]</td>
<td bgcolor=#D7D7CC valign=top>


The byte stride per dimension

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>dim</td>
<td bgcolor=#DDDDDD valign=top>int list[32]</td>
<td bgcolor=#D7D7CC valign=top>


The dimensions of matrix data (default = 1 1)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>dstdimend</td>
<td bgcolor=#DDDDDD valign=top>int list[32]</td>
<td bgcolor=#D7D7CC valign=top>


The destination dimension end position (default = all dim values minus 1)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>dstdimstart</td>
<td bgcolor=#DDDDDD valign=top>int list[32]</td>
<td bgcolor=#D7D7CC valign=top>


The source dimension start position (default = all 0)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>interp</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


Matrix interpolation flag (default = 0)
When the flag is set, the input matrix will be interpolated
when copied to the internal matrix.

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>name</td>
<td bgcolor=#DDDDDD valign=top>symbol</td>
<td bgcolor=#D7D7CC valign=top>


The name of the matrix (default = UID)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>planecount</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


The number of planes in matrix data (default = 4)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>planemap</td>
<td bgcolor=#DDDDDD valign=top>int list[32]</td>
<td bgcolor=#D7D7CC valign=top>


Maps input places to output planes (default = 0 1 2 3 ...)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>size (get)</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


Total byte size of matrix

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>srcdimend</td>
<td bgcolor=#DDDDDD valign=top>int list[32]</td>
<td bgcolor=#D7D7CC valign=top>


The source dimension end position (default = all dim values minus 1)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>srcdimstart</td>
<td bgcolor=#DDDDDD valign=top>int list[32]</td>
<td bgcolor=#D7D7CC valign=top>


The source dimension start position (default = all 0)

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>thru</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


Thru mode flag (default = 1) When the flag is set, a matrix is output
when another one is received.

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>type</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


The matrix data type (default = char 
Supported data types are char, long, float32, or float64.

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>usedstdim</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


Destdim use flag (default = 0)
When the flag is set, the destination dimension's attributes are used when copying an input matrix
to an internal matrix.

</td>
</tr>
<tr>
<td bgcolor=#D7CCCC valign=top>usesrcdim</td>
<td bgcolor=#DDDDDD valign=top>int</td>
<td bgcolor=#D7D7CC valign=top>


Srcdim use flag (default = 0)
When the flag is set, the source dimension's attributes are used when copying an input matrix
to an internal matrix.

</td>
</tr>
</table>


<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCDD>Messages:</td>
</tr>
</table>

<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>bang </td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Equivalent to the outputmatrix message.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>clear </td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Sets all matrix values to zero.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>exportimage [filename (symbol)] { [file-type (symbol)] } { [use-dialog (int)] }</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Export the current frame as an image file with the name specified by the first argument. The
optional second argument sets the file type (default = png). Available file types are
png, bmp, jpeg, macpaint, photoshop, pict, qtimage,
sgi, tga and tiff. An optional use-dialog argument of 1 will open a
file dialog to allow you to enter the image file settings.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>exportmovie { [filename (symbol)] } [FPS (float)] [codec (symbol)] [quality (symbol)] [timescale (int)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Exports a matrix as a QuickTime movie. The exportmovie message takes an optional argument
to specify a file name. If no filename is specified, a file dialog will open to let you choose a file.

The default FPS is 30. frames per second

The default codec is raw. Supported codecs are
raw, cinepak, graphics, animation, video, componentvideo, jpeg, mjpega, mjpegb, sgi, planarrgb, macpaint, gif, photocd, qdgx, avrjpeg, opendmljpeg, bmp, winraw, vector, qd, h261, h263, dvntsc, dvpal, dvprontsc, dvpropal, flc, targa, png, tiff, componentvideosigned, componentvideounsigned, cmyk, microsoft, sorenson, indeo4, argb64, rgb48, alphagrey32, grey16, mpegyuv420, yuv420, and sorensonyuv9.

The default quality is max. Supported quality settings are
lossless, max, min, low, normal, and high. 
 
Note that minimum quality is, in many cases, the codec's default quality. Use "low" quality for consistent results.

The default timescale is 600 units per second.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>float </td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Equivalent to the setall [float] message, followed by the bang message.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>getcell [position (list)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Sends the value(s) in the cell specified by position
out the right outlet of the object as a
list in the form
cell cell-position0 ... cell-positionN val plane0-value ... planeN-value.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>importmovie { [filename (symbol)] } [time-offset (int)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Imports a QuickTime movie into the matrix. If no filename is specified, a file dialog will open to let you choose a file.
The time-offset argument may be used to set a time offset for the QuickTime movie being imported (the default is 0).

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>int </td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Equivalent to the setall [int] message, followed by the bang message.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>exprfill [expression (symbol)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Evlauates expression to fill the matrix. See <a href="jit.expr.html">jit.expr</a> for more information on expressions.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>jit_gl_texture [texture-name (symbol)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Copies the texture specified by texture-name to the matrix.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>jit_matrix [matrix-name (symbol)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Copies a matrix specified by matrix-name to the matrix.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>list </td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Equivalent to the setall [list] message, followed by the bang message.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>outputmatrix </td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Sends the matrix out the left outlet.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>read { [filename (symbol)] }</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Reads Jitter binary data files (.jxf) into a matrix set.
If no filename is specified, a file dialog will open to let you choose a file.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>register </td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Equivalent to setting the name attribute.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>setall [value (list)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Sets all cells to the value specified by value(s). Position is specified of a list whose length is equal to the number of dimensions (dimcount).

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>setcell [position (list)] { plane [plane-number (int)] } val [value (list)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Sets the cell specified by position to the value specified by value.
Position is specified of a list whose length is equal to the number of dimensions (dimcount). The
optional arguments plane plane-number can be used to specify a plane. If a plane is specified, value should be a single number, otherwise it should be a list of numbers of size planecount - 1.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>val [value (list)]</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Equivalent to the setall message, followed by the bang message.

</td>
</tr>
</table>
 
<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCCC>write { [filename (symbol)] }</td>
</tr>
<tr>
<td bgcolor=#D7D7CC>


Writes matrix set as a Jitter binary data file (.jxf).
If no filename is specified, a file dialog will open to let you choose a file.

</td>
</tr>
</table>
 

<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCDD>Example:</a></td>
</tr>
</table>


<center>
<img src="images/jit.matrix.gif" border=0></center>

<table border=0 width=100%>
<tr>
<td bgcolor=#CCCCDD>See Also:</a></td>
</tr>
<tr>
<td bgcolor=#CCCCCC>
<a href="jit.coerce.html">jit.coerce</a>,
<a href="jit.fill.html">jit.fill</a>,
<a href="jit.matrixset.html">jit.matrixset</a>,
<a href="jit.matrixinfo.html">jit.matrixinfo</a>,
<a href="jit.peek~.html">jit.peek~</a>,
<a href="jit.poke~.html">jit.poke~</a>,
<a href="jit.spill.html">jit.spill</a>,
<a href="jit.submatrix.html">jit.submatrix</a></td>
</tr>
</table>

</body>
</html>