ISE Lab, Centre de Visió per Computador

 

ISE Lab

Research Lab on Image Sequence Evaluation

 

 

The new ISE Lab homepage has already been launched!

 


Crew  |  Description  |  Methodology Results Projects  |  Publications  |  Intranet  Acknowledgements 


Crew

The ISE Lab is headed by Prof. Juan José Villanueva and is located at the Computer Vision Center (CVC) in Barcelona, Spain.  

Ignasi Rius Daniel A. Rowe Ivan Huerta Javier Orozco Pau Baiget Carlos Fernández Murad Al Haj Ariel Amato Marco Pedersoli Gisele Kohatsu Poal F. Xavier Roca Juan J. Villanueva Mikhail Mozerov Miguel A. Viñas Joan Soto

 


Description

Research topics at ISE Lab cover different cognitive skills for the semantic understanding of human behaviors in complex scenes. These behaviors captured from camera sensors are explained by means of natural-language texts and virtual environments.

Fig. 1: Semantic understanding of human behaviours.

The analysis of image sequences involving human agents allows multiple applications, and implies lots of difficulties. This challenging domain is referred as Human Sequence Evaluation (HSE). A generic HSE system transforms image data into conceptual descriptions, and vice versa. This abstraction process is addressed by describing the HSE framework as a modular scheme, each module concerned to a specific task. 

Fig. 2: Human Sequence Evaluation (HSE) Architecture.

This analysis of video sequences incorporates high-level processes to determine the meaning of human motion. As a result, the goal is set motion naming, i.e. the automatic generation of semantic descriptions about when (ASL), where (ISL), what (PDL), who (SDL), how (CIL) and why (BIL) is motion being detected in complex scenes.



Methodology

ISE Lab aims to design a Cognitive Vision System for human motion and behavior understanding, followed by communication of the system results to end-users, based on two main goals:

The first goal is to determine which interpretations are feasible to be inferred from three different categories of human motion, namely the motion of agent, body and face, in the same discourse domain.

Fig. 3: Human-Expressive Representations of Motion.

The second objective is set to establish how these three types of interpretations can be linked together (i) to coherently evaluate the human motion as a whole in image sequences, and (ii) to communicate inferred interpretations using natural-language texts or virtual environments as a visual language.

Fig. 4: Evaluation in Sequences.

This general approach lends itself to various cognitive surveillance scenarios at varying degrees of resolution: from wide-field-of-view multiple-agent scenes, through to more specific inferences of emotional state that could be elicited from high resolution imagery of faces.

    

Fig. 5: Human behavior acquired at different resolutions.

Research is specialized to a single type of scenario in order to study the problems in-depth rather attempting to come up with a supposedly generally applicable solution. In a specific application domain, the challenge is to handle the transitions for continuous interpretation of human behavior during a range of substantially changing boundary conditions.

 


Results

We have obtained the following results in the aforementioned tasks:

Agent Motion

Detection and tracking of agents while they are still some distance away from a particular location (for example a bus station, a pedestrian crossing, a passenger in an airport, or a guest in a lobby).

    

Fig. 6: Detection of human motion and abandoned objects.

      

    

Fig. 7: Detection and tracking of human agents.

Body Motion

Tracking of human body limbs for markerless motion capture. When agents come closer to camera sensors and the active camera zooms in on these agents, their body posture can be evaluated to check for compatibility with behavior hypotheses generated.

      

       

Fig. 8: Detection and tracking of human bodies based on aSpaces.

Face Motion

When human faces can be resolved sufficiently well, facial emotions can be checked to see whether these again are compatible with what one expects from their movements and posture in the observational and locational context.

           

    

Fig. 9: Hierarchical tracking of human faces.

    

Fig. 10: Analysis of human expressions for the interpretation of emotions.

Cognitive Motion

One aim is the the generation of textual descriptions explaining observed human behaviors. Semantic descriptions will support conceptual abstraction, thereby facilitating the communication of short messages or essential details.

    

Fig. 11: Generation of Natural-language texts from image sequences.

Another goal is explanation with visual languages, in our case a virtual environment for the generation of synthetic behaviors which reproduce conceptual descriptions.

  

  Fig. 12: Design of synthetic behaviours in virtual environments.

 

Fig. 13: Generation of virtual environments from conceptual descriptions.

As a result, high-level interpretations provide a challenging domain of research on Cognitive Science, which encompasses topics on Computer Vision, Artificial Intelligence, Computational Linguistics and Computer Animation.

 


Projects

European Projects during FP6

HERMES IST 027110: Human-Expressive Representations of Motion and their Evaluation in Sequences.

VIDI-Video IST 045547: Interactive Semantic Video Search with a Large Thesaurus of Machine-Learned Audio-Visual Concepts.

euCognition IST 026408: European Network for the Advancement of Artificial Cognitive Systems.

Spanish Projects

CICYT SISYPHUS TIN2006-14606: Security Indoor SYstem for Places with HUman in Scenes.

PROFIT Edificio Seguro FIT-360000-2006-53: Estudio de viabilidad técnico previo al desarrollo.

ANHA TIC2003-08865: Modelado Computacional de Acciones Humanas mediante el análisis de secuencias de imágenes.

Technological Transfer

AUTOPISTAS MADRID-TOLEDO: Viability studies.

DAVANTIS: Analysis of algorithms for human motion detection.

ELASTIC BERGER: Quality control and automation processes.

FICOSA: Viability studies and functional prototyping.

VISION ADVANCE: Analysis of algorithms for human motion tracking.

 


Publications

2008

89. Ariel Amato, Mikhail Mozerov, Iván Huerta, Jordi Gonzàlez, Juan José Villanueva, " Background Subtraction Technique Based on Chromaticity and Intensity Patterns ", in 19th International Conference on Pattern Recognition (ICPR'2008), Tampa, Florida, USA, December, 2008.

88. Murad Al Haj, Javier Orozco, Jordi Gonzàlez, Juan José Villanueva, " Automatic Face and Facial Features Initialization for Robust and Accurate Tracking ", in 19th International Conference on Pattern Recognition (ICPR'2008), Tampa, Florida, USA, December, 2008.

87. Javier Varona, Antoni Jaume-i-Capó, Jordi Gonzàlez, Francisco J. Perales, " Toward natural interaction through visual recognition of body gestures in real-time ", Interacting with Computers: doi:10.1016/j.intcom.2008.10.001, available online November 8th, 2008

86. Carles Fernández, Xavier Roca, Jordi Gonzàlez, "Providing Automatic Multilingual Text Generation to Artificial Cognitive Systems", Vigo International Journal of Applied Linguistics, number 5, pp. 37 - 62, October, 2008

85. Pau Baiget, Carles Fernández, Xavier Roca, Jordi Gonzàlez, " Observing Human Behavior in Image Sequences: the Video-Hermeneutics Challenge ", in Computer Vision: Advances in Research & Development (CVCRD'2008), Bellaterra, Spain, October, 2008

84. Carles Fernández, Pau Baiget, Xavier Roca, Jordi Gonzàlez, " Three Dialogue-based Challenges for Cognitive Vision Surveillance ", in Computer Vision: Advances in Research & Development (CVCRD'2008), Bellaterra, Spain, October, 2008

83. Ognjen Rudovic, Jordi Gonzàlez, Xavier Roca, " Action History Measure for Human Behaviour Classification ", in Computer Vision: Advances in Research & Development (CVCRD'2008), Bellaterra, Spain, October, 2008

82. Marco Pedersoli, Ivan Huerta, Jordi Gonzàlez, Juan José Vilanueva, " Fast Human Detection using Multiresolution Cascade ", in Computer Vision: Advances in Research & Development (CVCRD'2008), Bellaterra, Spain, October, 2008

81. Iván Huerta, Ariel Amato, Marco Pedersoli, Jordi Gonzàlez, " Motion Segmentation of Image Sequences: A Survey ", in Computer Vision: Advances in Research & Development (CVCRD'2008), Bellaterra, Spain, October, 2008

80. Bhaskar Chakraborty, Ognjen Rudovic, Mikhail Mozerov, Jordi Gonzàlez, " Towards Real time Human Action Recognition Using Correlation Approach ", in Computer Vision: Advances in Research & Development (CVCRD'2008), Bellaterra, Spain, October, 2008

79. Bhaskar Chakraborty, Ognjen Rudovic, Jordi Gonzàlez, " View-Invariant Human-Body Detection with Extension to Human Action Recognition using Component-Wise HMM of Body Parts ", in 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands, September, 2008.

78. Javier Orozco, Ognjen Rudovic, F. Xavier Roca, Jordi Gonzàlez, " Confidence Assessment On Eyelid and Eyebrow Expression Recognition ", in 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands, September, 2008.

77. Carles Fernández, Pau Baiget, F. Xavier Roca, Jordi Gonzàlez, "Interpretation of Complex Situations in a Semantic-Based Surveillance Framework", Signal Processing: Image Communication, Special Issue on Semantic Analysis for Interactive Multimedia Services, volume 23, issue 7, pp. 554-569, August, 2008

76. Javier Varona, Jordi Gonzàlez, Ignasi Rius, Juan J. Villanueva, " On importance of detection for video surveillance applications ", Optical Engineering, Vol. 47, Issue 8, August, 2008.

75. Bhaskar Chakraborty, Marco Pedersoli, Jordi Gonzàlez, " View-invariant human action detection using component-wise HMM of body parts ", 5th International Workshop on Articulated Motion and Deformable Objects (AMDO'2008), Andratx, Mallorca, Spain, July, 2008.

74. Pau Baiget, F. Xavier Roca, Jordi Gonzàlez, " Autonomous Virtual Agents for Performance Evaluation of Tracking Algorithms ", 5th International Workshop on Articulated Motion and Deformable Objects (AMDO'2008), Andratx, Mallorca, Spain, July, 2008. Most Suitable for Commercial Application Award.

73. Ivan Huerta, Ariel Amato, Jordi Gonzàlez, and Juan José Villanueva, " Fusing Edge Cues to handle Colour Problems in Image Segmentation ", 5th International Workshop on Articulated Motion and Deformable Objects (AMDO'2008), Andratx, Mallorca, Spain, July, 2008

72. Ignasi Rius, Jordi Gonzàlez, Mikhail Mozerov, F. Xavier Roca, " Automatic Learning of 3D Pose Variability in Walking Performances for Gait Analysis ", International Journal for Computational Vision and Biomechanics, volume 1, number 1, pp. 33-43, January-June, 2008

71. Javier Orozco, F. Xavier Roca, Jordi Gonzàlez, " Real-Time Gaze Tracking With Appearance-Based Models ", Machine Vision and Applications, doi: 10.1007/s00138-008-0130-6, available online April 4th, 2008.

70. Mikhail Mozerov, Ariel Amato, F. Xavier Roca, Jordi Gonzàlez, " Trajectory occlusion handling with multiple view distance minimisation clustering ", Optical Engineering, , Vol. 47, Issue 4, 047202, April, 2008.

69. Jordi Gonzàlez, Daniel Rowe, Javier Varona, F. Xavier Roca, " Understanding Dynamic Scenes based on Human Sequence Evaluation ", Image and Vision Computing, doi: 10.1016/j.imavis.2008.02.004, available online February 14th, 2008.

2007

68. Carles Fernandez, Jordi Gonzàlez, " Ontology for Semantic Integration in a Cognitive Surveillance System ", in 2nd international conference on Semantics And digital Media Technologies (SAMT'2007), Genova, Italy, December, 2007.

67. Mikhail Mozerov, Ariel Amato, F.Xavier Roca, Jordi Gonzàlez, " Trajectory Extrapolation for Multiple Views Tracking ", in 8th International Conference on Pattern Recognition and Image Analysis (PRIA'2008), Yoshkar-Ola, Russia, October, 2007.

66. F. Alejandro García, Javier Orozco, Jordi Gonzàlez, " Assessing Confidence in Cased Based Reuse Step ", in Desè Congrés Internacional de l'Associació Catalana d'Intel·ligència Artificial (CCIA'2007), Principat d’Andorra, October, 2007.

65. Murad Al Haj, Ariel Amato, F. Xavier Roca, Jordi Gonzàlez, " Face Detection in Color Images using Primitive Shape Features ", in 5th International Conference on Computer Recognition Systems (CORES'2007), Wroclaw, Poland, October, 2007.

64. Ariel Amato, Murad Al Haj, Mikhail Mozerov, Jordi Gonzàlez, " Trajectory Fusion for Multiple Camera Tracking ", in 5th International Conference on Computer Recognition Systems (CORES'2007), Wroclaw, Poland, October, 2007.

63. Mikhail Mozerov, Ariel Amato, Murad Al Haj, Jordi Gonzàlez, " A simple Method of Multiple Camera Calibration for the Joint Top View Projection ", in 5th International Conference on Computer Recognition Systems (CORES'2007), Wroclaw, Poland, October, 2007.

62. Marco Pedersoli, Jordi Gonzàlez, Bhaskar Chakraborty, Juan Jose Villanueva, " Enhancing Real-time Human Detection based on Histograms of Oriented Gradients ", in 5th International Conference on Computer Recognition Systems (CORES'2007), Wroclaw, Poland, October, 2007.

61. Ariel Amato, Mikhail Mozerov, Murad Al Haj, Jordi Gonzàlez, " Trajectories Reconstruction with Multiple View ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

60. Iván Huerta, Daniel Rowe, Miguel Viñas, Mikhail Mozerov, Jordi Gonzàlez, " Background Subtraction Fusing Colours, Intensity and Edge Cues ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

59. Daniel Rowe, Iván Huerta, Marco Pedersoli, Soledad Guinea, Jordi Gonzàlez, Juan José Villanueva, " A Hierarchical Architecture to Multiple Target Tracking ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

58. Marco Pedersoli, Jordi Gonzàlez, Bhaskar Chakraborty, Juan José Villanueva, " Boosting Histograms of Oriented Gradients for Human Detection ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

57. Bhaskar Chakraborty, Ignasi Rius, Marco Pedersoli, Mikhail Mozerov, Jordi Gonzàlez, " Component-based Human Detection ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

56. Ignasi Rius, Jordi Gonzàlez, Bhaskar Chakraborty, Thomas Moeslund, F. Xavier Roca, " Modeling Motion for Gait Analysis ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

55. Murad Al Haj, Javier Orozco, Ariel Amato, F. Xavier Roca, Jordi Gonzàlez, " Finding Faces in Color Images trough Primitive Shape Features ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

54. Alejandro García, Javier Orozco, Murad Al Haj, F. Xavier Roca,  Jordi Gonzàlez, " Assessing Confidence and Quality for Expression Analysis With CBR ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

53. Pau Baiget, Carles Fernández, Aariel Amato, F. Xavier Roca, Jordi Gonzàlez, " Constructing a Path Database for Scene Categorization ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

52. Carles Fernández, Pau Baiget, F. Xavier Roca, Jordi Gonzàlez, " High-level Integration for Cognitive Vision Surveillance ", in Computer Vision: Advances in Research & Development (CVCRD'2007), Bellaterra, Spain, October, 2007.

51. Jordi Gonzàlez, F. Xavier Roca, Juan José Villanueva, " HERMES: A research project on human sequence evaluation ", in Computational Vision and Medical Image Processing (VipIMAGE'2007), Porto, Portugal, October, 2007.

50. Carles Fernández, Pau Baiget, F. Xavier Roca, Jordi Gonzàlez, " Semantic Annotation of Complex Human Scenes for Multimedia Surveillance ", in 10th International Conference on Advances in Artificial Intelligence (AI*IA'2007). Special Track on Intelligent Access to Multimedia Data, Villa Mondragone, Monte Porzio Catone, Roma, Italy, September, 2007.

49. Carles Fernández, Pau Baiget, F. Xavier Roca, Jordi Gonzàlez, " Natural Language Descriptions of Human Behavior from Video Sequences ", in 30th Annual German Conference on Artificial Intelligence (KI'2007), Osnabrück, Germany, September, 2007.

48. Javier Orozco, F.Xavier Roca, Jordi Gonzàlez, " Deterministic and Stochastic Methods for Gaze Tracking in Real-Time ", in 12th International Conference on Computer Analysis of Images and Patterns (CAIP'2007), Vienna, Austria, August, 2007.

47. Murad Al Haj, Ariel Amato, Gemma Sánchez, Jordi Gonzàlez, " On-line One Stroke Character Recognition Using Directional Features ", in International Workshop on Advances in Pattern Recognition (IWAPR 2007), Plymouth, UK, July, 2007.

46. Ariel Amato, Murad Al Haj, Josep Lládos, Jordi Gonzàlez, " Computationally Efficient Graph Matching via Energy Vector Extraction ", in International Workshop on Advances in Pattern Recognition (IWAPR 2007), Plymouth, UK, July, 2007.

45. Daniel Rowe, Jordi González, Ivan Huerta, Juan José Villanueva, " On Reasoning over Tracking Events ", in 15th Scandinavian Conference on Image Analysis (SCIA'2007), Aalborg, Denmark, June, 2007.

44. Pau Baiget, Carles Fernández, F. Xavier Roca, Jordi Gonzàlez, " Automatic Learning of Conceptual Knowledge for the Interpretation of Human Behavior in Video Sequences ", in 3rd Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2007), Girona, Spain, June, 2007.

43. Ivan Huerta, Daniel Rowe, Mikhail Mozerov, Jordi Gonzàlez, " Improving Background Subtraction based on a Casuistry of Colour-Motion Segmentation Problems ", in 3rd Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2007), Girona, Spain, June, 2007.

42. Javier Orozco, Jordi Gonzàlez, Ignasi Rius, F.Xavier Roca, " Hierarchical Eyelid and Face Tracking ", in 3rd Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2007), Girona, Spain, June, 2007.

41. Daniel Rowe, Ivan Huerta, Jordi Gonzàlez, Juan J. Villanueva, " Robust Multiple-People Tracking Using Colour-Based Particle Filters ", in 3rd Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2007), Girona, Spain, June, 2007.

40. Pau Baiget, Joan Soto, F. Xavier Roca, Jordi Gonzàlez, "Automatic Generation of Computer-Animated Sequences based on Human Behaviour Modelling ", in 10th International Conference on Computer Graphics and Artificial Intelligence (3IA'2007), Athens, Greece, May, 2007.

39. Javier Orozco, F. Alejandro García, Josep Lluis Arcos, Jordi Gonzàlez, " Spatio-Temporal Reasoning for Reliable Facial Expression Interpretation ", in 5th International Conference on Computer Vision Systems (ICVS'2007), Bielefeld, Germany, March, 2007.

2006

38. Pau Baiget, Jordi Gonzàlez, Javier Orozco, Xavier Roca, " Interpretation of Human Motion in Image Sequences using Situation Graph Trees ", in 1st CVC Workshop on Computer Vision: Progress of Research and Development (CVCRD'06), Bellaterra, Spain, October, 2006.

37. Carles Fernández, Pau Baiget, Mikhail Mozerov, Jordi Gonzàlez, " Spanish Text Generation for Image Sequence Evaluation using FMTHL and DRS ", in 1st CVC Workshop on Computer Vision: Progress of Research and Development (CVCRD'06), Bellaterra, Spain, October, 2006.

36. Iván Huerta, Daniel Rowe, Jordi Gonzàlez, Juan J. Villanueva, " Improving Foreground Detection for Adaptive Background Segmentation ", in 1st CVC Workshop on Computer Vision: Progress of Research and Development (CVCRD'06), Bellaterra, Spain, October, 2006.

35. Javier Orozco, Jordi Gonzàlez, Ignasi Rius, Xavier Roca, " Robust Real-Time Tracking for Facial Expression Analysis ", in 1st CVC Workshop on Computer Vision: Progress of Research and Development (CVCRD'06), Bellaterra, Spain, October, 2006.

34. Ignasi Rius, Carles Fernandez, Mikhail Mozerov, Jordi Gonzàlez, " Constraining Human Motion for Efficient Tracking with a Particle Filter ", in 1st CVC Workshop on Computer Vision: Progress of Research and Development (CVCRD'06), Bellaterra, Spain, October, 2006.

33. Daniel Rowe, Ivan Huerta, Jordi Gonzàlez, Juan J. Villanueva, " Detection and Tracking of Multiple Agents in Unconstrained Environments ", in 1st CVC Workshop on Computer Vision: Progress of Research and Development (CVCRD'06), Bellaterra, Spain, October, 2006.

32. Daniel Rowe, Ian Reid, Jordi Gonzàlez, Juan José Villanueva. " Unconstrained Multiple-People Tracking ", in 28th Annual Symposium of the German Association for Pattern Recognition (DAGM'2006), Berlin, Germany, September, 2006.

31. Mikhail Mozerov, Ignasi Rius, Xavier Roca, Jordi Gonzàlez. " 3D Human Motion Sequences Synchronization using Dense Matching Algorithm ", in 28th Annual Symposium of the German Association for Pattern Recognition (DAGM'2006), Berlin, Germany, September, 2006.

30. Joaquín Salas, Pedro Martínez, Jordi Gonzàlez. " Background Updating with the use of Intrinsic Curves ", in International Conference on Image Analysis and Recognition (ICIAR'2006), Póvoa de Varzim, Portugal, September, 2006.

29. Javier Orozco, Pau Baiget, Jordi Gonzàlez, F. Xavier Roca. " Eyelids and Face Tracking in Real-Time ", in 6th International Conference on Visualization, Imaging, and Image Processing (VIIP 2006), Palma de Mallorca, Spain, August, 2006.

28. Jordi Gonzàlez, Daniel Rowe, Juan Andrade, Juan J. Villanueva. " Efficient Management of Multiple Agent Tracking through Observation Handling ", in 6th International Conference on Visualization, Imaging, and Image Processing (VIIP 2006), Palma de Mallorca, Spain, August, 2006.

27. Ignasi Rius, Javier Varona, Jordi Gonzàlez, Juan José Villanueva. " Action Spaces for Efficient Bayesian Tracking of Human Motion ", in 18th International Conference on Pattern Recognition (ICPR'2006), Hong Kong, China, August 2006.

26. Ignasi Rius, Javier Varona, F. Xavier Roca, Jordi Gonzàlez. " Posture Constraints for Bayesian Human Motion Tracking ", in 4th International Workshop on Articulated Motion and Deformable Objects (AMDO-e'2006), Andratx, Mallorca, Spain, July 2006.

25. Iván Huerta, Daniel Rowe, Jordi Gonzàlez, Juan José Villanueva. " Efficient Incorporation of Motionless Foreground Objects for Adaptive Background Segmentation ", in 4th International Workshop on Articulated Motion and Deformable Objects (AMDO-e'2006), Andratx, Mallorca, Spain, July 2006.

24. Fadi Dornaika, Javier Orozco, Jordi Gonzàlez. " Combined Head, Lips, Eyebrows, and Eyelids Tracking using Adaptive Appearance Models ", in 4th International Workshop on Articulated Motion and Deformable Objects (AMDO-e'2006), Andratx, Mallorca, Spain, July 2006.

23. Javier Orozco, Jordi Gonzàlez, Pau Baiget, Juan José Villanueva. " Human Emotion Evaluation on Image Sequences ". CogSys II Conference, Radboud University Nijmegen, Netherlands, April 2006.

22. Pau Baiget, Javier Orozco, F. Xavier Roca, Jordi Gonzàlez. " Situation Graph Trees for Human Behavior Analysis ". CogSys II Conference, Radboud University Nijmegen, Netherlands, April 2006.

2005

21. Jordi Gonzàlez, Javier Varona, F. Xavier Roca and Juan J. Villanueva. " A Comparison Framework for Walking Performances using aSpaces ". Electronic Letters on Computer Vision and Image Analysis, Special Issue on Articulated Motion, volume 5, number 3, pp. 105-116, 2005.

20. Sergio García, Daniel Rowe, Jordi Gonzàlez, Juan J. Villanueva. " Articulated Object Modelling using Neural Gas Networks ", in 5th IASTED International Conference on Visualization, Imaging and Image Processing (VIIP'2005), Benidorm, Spain, September 2005.  

19. Daniel Rowe, Ignasi Rius, Jordi Gonzàlez, Juan J. Villanueva. " Robust Particle Filtering for Object Tracking ", in 13th International Conference on Image Analysis and Processing (ICIAP'2005), Cagliary, Italy, September 2005.  

18. Ignasi Rius, Daniel Rowe, Jordi Gonzàlez, F.Xavier Roca. " 3D Action Modeling and Reconstruction for 2D Human Body Tracking ", in 3rd International Conference on Advances in Pattern Recognition (ICAPR'2005), Bath, United Kingdom, August 2005.  

17. Daniel Rowe, Ignasi Rius, Jordi Gonzàlez, Juan J. Villanueva. " Improving Tracking by Handling Occlusions ", in 3rd International Conference on Advances in Pattern Recognition (ICAPR'2005), Bath, United Kingdom, August 2005.  

16. Ignasi Rius, Daniel Rowe, Jordi Gonzàlez, F.Xavier Roca. " A 3D Dynamic Model of Human Actions for Probabilistic Image Tracking ", in 2nd Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2005), Estoril, Portugal, June 2005.  

15. Daniel Rowe, Ignasi Rius, Jordi Gonzàlez, F.Xavier Roca, Juan J. Villanueva. " Probabilistic Image-based Tracking: Improving Particle Filtering ", in 2nd Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2005), Estoril, Portugal, June 2005.  

2004

14. Jordi Gonzàlez, Javier Varona,  F.Xavier Roca and Juan J. Villanueva. " Situation Graph Trees for Human Behavior Modeling ", in 7th Catalan Conference for Artificial Intelligence (CCIA'2004), Barcelona, Spain, October 2004

13. Jordi Gonzàlez, Javier Varona, F.Xavier Roca and Juan J. Villanueva. " Analysis of Human Walking based on aSpaces ", in 3rd International Workshop on Articulated Motion and Deformable Objects (AMDO'2004), Palma de Mallorca, Spain, September 2004. Award for Best Paper.

12. Jordi Gonzàlez. " Human Sequence Evaluation: the Key-frame Approach " (6.58 Mb), PhD Thesis, Universitat Autònoma de Barcelona. Barcelona, Spain, May 2004.  

2003

11. Jordi Gonzàlez, Javier Varona,  F.Xavier Roca and Juan J. Villanueva. " A Human Action Comparison Framework for Motion Understanding ", in 6th Catalan Conference for Artificial Intelligence (CCIA'2003), Palma de Mallorca, Spain, October 2003

10. Jordi Gonzàlez, Javier Varona,  F.Xavier Roca and Juan J. Villanueva. " Human Sequence Evaluation: towards Knowledge-based Scene Interpretations ", in 6th Catalan Conference for Artificial Intelligence (CCIA'2003), Palma de Mallorca, Spain, October 2003.

9. Jordi Gonzàlez, Javier Varona,  F.Xavier Roca and Juan J. Villanueva. " Automatic Keyframing of Human Actions for Computer Animation ", in 1st Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2003), Port d'Andratx, Mallorca, Spain, June 2003

8. Javier Varona, Jordi Gonzàlez, F.Xavier Roca and Juan J. Villanueva. " Appearance Tracking for Video Surveillance ", in 1st Iberian Conference on Pattern Recognition and Image Analysis (ibPRIA'2003), Port d'Andratx, Mallorca, Spain, June 2003

 2002

7. Jordi Gonzàlez, Javier Varona, F.Xavier Roca and Juan J. Villanueva. " aSpaces: Action Spaces for Recognition and Synthesis of Human Actions ", in 2nd International Workshop on Articulated Motion and Deformable Objects (AMDO'2002), Palma de Mallorca, Spain, November 2002.

 2001

6. Javier Varona. " Seguimiento Visual Robusto en Entornos Complejos ". PhD Thesis, Universitat Autònoma de Barcelona. Barcelona, Spain, November 2001.

5. Jordi Gonzàlez, Javier Varona, F.Xavier Roca and Juan J. Villanueva. " Human Activity Learning and Recognition from Appearance ". World Multiconference on Systemics, Cybernetics and Informatics (SCI'2001), Volume XIII, Orlando, Florida, USA, July 2001.

4. Jordi Gonzàlez, Javier Varona, Juan J. Villanueva and F.Xavier Roca. " On-line Human Activity Recognition for Video Surveillance ". Proc. IX National Symposium on Pattern Recognition and Image Analysis (SNRFAI'2001), Castelló, Spain, May 2001.

2000

3. Javier Varona, Jordi Gonzàlez, F.Xavier Roca and Juan J. Villanueva. " Automatic Selection of Keyframes for Activity Recognition ", in 1st International Workshop on Articulated Motion and Deformable Objects (AMDO'2000), Palma de Mallorca, Spain, September 2000.

2. Javier Varona, Jordi Gonzàlez, F.Xavier Roca and Juan J. Villanueva. " iTrack: Image-based Probabilistic Tracking of People ", in 15th International Conference on Pattern Recognition (ICPR'2000), Barcelona, Spain, September 2000.

1999

1. Jordi Gonzàlez, Javier Varona and F.Xavier Roca. " Action Recognition in Application Domains ", CVC Technical Report #13, September 1999.

 


Intranet

Link to the ISE Lab Wiki here (restricted access only).

 


Acknowledgements

AVL: Active Vision Laboratory,  University of Oxford.

CIDA: Centre for Intelligent Data Analysis, University of Brunel.

CORDIS: Community Research and Development Information Service

CVMT: Laboratory of Computer Vision and Media Technology, Aalborg Universitet.

ETHZ: Eidgenöessische Technische Hochschule Zurich.

GVC: Grupo de Visión por Computador y Redes Neuronales, Universidad de Zaragoza.

IAKS: Institut für Algorithmen und Kognitive Systeme, Universität Karlsruhe.

IRI: Institut de Robòtica i Informàtica Industrial, CSIC-UPC.

ISLA: Intelligent Systems Lab Amsterdam, Universiteit van Amsterdam.

UGIV: Unitat de Gràfics i Visió per Ordinador, Universitat de les Illes Balears.

Unit E5 - Cognition: Information Society Directorate General.

 


Contact: Jordi Gonzàlez (poal@cvc.uab.es)

Last modified: May 25, 2009