Title: "Activity Summarization from 3D Video Systems in an Eldercare Environment"

Abstract: This talk concerns eldercare.  Older adults are living longer and more fulfilled lives, and they desire to live as independently as possible in the home of their choice. However, independent lifestyles come with risks that are complicated by chronic illness and impairments in mobility, cognition, and the senses.  In response to this trend, the University of Missouri has been investigating new approaches in caring for the elderly. This research focus has resulted in TigerPlace, an apartment complex for seniors that opened in Columbia, Missouri in 2004.  A joint venture between MU’s Sinclair School of Nursing and Americare Systems Inc., TigerPlace is one of four projects granted state approval to operate under the “aging in place” model of care giving. Under that model, residents who would otherwise be required by state law to live in nursing homes may have health services brought to them in their apartments instead.  One focus of our large multidisciplinary research team, including faculty and students from Engineering, Nursing, Health Management and Informatics, Medicine, Social Work, and Physical Therapy, is the creation of intelligent systems that use sensors to uncover patterns of activity helpful to caregivers, especially targeting mobility and cognitive impairment.  Details can be found at http://eldertech.missouri.edu.


The larger research program fits perfectly into the concept of Recognition Technology, as defined by L. Zadeh, to be current or future systems that have the potential to provide a "quantum jump in the capabilities of today’s recognition systems", and includes systems that incorporate new sensors, novel signal processing and soft computing.  In this talk, I will concentrate on generating linguistic activity summarization for large amounts of multiple camera video data, depicting activities that might take place in a single person apartment.  Using 2 cameras, a 3-D “voxel person” is constructed (made possible by our high speed GPU construction of silhouettes from image sequences), and sophisticated position and shape features are calculated.  A  hierarchical fuzzy logic system is built to determine memberships in various states, followed by another set of rules to classify activities (early focus on fall detection). Extensions to a fuzzy voxel person to model the uncertainty of reconstruction in some areas of the field of view will be discussed. Additionally, we have recently investigated and constructed a real time multiple stereo camera system that produces true depth-based 3-D objects, providing comprehensive models of the environment and the human within it.  This representation is completely insensitive to (even abrupt) lighting changes and shadows, incorporates a human detector that provides false alarm reduction for change detection regarding movement of nonhuman objects (e.g. chairs) and objects manipulated by a person, and has a natural way to address tracking and updating, i.e. not adapting stationary humans into the background while still absorbing moved objects even under significant lighting variations.


Jim Keller James M. Keller received the Ph.D. in Mathematics in 1978. He holds the University of Missouri Curators’ Professorship in the Electrical and Computer Engineering and Computer Science Departments on the Columbia campus. He is also the R. L. Tatum Professor in the College of Engineering. His research interests center on computational intelligence: fuzzy set theory and fuzzy logic, neural networks, and evolutionary computation with a focus on problems in computer vision, pattern recognition, and information fusion including bioinformatics, spatial reasoning in robotics, geospatial intelligence, sensor and information analysis in technology for eldercare, and landmine detection. His industrial and government funding sources include the Electronics and Space Corporation, Union Electric, Geo-Centers, National Science Foundation, the Administration on Aging, The National Institutes of Health, NASA/JSC, the Air Force Office of Scientific Research, the Army Research Office, the Office of Naval Research, the National Geospatial Intelligence Agency, the Leonard Wood Institute, and the Army Night Vision and Electronic Sensors Directorate. Professor Keller has coauthored over 350 technical publications.


Jim is a Fellow of the Institute of Electrical and Electronics Engineers (IEEE) for whom he has presented live and video tutorials on fuzzy logic in computer vision, is an International Fuzzy Systems Association (IFSA) Fellow, an IEEE Computational Intelligence Society Distinguished Lecturer, a national lecturer for the Association for Computing Machinery (ACM) from 1993 to 2007, and a past President of the North American Fuzzy Information Processing Society (NAFIPS). He received the 2007 Fuzzy Systems Pioneer Award and the 2010 Meritorious Service Award from the IEEE Computational Intelligence Society. He finished a full six year term as Editor-in-Chief of the IEEE Transactions on Fuzzy Systems, is an Associate Editor of the International Journal of Approximate Reasoning, and is on the editorial board of Pattern Analysis and Applications, Fuzzy Sets and Systems, International Journal of Fuzzy Systems, and the Journal of Intelligent and Fuzzy Systems. Jim was the Vice President for Publications of the IEEE Computational Intelligence Society from 2005-2008, and is currently an elected Adcom member. He was the conference chair of the 1991 NAFIPS Workshop, program co-chair of the 1996 NAFIPS meeting, program co-chair of the 1997 IEEE International Conference on Neural Networks, and the program chair of the 1998 IEEE International Conference on Fuzzy Systems. He was the general chair for the 2003 IEEE International Conference on Fuzzy Systems.