JOURNAL BROWSE
Search
Advanced SearchSearch Tips
Janus - Multi Source Event Detection and Collection System for Effective Surveillance of Criminal Activity
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Janus - Multi Source Event Detection and Collection System for Effective Surveillance of Criminal Activity
Shahabi, Cyrus; Kim, Seon Ho; Nocera, Luciano; Constantinou, Giorgos; Lu, Ying; Cai, Yinghao; Medioni, Gerard; Nevatia, Ramakant; Banaei-Kashani, Farnoush;
  PDF(new window)
 Abstract
Recent technological advances provide the opportunity to use large amounts of multimedia data from a multitude of sensors with different modalities (e.g., video, text) for the detection and characterization of criminal activity. Their integration can compensate for sensor and modality deficiencies by using data from other available sensors and modalities. However, building such an integrated system at the scale of neighborhood and cities is challenging due to the large amount of data to be considered and the need to ensure a short response time to potential criminal activity. In this paper, we present a system that enables multi-modal data collection at scale and automates the detection of events of interest for the surveillance and reconnaissance of criminal activity. The proposed system showcases novel analytical tools that fuse multimedia data streams to automatically detect and identify specific criminal events and activities. More specifically, the system detects and analyzes series of incidents (an incident is an occurrence or artifact relevant to a criminal activity extracted from a single media stream) in the spatiotemporal domain to extract events (actual instances of criminal events) while cross-referencing multimodal media streams and incidents in time and space to provide a comprehensive view to a human operator while avoiding information overload. We present several case studies that demonstrate how the proposed system can provide law enforcement personnel with forensic and real time tools to identify and track potential criminal activity.
 Keywords
Multi-source;Multi-modal Event Detection;Law Enforcement;Criminal Activity;Surveillance;Security;Safety;
 Language
English
 Cited by
1.
Achieving Fair Spectrum Allocation and Reduced Spectrum Handoff in Wireless Sensor Networks: Modeling via Biobjective Optimization, Modelling and Simulation in Engineering, 2014, 2014, 1  crossref(new windwow)
2.
Comparative Study of Human Age Estimation with or without Preclassification of Gender and Facial Expression, The Scientific World Journal, 2014, 2014, 1  crossref(new windwow)
3.
Execution Behavior Modeling Methodology for Large Scale Surveillance System Design and Evaluation, Advances in Multimedia, 2014, 2014, 1  crossref(new windwow)
4.
Nonuniform Video Size Reduction for Moving Objects, The Scientific World Journal, 2014, 2014, 1  crossref(new windwow)
5.
Predicting the next turn at road junction from big traffic data, The Journal of Supercomputing, 2017, 73, 7, 3128  crossref(new windwow)
6.
Trajectory based database management for intelligent surveillance system with heterogeneous sensors, Multimedia Tools and Applications, 2016, 75, 23, 15429  crossref(new windwow)
7.
A network attack forensic platform against HTTP evasive behavior, The Journal of Supercomputing, 2017, 73, 7, 3053  crossref(new windwow)
8.
A wearable guidance system with interactive user interface for persons with visual impairment, Multimedia Tools and Applications, 2016, 75, 23, 15275  crossref(new windwow)
9.
Multi-modal recording and modeling of vocal tract movements, Multimedia Tools and Applications, 2016, 75, 9, 5247  crossref(new windwow)
10.
Detection of damaged files and measurement of similarity to originals using entropy graph characteristics, The Journal of Supercomputing, 2017  crossref(new windwow)
11.
Design and test bed experiments of server operation system using virtualization technology, Human-centric Computing and Information Sciences, 2016, 6, 1  crossref(new windwow)
12.
Detection and Modeling of Cyber Attacks with Petri Nets, Entropy, 2014, 16, 12, 6602  crossref(new windwow)
13.
Mouse operation on monitor by interactive analysis of intuitive hand motions, Multimedia Tools and Applications, 2016, 75, 23, 15261  crossref(new windwow)
14.
Geo-registration of wide-baseline panoramic image sequences using a digital map reference, Multimedia Tools and Applications, 2017, 76, 9, 11215  crossref(new windwow)
15.
System Architecture for Real-Time Face Detection on Analog Video Camera, International Journal of Distributed Sensor Networks, 2015, 11, 5, 251386  crossref(new windwow)
 References
1.
W. Zajdel, J.D. Krijnders, T. Andringa, and D.M. Gavrila, "CASSANDRA: audio-video sensor fusion for aggression detection", Proceedings of IEEE Conference on Advanced Video and Signal Based Surveillance, London, September, 2007, pp. 200-205.

2.
C.G.M. Snoek and M. Worring, "Multimodal Video Indexing: A Review of the State-of-the-art", Multimedia Tools and Applications, Vol. 25, pp.5-35, 2005. crossref(new window)

3.
J. Kang, F. Lv, R. Nevatia, I. Cohen and G. Medioni, "Automatic Tracking and Labeling of Human Activities in a Video Sequence", Proceedings of the 6th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, Prague, Czech Republic, May, 2004.

4.
J. Kang, I. Cohen and G. Medioni, "Persistent Objects Tracking Across Multiple Non Overlapping Cameras", IEEE Workshop on Motion and Video Computing, MOTION'05. Breckenridge, Colorado, Jan 4-5, 2005.

5.
L. Yaroslavsky, B. Fishbain A. Shteinman and Sh. Gepshtein, "Processing and Fusion of Thermal and Video Sequences for Terrestrial Long Range Observation Systems", Proceedings the 7th International Conference on Information Fusion, pp. 848-855, Stockholm, Sweden, June, 2004.

6.
B. Fishbain, L.P. Yaroslavsky and I.A. Ideses, "Spatial, Temporal, and Inter-channel Image Data Fusion for Long-Distance Terrestrial Observation Systems", Advances in Optical Technologies, Vol. 2008, Article ID 546808, 2008.

7.
M. Valera, and S.A. Velastin, "Intelligent distributed surveillance systems: a review". IEEE Proceedings of Vision, Image and Signal Processing, vol. 152, pp.192-204, April, 2005.

8.
K. Toyama, R. Logan, and A. Roseway, "Geographic Location Tags on Digital Images", Proceedings of the ACM International Conference on Multimedia, pp.156-166, 2003.

9.
A. Pigeau and M. Gelgon, "Building and Tracking Hierarchical Geographical & Temporal Partitions for Image Collection Management on Mobile Devices", Proceedings of the ACM International Conference on Multimedia, 2005.

10.
I. Simon and S.M. Seitz. "Scene Segmentation Using the Wisdom of Crowds", Proceedings of European Conference on Computer Vision, Marseille, France, 2008.

11.
Y. Li, N. Snavely, D.P. Huttenlocher, "Location Recognition using Prioritized Feature Matching", Proceedings of European Conference on Computer Vision, Crete, Greece, 2010.

12.
S. Agarwal, N. Snavely, I. Simon, S.M. Seitz, and R. Szeliski, "Building Rome in a Day", Proceedings of International Conference on Computer Vision, 2009.

13.
T. Zhao, R. Nevatia, B. Wu, "Segmentation and Tracking of Multiple Humans in Crowded Environments", IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(7):1198-1211, July, 2008. crossref(new window)

14.
B. Wu and R. Nevatia, "Detection and Tracking of Multiple, Partially Occluded Humans by Bayesian Combination of Edgelet based Part Detectors", International Journal of Computer Vision, Vol. 75, pp.247-266, 2007. crossref(new window)

15.
G. Medioni, I. Cohen, F. Bremond, S. Hongeng, R. Nevatia, "Event detection and analysis from video streams", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.23, pp.873-889, 2001. crossref(new window)

16.
S.A. Ay, R. Zimmermann, and S. Kim. "Viewable Scene Modeling for Geospatial Video Search", Proceedings of the ACM International Conference on Multimedia, pp. 309-318, 2008.

17.
S.A. Ay, L. Zhang, S. Kim, M. He and R. Zimmermann, "GRVS: a georeferenced video search engine", ACM Multimedia 2009.

18.
S. Kim, S.A. Ay, R. Zimmermann, "Design and Implementation of Geo-Tagged Video Search Framework", Journal of Visual Communications and Image Representation Special Issue on Large Scale Image and Video Search; Challenges, Technologies, and Trends, 21(8):773-786, 2010.

19.
Y. Cai, T. B. Dinh, and G. Medioni, "Towards a practical ptz face detection and tracking system", In WACV, 2013.

20.
C. Huang and R. Nevatia, "High performance object detection by collaborative learning of joint ranking of granules features", In CVPR, pages 41-48, 2010.

21.
B. Yang and R. Nevatia, "Online learned discriminative part-based appearance models for multihuman tracking", In ECCV, 2012.

22.
C. Huang, B. Wu, R. Nevatia, "Robust Object Tracking by Hierarchical Association of Detection Responses", In ECCV, 2008.

23.
Ali Khodaei, Cyrus Shahabi, and Chen Li, "Hybrid Indexing and Seamless Ranking of Spatial and Textual Features of Web Documents", 21st International Conference on Database and Expert Systems Applications (DEXA10), Bilbao, Spain , August 2010.

24.
Ali Khodaei, Cyrus Shahabi, and Chen Li, "SKIF-P: a point-based indexing and ranking of web documents for spatial-keyword search", Geoinformatica, Publisher: Springer Netherlands, Issn: 1384- 6175, Doi: 10.1007/s10707-011-0142-7, October 2011. crossref(new window)

25.
Ali Khodaei, Cyrus Shahabi, and Amir Khodaei, "Temporal-Textual Retrieval: Time and Keyword Search in Web Documents", International Journal of Next-Generation Computing, November 2012.

26.
Chi Y., Wang H., Yu P. S., Muntz R. R. (2006): "Catch the Moment: Maintaining Closed Frequent Itemsets in a Data Stream Sliding Window", Knowledge and Information Systems,10(3): 265-294. crossref(new window)