Jiang et al., CNN-Based Non-Contact Detection of Food Level in Bottles from RGB Images, MMM2019.
  Jiang et al., When Will Breakfast Be Ready: Temporal Prediction of Food Readiness Using Deep Convolutional Neural Networks on Thermal Videos, ICMEW2018.
  Dunn et al., User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction, MMSP2018.
  Jiang et al., Hardware Synchronization of Multiple Kinects and Microphones for 3D Audiovisual Spatiotemporal Data Capture, ICME2018.
  Guo et al., Spatiotemporal 3D Models of Aging Fruit from Multi-View Time-Lapse Videos, MMM2018.
  Guo et al., Multi-Camera Microenvironment to Capture Multi-view Time-lapse Videos for 3D Analysis of Aging Objects, MMM2018.
  Quant et al., A Virtual Reality Interface for Interactions with Spatiotemporal 3D Data, MMM2018.
  Lamb et al., Programmatic 3D Printing of a Revolving Camera Track to Automatically Capture Dense Images for 3D Scanning of Objects, MMM2018.

I am currently looking for graduate and undergraduate students of high caliber for assistantships. Please contact me via email for details about available positions.


RESEARCH

My research lies at the intersection of computer graphics and computer vision. I perform research on using dense multi-camera systems to obtain 3D understanding of spatiotemporal changes to the shapes and appearances of objects due to environmental impact and human interactions, and on providing photorealistic manipulations in mixed reality environments based on this understanding.


I co-direct the Terascale All-sensing Research Studio (TARS) at Clarkson University with Dr. Sean Banerjee. Graduate and undergraduate students at our studio perform research in areas such as computer graphics, computer vision, software engineering, natural language processing, robotics, and human-computer interaction, and provide exciting new approaches to problems in human-behavior understanding, software repositories, multi-camera systems, 3D printing, and mixed reality. Visit the studio website to know more about current projects.

FUNDING

[NSF CRI] Omniview Multi-modal Sensor Laboratory for Understanding Human Interactions in Ubiquitous Environments, $746,916 (2017). In collaboration with Dr. Sean Banerjee.

[NSF CITeR] Single-shot contact-less fingerprints, $20,000 (2017). In collaboration with Dr. Stephanie Schuckers and Dr. Sean Banerjee.

[ISE Seed Grant] Global Mapping of Airborne Particulate Matter from Analysis of Photographs, $25,000 (2016). In colloboration with Dr. Suresh Dhaniyala and Dr. Jan Scrimgeour.

[NSF CITeR] Longitudinal Collection of Child Face Photographs, $40,000 (2015). In colloboration with Dr. Stephanie Schuckers.

PUBLICATIONS

Y. Jiang, E. Schenck, S. Kranz, S. Banerjee, and N. K. Banerjee (2019). CNN-Based Non-Contact Detection of Food Level in Bottles from RGB Images. The 25th International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece.

T. Dunn, S. Banerjee, and N. K. Banerjee (2018). User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction. 20th International Workshop on Multimedia Signal Processing (MMSP), Vancouver, Canada.

Y. Jiang, M. Luo, S. Banerjee, and N. K. Banerjee (2018). When Will Breakfast Be Ready: Temporal Prediction of Food Readiness Using Deep Convolutional Neural Networks on Thermal Videos. International Conference on Multimedia and Expo Workshops (ICMEW), San Diego, CA.

Y. Jiang, D. Russell, T. Godisart, N. K. Banerjee, and S. Banerjee (2018). Hardware Synchronization of Multiple Kinects and Microphones for 3D Audiovisual Spatiotemporal Data Capture. International Conference on Multimedia and Expo (ICME), San Diego, CA.

D. Gwinn, J. Helmick, N. K. Banerjee, and S. Banerjee (2018). Optimal Estimation of Census Block Group Clusters to Improve the Computational Efficiency of Drive Time Calculations. 4th International Conference on Geographical Information Systems Theory, Applications and Management (GISTAM), Madeira, Portugal.

L. Guo, H. Quant, N. Lamb, B. Lowit, S. Banerjee, and N. K. Banerjee (2018). Spatiotemporal 3D Models of Aging Fruit from Multi-View Time-Lapse Videos. The 24th International Conference on Multimedia Modeling, Bangkok, Thailand.

L. Guo, H. Quant, N. Lamb, B. Lowit, N. K. Banerjee, and S. Banerjee (2018). Multi-Camera Microenvironment to Capture Multi-view Time-lapse Videos for 3D Analysis of Aging Objects. The 24th International Conference on Multimedia Modeling, Bangkok, Thailand.

H. Quant, S. Banerjee, and N. K. Banerjee (2018). A Virtual Reality Interface for Interactions with Spatiotemporal 3D Data. The 24th International Conference on Multimedia Modeling, Bangkok, Thailand.

N. Lamb, N. K. Banerjee, and S. Banerjee (2018). Programmatic 3D Printing of a Revolving Camera Track to Automatically Capture Dense Images for 3D Scanning of Objects. The 24th International Conference on Multimedia Modeling, Bangkok, Thailand.

N. K. Banerjee, M. Simms, and S. Banerjee (2017). Image-based Keyword Search and Activity Retrieval for Social Medial Forensics. 12th Annual Symposium on Information Assurance (co-located with 20th Annual New York State Cyber Security Conference), Albany, New York.

T. Dunn, N. K. Banerjee, and S. Banerjee (2016). GPU Acceleration of Document Similarity Measures for Automated Bug Triaging. 1st International Workshop on Software Faults (co-located with 27th International Symposium on Software Reliability Engineering, ISSRE), Ottawa, Canada.

Z. Cao, Y. Sheikh, and N. K. Banerjee (2016). Real-time scalable 6DOF pose estimation for textureless objects. IEEE Conference on Robotics and Automation, Stockholm, Sweden.

Y. Gao, D. Hou, N. K. Banerjee, and S. Banerjee (2016). Water Fixture Identification in Smart Housing: A Domain Knowledge Based Case Study. 15th Int'l Conference on Machine Learning and Applications, Anaheim, California.

N. Kholgade (now N. K. Banerjee), T. Simon, A. Efros, and Y. Sheikh (2014). 3D Object Manipulation in a Single Photograph using Stock 3D Models. ACM Transations on Graphics (Proceedings of SIGGRAPH 2014).

N. Kholgade (now N. K. Banerjee), I. Matthews, and Y. Sheikh (2011). Content Retargeting Using Parameter-Parallel Facial Layers ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), Vancouver, BC.

N. Kholgade (now N. K. Banerjee), and A. Savakis (2009). Human activity recognition using the 4D spatiotemporal shape context descriptor. International Symposium on Visual Computing, 2, pp. 357-366.

N. Kholgade (now N. K. Banerjee), and A. Savakis (2009). Human activity recognition using the 4D spatiotemporal shape context descriptor. International Symposium on Visual Computing, 2, pp. 357-366.

N. Kholgade (now N. K. Banerjee), and A. Savakis (2008). Human activity recognition in video using two methods for matching shape contexts of silhouettes. SPIE Defense and Security Symposium.

TEACHING

[Fall 2018]CS242 Advanced Programming Concepts in Java
[Fall 2018]CS652 / EE652 Computer Vision
[Spring 2018]CS652 / EE652 Computer Vision
[Spring 2018]CS452 / EE465 / CS552 / EE505 Computer Graphics
[Spring 2018]CS461 / CS561 Mixed Reality
[Fall 2017]CS242 Advanced Programming Concepts in Java
[Fall 2017]CS652 / EE652 Computer Vision
[Summer 2017]Horizons II One Week Course on Programming
[Spring 2017]CS452 / EE465 / CS552 / EE505 Computer Graphics
[Spring 2017]CS459 / CS559 Human-Computer Interaction
[Fall 2016]CS242 Advanced Programming Concepts in Java
[Fall 2016]CS652 / EE652 Computer Vision
[Summer 2016]Horizons II One Week Course on Programming
[Summer 2016]Horizons III One Week Course on Graphics and HCI
[Spring 2016]CS452 / EE465 / CS552 / EE505 Computer Graphics
[Spring 2016]CS459 / CS559 Human-Computer Interaction
[Fall 2015]CS652 / EE652 Computer Vision

STUDENTS

[PhD]Yijun Jiang, Computer Science
[PhD]Gennady Staskevich, Computer Science
[PhD]Edward Verenich, Computer Science
[PhD]Corey Pentasuglia, Computer Science
[MS]Miao Luo, Computer Science
[BS]Nikolas Lamb, Computer Science
[BS]Tim Dunn, Electrical Engineering / Computer Science, Honors
[BS]David Russell, Computer Science, Honors
[BS]Benjamin Moeller, Computer Science
[BS]Elim Schenck, Computer Engineering
[BS]Hannah DeFazio, Computer Science / Computer Engineering, Honors
[BS]Jenna Ryan, Computer Science / Mathematics, Honors
[BS]Alexander Kupin, Computer Science
[I co-advise several students with Dr. Sean Banerjee.]

PRESS

BIOGRAPHY

Natasha Banerjee is an Assistant Professor in the Department of Computer Science at Clarkson University in Potsdam, New York. She received her Ph.D. in 2015 from the Robotics Institute at Carnegie Mellon University, and her B.S. and M.S. degrees in 2009 from the Department of Computer Engineering at Rochester Institute of Technology. Her research lies at the intersection of computer graphics and computer vision, and focuses on understanding spatiotemporal characteristics of objects in three dimensions using large databases of images, videos, and 3D models. She is co-founder and co-director of the Terascale All-Sensing Research Studio (TARS) at Clarkson. Her work received Popular Science magazine's Best of What's New Award in 2014, was a Finalist for the World Technology Award in 2015, and has been covered extensively by several media outlets such as the New York Times, Inside Science TV, Gizmodo, TechCrunch, Clarkson News, and North Country Now. During her off time, Natasha enjoys doing origami, sewing, knitting, woodworking, and working with her spouse and research partner, Dr. Sean Banerjee.

Copyright © Natasha Kholgade Banerjee. All rights reserved.