Research

My research develops computational methods for learning and extracting structure from complex visual and temporal data. Images, video, biological signals, environmental imagery, and social systems are high-dimensional — yet structured. The goal is to recover that hidden structure and turn it into scientific insight.

From data to insight

A common thread runs through my work: discover the latent structure in raw data, then reason about it.

  1. Complex dataimages · video · signals · networks
  2. Structure discoverygeometry · motion · interactions · networks
  3. Scientific insightunderstanding in science & society

Main themes

Five connected lines of research.

01

Geometry & Visual Perception

Recovering 3-D structure and surface geometry from a single image — inferring local surface orientation from the way regular textures distort under perspective, estimating pose, and recovering surface normals using spectral (Fourier) methods.

  • shape-from-texture
  • pose estimation
  • spectral methods
Representative publications
  • E. Ribeiro, E. R. Hancock. “Shape from Periodic Texture Using the Eigenvectors of Local Affine Distortion.” IEEE TPAMI, 2002.
  • E. Ribeiro, E. R. Hancock. “Estimating the Perspective Pose of Texture Planes Using Spectral Analysis on the Unit Sphere.” Pattern Recognition, 2002.
  • E. Ribeiro, E. R. Hancock. “Adapting Spectral Scale for Shape from Texture.” ECCV, 2000.
  • E. Ribeiro, F. Sartori, E. R. Hancock. “An Evidence Combining Approach to Shape-from-Shading.” ICPR, 2002.
02

Temporal Understanding of Visual Data

Making sense of motion in video — tracking objects through occlusion, recognizing human actions, and modeling how a person interacts with objects over time. When someone handles an object, their motion is constrained by that object’s shape and affordance — a cue for actor–object interaction recognition.

  • tracking
  • motion
  • action recognition
  • activity discovery
Representative publications
  • R. Filipovych, E. Ribeiro. “Recognizing Primitive Interactions by Exploring Actor-Object States.” IEEE CVPR, 2008.
  • R. Filipovych, E. Ribeiro. “Robust Sequence Alignment for Actor-Object Interaction Recognition: Discovering Actor-Object States.” Computer Vision and Image Understanding, 2011.
  • R. Filipovych, E. Ribeiro. “Learning Human Motion Models from Unsegmented Videos.” IEEE CVPR, 2008.
  • D. Kular, E. Ribeiro. “Analyzing Activities in Videos Using Latent Dirichlet Allocation and Granger Causality.” ISVC, 2015.
  • I. Bogun, E. Ribeiro. “Object-Aware Tracking.” ICPR, 2016.
03

Recognition & Classification in Complex Domains

Bringing recognition methods to challenging scientific data — identifying pollen grains in optical microscopy, classifying coral-reef textures, and recognizing frog (anuran) calls from audio spectrograms for biodiversity monitoring.

  • pollen
  • coral reefs
  • bioacoustics
  • microscopy
Representative publications
  • J. Strout, B. Rogan, S. M. M. Seyednezhad, M. Bush, E. Ribeiro. “Anuran Call Classification with Deep Learning.” IEEE ICASSP, 2017.
  • A. Daood, E. Ribeiro, M. Bush. “Pollen Grain Recognition Using Deep Learning.” ISVC, 2016.
  • R. Filipovych, A. Daood, E. Ribeiro, M. Bush. “Pollen Recognition in Optical Microscopy by Matching Multifocal Image Sequences.” ICPR, 2016.
  • Z. Ferris, E. Ribeiro, T. Nagata, R. van Woesik. “ReScape: Transforming Coral-Reefscape Images for Quantitative Analysis.” Scientific Reports, 2024.
  • A. Mehta, E. Ribeiro, J. Gilner, R. van Woesik. “Coral Reef Texture Classification Using Support Vector Machines.” VISAPP, 2007.
04

Learning Representations for Complex Signals

Designing and compressing deep models — learning compact, efficient representations through weight pruning and knowledge distillation, and combining information across multiple modalities.

  • deep learning
  • model compression
  • multimodal
Representative publications
  • N. Aghli, E. Ribeiro. “Combining Weight Pruning and Knowledge Distillation for CNN Compression.” IEEE/CVF CVPR Workshops, 2021.
  • N. Aghli, E. Ribeiro. “A Data-Driven Approach to Improve 3D Head-Pose Estimation.” ISVC, 2021.
  • L. Scabini, L. Ribas, E. Ribeiro, O. Bruno. “Deep Topological Embedding with Convolutional Neural Networks for Complex Network Classification.” NetSci-X, 2022.
05

Complex Systems & Network Analysis

Discovering patterns in networked and social data — the temporal rhythms and travelling waves of urban crime, characterization of social-media communities, political influence in multi-party systems, and culture networks.

  • social media
  • crime dynamics
  • culture networks
Representative publications
  • M. Oliveira, E. Ribeiro, C. Bastos-Filho, R. Menezes. “Spatio-temporal Variations in the Urban Rhythm: The Travelling Waves of Crime.” EPJ Data Science, 2018.
  • L. Berrisfeld, E. Ribeiro, R. Menezes. “Estimating Annual Ambient Air Pollution Using Structural Properties of Road Networks.” Environment and Planning B, 2024.
  • J. Faustino, H. Barbosa, E. Ribeiro, R. Menezes. “A Data-Driven Network Approach for Characterization of Political Parties’ Ideology Dynamics.” Applied Network Science, 2019.
  • D. K. Kular, R. Menezes, E. Ribeiro. “Using Network Analysis to Understand the Relation Between Cuisine and Culture.” IEEE Network Science Workshop, 2011.

Funded research

Selected externally funded projects, applying vision and machine learning to problems in aerospace, defense, government, and industry.

  1. National Science Foundation (NSF) 2012–2015$360,000

    Automated Recognition and Mapping of Anuran (Frog) Calls PI

    A full platform for automated species identification and geographic mapping of frog calls — integrating CNN/RNN acoustic classifiers, mobile data collection, and a web-based mapping dashboard for biodiversity monitoring by field biologists.

    Recognition & Classification in Complex Domains
  2. Office of Naval Research (ONR) 2005–2008$250,000

    Automated Image-Based Screening of Marine Coatings PI

    High-throughput image analysis for quantitative assessment of biofouling on novel coating materials, replacing labor-intensive manual scoring — using texture-based segmentation and a calibrated imaging pipeline reproducible across laboratories.

    Recognition & Classification in Complex Domains
  3. Embraer, Inc. 2019–2021$150,000

    AI System for Passenger Identification and Behavioral Analysis PI

    An end-to-end deep-learning system for estimating passenger identity and emotional state from aircraft cabin cameras — using multi-task CNN architectures, domain adaptation for varied lighting, and model compression for edge inference on embedded hardware.

    Learning Representations for Complex Signals
  4. NASA 2024–2025$94,000

    Computer-Vision Pipeline for Rocket-Fuel Slosh Analysis PI

    A GPU-accelerated vision pipeline for automated detection, segmentation, and quantification of fluid-slosh dynamics from high-speed video inside rocket fuel tanks, fusing vision measurements with IMU sensor data against known tank geometry.

    Temporal Understanding of Visual Data

Future directions

Current focus

  • Multimodal perception
  • Efficient deep learning & model compression
  • AI for environmental monitoring

Open challenges

  • Learning from limited data
  • Integrating geometry and deep learning
  • Modeling long-term temporal structure

The throughline: multimodal data contains hidden structure, and vision and machine learning let us discover it — enabling discovery across science and society. See my publications for the full record.