Figure 4.
The flow diagram illustrates a feature processing pipeline that enhances captured intensity frames using event data. The upper branch processes captured intensity frames affected by low resolution, low dynamic range, defocus blurring, low light, rain streaks, and occlusion through intensity feature extraction. The lower branch processes captured event frames containing rich textures, high dynamic range information, and details under low light and occlusion through event feature extraction. The extracted features from both branches are combined in a feature fusion, processing, and reconstruction module. Event driven loss functions are incorporated during training. The output consists of enhanced intensity frames reconstructed using fused intensity and event features.The typical pipeline of how spatial (in Section 4) enhancement methods work with event information to restore the degraded images/videos