skip to main content
Language:
Primo Search
Clear Search Box
Search in: General Search
Advanced Search
Browse Search

Select-and-Combine (SAC): A Novel Multi-Stereo Depth Fusion Algorithm for Point Cloud Generation via Efficient Local Markov Netlets

Elhashash, Mostafa ; Qin, Rongjun

IEEE transactions on geoscience and remote sensing, 2023-01, Vol.61, p.1-1 [Peer Reviewed Journal]

New York: IEEE

Full text available

Citations Cited by
  • Title:
    Select-and-Combine (SAC): A Novel Multi-Stereo Depth Fusion Algorithm for Point Cloud Generation via Efficient Local Markov Netlets
  • Author: Elhashash, Mostafa ; Qin, Rongjun
  • Subjects: 3D Modeling ; Accuracy ; Algorithms ; Depth ; Depth Fusion ; Errors ; Filtering ; Image processing ; Image reconstruction ; Markov processes ; Matching ; Multi-View Stereo ; Outliers (statistics) ; Point cloud compression ; Systematics ; Three-dimensional displays ; Uncertainty
  • Is Part Of: IEEE transactions on geoscience and remote sensing, 2023-01, Vol.61, p.1-1
  • Description: Many practical systems for image-based surface reconstruction employ a stereo/multi-stereo paradigm, due to its ability to scale for large scenes and its ease of implementation for out-of-core operations. In this process, multiple and abundant depth maps from stereo matching must be combined and fused into a single, consistent, and clean point cloud. However, the noises and outliers caused by stereo matching and the heterogenous geometric errors of the poses present a challenge for existing fusion algorithms, since they mostly assume Gaussian errors and predict fused results based on data from local spatial neighborhoods, which may inherit uncertainties from multiple depths resulting in lowered accuracy. In this paper, we propose a novel depth fusion paradigm, that instead of numerically fusing points from multiple depth maps, selects the best depth map per point, and combines them into a single and clean point cloud. This paradigm, called select-and-combine (SAC), is achieved through modeling the point level fusion using local Markov Netlets, a micro-network over point across neighboring views for depth/view selection, followed by a Netlets collapse process for point combination. The Markov Netlets are optimized such that they can inherently leverage spatial consistencies among depth maps of neighboring views, thus they can address errors beyond Gaussian ones. Our experiment results show that our approach outperforms existing depth fusion approaches by increasing the F1 score that considers both accuracy and completeness by 2.07% compared to the best existing method. Finally, our approach generates clearer point clouds that are 18% less redundant while with a higher accuracy before fusion.
  • Publisher: New York: IEEE
  • Language: English
Back to results list

  • Implemented by: ABCD-USP USP   Social Network Logos: Freepik

Searching Remote Databases, Please Wait

  • Searching for
  • inscope:(USP_PRODUCAO),scope:(USP_EBOOKS),scope:("PRIMO"),scope:(USP),scope:(USP_EREVISTAS),scope:(USP_FISICO),primo_central_multiple_fe
  • Show me what you have so far