PCPNET Learning Local Shape Properties from Raw Point Clouds

Paul Guerrero (1) , Yanir Kleiman (2) , Maks Ovsjanikov (2) , Niloy J Mitra Mitra (1)

1 UCL-CS - Department of Computer science [University College of London]
2 LIX - Laboratoire d'informatique de l'École polytechnique [Palaiseau]

In this paper, we propose PCPNET, a deep-learning based approach for estimating local 3D shape properties in point clouds. In contrast to the majority of prior techniques that concentrate on global or mid-level attributes, e.g., for shape classification or semantic labeling, we suggest a patch-based learning method, in which a series of local patches at multiple scales around each point is encoded in a structured manner. Our approach is especially well-adapted for estimating local shape properties such as normals (both unoriented and oriented) and curvature from raw point clouds in the presence of strong noise and multi-scale features. Our main contributions include both a novel multi-scale variant of the recently proposed PointNet architecture with emphasis on local shape information, and a series of novel applications in which we demonstrate how learning from training data arising from well-structured triangle meshes, and applying the trained model to noisy point clouds can produce superior results compared to specialized state-of-the-art techniques. Finally, we demonstrate the utility of our approach in the context of shape reconstruction, by showing how it can be used to extract normal orientation information from point clouds.

Mots clés: CCS Concepts •Computing methodologies → Point-based models

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Paul Guerrero, Yanir Kleiman, Maks Ovsjanikov, Niloy J Mitra Mitra. PCPNET Learning Local Shape Properties from Raw Point Clouds. Computer Graphics Forum, 2018, 37. ⟨hal-01741744⟩