Skip to Main content Skip to Navigation

Fine-grained object categorization : plant species identification

Abstract : We introduce models for fine-grained categorization, focusing on determining botanical species from leaf images. Images with both uniform and cluttered background are considered and several identification scenarios are presented, including different levels of human participation. Both feature extraction and classification algorithms are investigated. We first leverage domain knowledge from botany to build a hierarchical representation of leaves based on IdKeys, which encode invariable characteristics, and refer to geometric properties (i.e., landmarks) and groups of species (e.g., taxonomic categories). The main idea is to sequentially refine the object description and thus narrow down the set of candidates during the identification task. We also introduce vantage feature frames as a more generic object representation and a mechanism for focusing attention around several vantage points (where to look) and learning dedicated features (what to compute). Based on an underlying coarse-to-fine hierarchy, categorization then proceeds from coarse-grained to fine-grained using local classifiers which are based on likelihood ratios. Motivated by applications, we also introduce on a new approach and performance criterion: report a subset of species whose expected size is minimized subject to containing the true species with high probability. The approach is model-based and outputs a confidence set in analogy with confidence intervals in classical statistics. All methods are illustrated on multiple leaf datasets with comparisons to existing methods.
Complete list of metadata

Cited literature [123 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Wednesday, February 15, 2017 - 5:55:06 PM
Last modification on : Friday, July 31, 2020 - 10:44:09 AM
Long-term archiving on: : Tuesday, May 16, 2017 - 3:43:20 PM


Version validated by the jury (STAR)


  • HAL Id : tel-01468829, version 1



Asma Rejeb Sfar. Fine-grained object categorization : plant species identification. Information Retrieval [cs.IR]. Télécom ParisTech, 2014. English. ⟨NNT : 2014ENST0046⟩. ⟨tel-01468829⟩



Record views


Files downloads