Fine-grained object categorization : plant species identification

Abstract : We introduce models for fine-grained categorization, focusing on determining botanical species from leaf images. Images with both uniform and cluttered background are considered and several identification scenarios are presented, including different levels of human participation. Both feature extraction and classification algorithms are investigated. We first leverage domain knowledge from botany to build a hierarchical representation of leaves based on IdKeys, which encode invariable characteristics, and refer to geometric properties (i.e., landmarks) and groups of species (e.g., taxonomic categories). The main idea is to sequentially refine the object description and thus narrow down the set of candidates during the identification task. We also introduce vantage feature frames as a more generic object representation and a mechanism for focusing attention around several vantage points (where to look) and learning dedicated features (what to compute). Based on an underlying coarse-to-fine hierarchy, categorization then proceeds from coarse-grained to fine-grained using local classifiers which are based on likelihood ratios. Motivated by applications, we also introduce on a new approach and performance criterion: report a subset of species whose expected size is minimized subject to containing the true species with high probability. The approach is model-based and outputs a confidence set in analogy with confidence intervals in classical statistics. All methods are illustrated on multiple leaf datasets with comparisons to existing methods.
Complete list of metadatas

Cited literature [123 references]  Display  Hide  Download

https://pastel.archives-ouvertes.fr/tel-01468829
Contributor : Abes Star <>
Submitted on : Wednesday, February 15, 2017 - 5:55:06 PM
Last modification on : Thursday, October 17, 2019 - 12:36:10 PM
Long-term archiving on : Tuesday, May 16, 2017 - 3:43:20 PM

File

TheseRejebSfarV2.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01468829, version 1

Collections

Citation

Asma Rejeb Sfar. Fine-grained object categorization : plant species identification. Information Retrieval [cs.IR]. Télécom ParisTech, 2014. English. ⟨NNT : 2014ENST0046⟩. ⟨tel-01468829⟩

Share

Metrics

Record views

320

Files downloads

228