Logo Lanfrica

SAR Backscatter, not Optical Indices or Phenology, Drives Cropland Classification Accuracy: A Multi-Sensor Feature Ablation Study in the Abuja Municipal Area Council, Nigeria

Domain:

geospatialagriculture

Record type:

paper
Creator:
IdrSalHudNaf
Publisher:
RSI
Host:
Cropland mapping in rapidly urbanizing tropical regions increasingly relies on multi-sensor Earth observation, yet the individual contribution of different sensor and feature types to classification accuracy is rarely quantified explicitly. Building on a prior comparative study of Random Forest (RF) and Gradient Tree Boosting classifiers using a 20-band Sentinel-1/Sentinel-2 feature stack over the Abuja Municipal Area Council (AMAC), Nigeria, this study conducts a systematic feature ablation to isolate the marginal contribution of spectral indices, NDVI-derived phenological metrics, and Synthetic Aperture Radar (SAR) backscatter to cropland classification accuracy. Six feature-stack combinations, ranging from optical-only to the full fused stack, were classified using an RF classifier with fixed hyperparameters and the same stratified reference dataset (373 validation points) used in the original study. Overall accuracy, Kappa coefficient, and cropland-specific precision, recall, and F1-score were compared across combinations, and McNemar's test was used to assess whether accuracy differences between stacks were statistically significant. Results show that SAR backscatter, not spectral indices or phenological metrics, was the dominant driver of accuracy gains: the optical-plus-SAR combination achieved the highest overall accuracy (74.8%) and Kappa (0.685) of all six combinations tested, exceeding even the full fused stack (73.5%, κ=0.668), while adding spectral indices and phenological metrics without SAR reduced accuracy below the optical-only baseline (67.0% vs. 68.9%). McNemar's tests confirmed the full stack was not significantly different from the optical-only baseline or the optical-plus-SAR combination (p > 0.05), but was significantly more accurate than any combination lacking SAR (p < 0.05). Gini-based variable importance ranked VH backscatter and VH temporal variance as the two most important predictors among all 20 bands, and this ranking was corroborated by a permutation-importance cross-check on an independently trained model, which agreed with Gini importance on both top-ranked SAR bands despite the two methods diverging further down the ranking  indicating SAR's dominance is a robust finding rather than an artifact of Gini importance's known bias toward continuous variables. These findings indicate that, in this tropical savanna setting, radar data delivers the largest return on investment for operational cropland monitoring, while spectral indices and phenological metrics contribute comparatively little value on their own.

Languages

Similar