Chapter 12

1. Chapter 12 Spatial Sharpening of Spectral Image Data

2. Spatially enhanced unmixing

3. Figure A y HSI cube Pan-MS x Superpixel contains s sharpening band Subpixels corresponding to an HSI pixel (s=9 for this example) Rp(λ) * spectral convolution * spatial convolution λ Pan-MS superpixel His His DC DC Linear Histogram transform yields m and b Transforms high resolution spatial sharpening data into common radiometry with the low resolution HSI derived sharpening bands.

4. To define the radiometric relationship between the HSI data and the sharpening data we need to derive transform coefficients This can be expressed as (1) or its numerical equivalent (2)

5. spatially convolve the sharpening bands down to the HSI superpixel size (3)

6. Schott 1997 suggests that the differences in the atmosphere, atmospheric correction errors, instrument calibration, sensor gain and bias are to first order linear such that the aggregate relation due to any combination can be expressed as: (4)

7. For synthesized and corresponding region of spatially degraded band p (5) (6) use these values to transform the sharpening band(s) images into common radiometry with the HSI synthesized bands and more importantly, the synthesized end members using (7)

8. We are going to use the subpixel data to unmix down to the subpixel level (8) or (9) where Is the observed element column vector for the jth pixel made up of the radiometrically equalized sharpening band values (note: if only one sharpening band is used, this is simply the normalized pan band brightness for the jth pixel.

9. spectral response functions for the sharpening bands is the fraction of the nth end member in the jth pixel and is the vector containing the error in the model for the jth pixel

10. Is the matrix of end member vectors and Is a column vector containing the fraction of each member in the jth sub pixel

11. consistency constraints require that the subpixel fractional average must equal the superpixel fractions (10)

12. squared error metric (11)

13. Gross and Schott Figures 3,4

14. Gross+Schott 96 fig 5

15. Figure 6

16. Figure 7

17. Figure 8

18. Spatial Fusion Single sharpening band, output spectral brightness is computed for each pixel in a superpixel (12)

19. For poorly correlated bands, a regression equation is solved of the following form (13) Once the coefficients are computed, they are applied at the subpixel level according to: (14)

20. Figure B: fusion scheme 1) • Compute image wide single band correlation's between each • hyperspectral band and the pan superpixel brightnesses. • -Select bands with correlation's r2>T (threshold 0.85-0.95) • -Generate hybrid images at highest resolution for all highly • correlated bands using simple ratio method (Equation 11) • -Note, if multiple sharpening bands are available, the correlation • with each sharpening bands is computed and the most highly • correlated band is used for that hyperspectral band. 2) • Classify HSI scene using an unsupervised classifier (e.g.. K means)

21. Fusion scheme B con’t 3) • Use image wide (global) classification to support 2 band regressions • -Compute image wide residuals for all two band regressions • using each of the remaining HSI bands as dependent • variable and the sharpening band(s) or the hybrid bands • from step 1 as the independent variables. For all bands • where the residuals are below a threshold (R) use a two • band regression to compute the hybrid brightness • -Compute regression coefficients by class from the entire scene • using supervised brightness values and the band • combinations with the lowest residuals. • -Apply the regression coefficients at the subpixel level using • the sharpening bands(s) or previously computed hybrid • bands (i.e. from step 1)

22. B con’t: Fusion steps 4 and 5 4) • Repeat step 3 using three independent variables. To date this has been • done with no threshold just accepting the lowest residuals. • However higher order regressions could be used and step 3 • repeated again. 5) • The output from this process is a hybrid image cube at the spatial • resolution of the sharpening band(s).

23. B con’t: Fusion variations Variations A) step 1 could be implemented using alternate ratios at the subpixel level (i.e. allow for mixed pixels). If σpan > threshold assume a mixed pixel and use the ratio of the adjacent or target superpixel with the closest mean pan brightness B)The unsupervised image classification can be conducted at the subpixel level and the regression coefficients selected at the subpixel level. This is done using pixel replication to generate HSI pixels at the spatial scale of the sharpening bands. The pixel replicated HSI spectral vectors are then augmented with the sharpening band(s) and the unsupervised classifier run at the highest resolution.

24. Figure C Fused false color IR Spot panchromatic TM false color IR Plate 8.16 Fusion of multispectral TM data with geometrically registered and resampled SPOT data.

25. Robinson figures 1,2 Figure 1. Original synthetic scene (band 2) Figure 2. Sample spectra used for synthetic scene

26. Robinson figures 3,4 Figure 3. Original DAEDALUS scene (band 4) Figure 4. Sample spectra for DAEDALUS scene

27. Robinson figure 5 Figure 5. Test plan overview

28. Robinson figure 7 Figure 7. Fraction maps for DAEDALUS image. Top¯¯key; middle¯¯stepwise unmix/sharpen; bottom-fuse/unmix

29. Robinson figures 6,8 Figure 6. Image enhancement of synthetic scene at various scale factors Figure 8. Image enhancement of DAEDALUS scene at two scale factors