Two-direction nonlocal model for image interpolation
Source abstract
Abstract
How to sufficiently exploit the self-similarity of natural images for image restoration has attracted extensive interest in the field of image processing in recent years. In fact, the self-similarity implies two-direction similarity structures inherent in images, when a group of similar patches are rearranged to form a matrix, there exists similarity between both columns and rows of this matrix. In this paper, we propose a two-direction nonlocal model (TDNL) to symmetrically exploit the two-direction similarity structures in images, the model directly takes the similar patches as local adaptive dictionary to represent each patch in the image and constrain the representation coefficients by Tikhonov regularization. TDNL can achieve the best results so far and obtain significant gains over the existing methods, in terms of both peak signal to noise ratio (PSNR) measure and the visual quality when it is applied to the problem of image interpolation.
Source: openaire · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Advanced Image Processing Techniques · Image and Signal Denoising Methods · Image Processing Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (36)
Show source-provided references
1. Keys R. Cubic convolution interpolation for digital image processing. IEEE T Acoust Speech Signal Proc, 1981, 6: 1153–116010.1109/TASSP.1981.1163711 ↗
2. Unser M. Splines, a perfect fit for signal and image processing. IEEE Signal Proc Mag, 1999, 16: 22–3810.1109/79.799930 ↗
3. Algazi V R, Ford G E, Potharlanka R. Directional interpolation of images based on visual properties and rank order filtering. IEEE International Conference on Acoustics, Speech, and Signal Processing, vol 4. 1991. 3005–3008
4. Zhang C M, Li X M, Liu H, et al. Cubic surface fitting to image by combination. Sci China Inf Sci, 2010, 53: 1287–129510.1007/s11432-010-4005-x ↗
5. Bayrakeri S D, Mersereau R M. A new method for directional image interpolation. IEEE International Conference on Acoustics, Speech, and Signal Processing, vol 4. 1995. 2383–2386
6. Carrato S, Ramponi G, Marsi S. A simple edge-sensitive image interpolation filter. IEEE International Conference on Image Processing, vol 3. 1996. 111–122
7. Chughtai M A, N Khattak. An edge preserving locally adaptive anti-aliasing zooming algorithm with diffused interpolation. The 3rd Canadian Conference on Computer and Robot Vision, 2006. 234–242
8. Jensen K, Anastassiou D. Subpixel edge localization and the interpolation of still images. IEEE T Image Proc, 1995, 4: 285–29510.1109/83.366477 ↗
9. Jiang H, Moloney C. A new direction adaptive scheme for image interpolation. IEEE International Conference on Image Processing, vol 3. 2002. 369–372
10. Shi H, Ward R. Canny edge based image expansion. IEEE International Symposium on Circuits and Systems, vol 1. 2002. 785–78810.1109/ISCAS.2002.1009958 ↗
11. Allebach J, Wong P W, Edge-directed interpolation. IEEE International Conference on Image Processing, vol 3. 1996. 707–71010.1109/ICIP.1996.560768 ↗
12. Van Ouwerkerk J D. Image super-resolution survey. Image Vision Comput, 2006, 24: 1039–105210.1016/j.imavis.2006.02.026 ↗
13. Wang Q, Ward R K. A new orientation-adaptive interpolation method. IEEE T Image Proc, 2007, 16: 889–90010.1109/TIP.2007.891794 ↗
14. Zhang L, Wu X. An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE T Image Proc, 2006, 15: 2226–223610.1109/TIP.2006.877407 ↗
15. Mallat S, Yu G. Super-resolution with sparse mixing estimators. IEEE T Image Proc, 2010, 19: 2889–290010.1109/TIP.2010.2049927 ↗
16. Li X, Orchard M T. New edge-directed interpolation. IEEE T Image Proc, 2001, 10: 1521–152710.1109/83.951537 ↗
17. Zhang X, Wu X. Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation. IEEE T Image Proc, 2008, 17: 887–89610.1109/TIP.2008.924279 ↗
18. Hung K W, Siu W C. Robust soft-decision interpolation using weighted least squares. IEEE T Image Proc, 2012, 21: 1061–106910.1109/TIP.2011.2168416 ↗
19. Takeda H, Farsiu S, Milanfar P. Kernel regression for image processing and reconstruction. IEEE T Image Proc, 2007, 16: 349–36610.1109/TIP.2006.888330 ↗
20. Dong W S, Zhang L, Shi G, et al. Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE T Image Proc, 2011, 20: 1838–185710.1109/TIP.2011.2108306 ↗
21. Aharon M, Elad M, Bruckstein A M. The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representation. IEEE T Signal Proc, 2006, 54: 4311–432210.1109/TSP.2006.881199 ↗
22. Elad M, Aharon M. Image denoising via sparse and representations over learned dictionaries. IEEE T Image Proc, 2006, 15: 3736–374510.1109/TIP.2006.881969 ↗
23. Malgouyres F, Guichard F. Edge direction preserving image zooming: a mathematical and numerical analysis. SIAM J Num Anal, 2002, 1: 1–37
24. Morse B S, Schwartzwald D. Image magnification using level-set reconstruction. IEEE Conference on Computer Vision and Pattern Recognition, vol 1. 2001. 333–340
25. Aly H A, Dubois E. Image up-sampling using total-variation regularization with a new observation model. IEEE T Image Proc, 2005, 14: 1647–165910.1109/TIP.2005.851684 ↗
26. Calle D, Montanvert A. Super-resolution inducing of an image. IEEE International Conference on Image Processing, vol 3. 1998. 232–235
27. Lu C W, Song G X. An image denoising method using total variation regularization for flow field. J Electron Inf Theor, 2009, 31: 112–115
28. Rudin L I, Osher S J. Fatemi E. Nonlinear total variation based noise removal algorithms. Physica D, 1992, 60: 259–26810.1016/0167-2789(92)90242-F ↗
29. Hao B B, Feng X C. Image zooming based on wavelet and matrix valued diffusion equation. Acta Photon Sin, 2008, 37: 2365–2368
30. Chatterjee P, Milanfar P. Clustering-based denoising with locally learned dictionaries. IEEE T Image Proc, 2009, 18: 1438–145110.1109/TIP.2009.2018575 ↗
31. Zhang L, Dong W, Zhang D, et al. Two-stage image denoising by principal component analysis with local pixel grouping. Patt Recog, 2010, 43: 1531–154910.1016/j.patcog.2009.09.023 ↗
32. Dabov K, Foi A, Katkovnik V, et al. Image denoising by sparse 3D transform domain collaborative filtering. IEEE T Image Proc, 2007, 16: 2080–209510.1109/TIP.2007.901238 ↗
33. Mairal J, F Bach, Ponce J, et al. Non-local sparse models for image restoration. IEEE International Conference on Computer Vision, Kyoto, 2009. 2272–227910.1109/ICCV.2009.5459452 ↗
34. Wright J, Yang A, Ganesh A, et al. Robust face recognition via sparse representation. IEEE T Pattern Anal Mach Intell, 2009, 31: 210–22710.1109/TPAMI.2008.79 ↗
35. Buades A, Coll B, Morel J M. A non-local algorithm for image denoising. IEEE Conference on Computer Vision and Pattern Recognition, vol 2. 2005. 60–65
36. Wang Z, Bovik A C, Sheikh H R, et al. Image quality assessment: from error visibility to structural similarity. IEEE T Image Proc, 2004, 13: 600–61210.1109/TIP.2003.819861 ↗