Angularly continuous light‐field format: Concept, implementation, and evaluation
Source abstract
Abstract
Abstract In this paper, we present the concept, the implementation, and the evaluation of our novel angularly continuous light‐field format. We compared the subjective visual performance of our format with the perspective camera format through a series of subjective and objective tests. In our extensive subjective study, we used multiple absolute and comparative rating scales and various visual stimuli with different contents and angular resolutions. The perceived quality was assessed by a total of 36 test participants, who were separated based on their scientific expertise. The objective quality was evaluated through the degradations caused by three well‐known compression methods. The obtained results indicate that our light‐field format may outperform the conventional format, and it generally can provide at least equivalent visual quality. Furthermore, these findings open the way for data size optimization, without compromising the achieved level of perceived quality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image and Video Quality Assessment · Image Enhancement Techniques · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Information Technology and Bionics Pazmany Peter Catholic University Budapest Hungary
Holografika Ltd. Budapest Hungary
Wireless Multimedia Networking Research Group Kingston University London UK
Department of Networked Systems and Services Budapest University of Technology and Economics Budapest Hungary
References (75)
Show source-provided references
1. BrunnströmK BekerSA De MoorK et al.Qualinet white paper on definitions of quality of experience;2013.
2. TrouleauW AshkanA DingW ErikssonB.Just one more: modeling binge watching behavior.Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM;2016. p.1215–1224.10.1145/2939672.2939792 ↗
3. KaraPA NagyZ MartiniMG BarsiA.Cinema as large as life: large‐scale light field cinema system.2017 International Conference on 3D Immersion (IC3D).IEEE;Brussels Belgium;2017. p.1–8.10.1109/IC3D.2017.8251893 ↗
4. CserkaszkyA KaraPA TamboliRR BarsiA MartiniMG BaloghT.Light‐field capture and display systems: limitations challenges and potentials.SPIE novel optical systems design and optimization XXI;San Diego USA;2018. p.1–9.
5. CserkaszkyA KaraPA BarsiA MartiniMG.Towards display‐independent light‐field formats.International Conference on 3D Immersion (IC3D).Brussels:IEEE;2017. p.1–7.10.1109/IC3D.2017.8251903 ↗
6. CserkaszkyA KaraPA BarsiA MartiniMG.Expert evaluation of a novel light‐field visualization format.3DTV Conference;Stockholm Sweden;2018. p.1–4.10.1109/3DTV.2018.8478436 ↗
7. TamboliRR CserkaszkyA KaraPA BarsiA MartiniMG.Objective quality evaluation of an angularly‐continuous light‐field format.nternational Conference on 3D Immersion (IC3D); Brussels Belgium;2018. p.1–8.10.1109/IC3D.2018.8657876 ↗
8. 10.1007/978-3-642-12802-8_1710.1007/978-3-642-12802-8_17 ↗
9. KovácsPT BaloghT.3D display technologies and effects on the human vision system.2011 2nd International Conference on Cognitive Infocommunications (COGINFOCOM). Budapest Hungary:IEEE;2011. p.1–33.
10. 10.1002/9781118583593.ch1710.1002/9781118583593.ch17 ↗
11. KovácsPT BoevA BregovićR GotchevA.Quality measurements of 3D light‐field displays.Proc. Eighth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM); Chandler Arizona;2014. p.1–6.
12. KovácsPT LacknerK BarsiA et al.Measurement of perceived spatial resolution in 3D light‐field displays.International Conference on Image Processing (ICIP). Paris France:IEEE;2014. p.768–772.10.1109/ICIP.2014.7025154 ↗
13. 10.1109/JSTSP.2017.273860610.1109/JSTSP.2017.2738606 ↗
14. KaraPA KovácsPT MartiniMG BarsiA LacknerK BaloghT.Viva la resolution: the perceivable differences between image resolutions for light field displays.5th ISCA/DEGA Workshop on Perceptual Quality of Systems (PQS 2016);Berlin;2016.10.21437/PQS.2016-23 ↗
15. KaraPA MartiniMG KovácsPT et al.Perceived quality of angular resolution for light field displays and the validity of subjective assessment.International Conference on 3D Imaging (IC3D);Liege;2016. p.1–7.10.1109/IC3D.2016.7823450 ↗
16. KaraPA KovácsPT VagharshakyanS et al.The effect of light field reconstruction and angular resolution reduction on the quality of experience.12th International Conference on Signal Image Technology & Internet Based Systems (SITIS) 3rd International Workshop on Quality of Multimedia Services (QUAMUS);Naples;2016. p.781–786.10.1109/SITIS.2016.128 ↗
17. KaraPA TamboliRR CserkaszkyA MartiniMG BarsiA BokorL.The viewing conditions of light‐field video for subjective quality assessment.International Conference on 3D Immersion (IC3D). Brussels Belgium:IEEE;2018. p.1–8.10.1109/IC3D.2018.8657881 ↗
18. KaraPA CserkaszkyA DarukumalliS BarsiA MartiniMG.On the edge of the seat: reduced angular resolution of a light field cinema with fixed observer positions.9th International Conference on Quality of Multimedia Experience (QOMEX);Erfurt;2017. p.1–6.10.1109/QoMEX.2017.7965637 ↗
19. KaraPA CserkaszkyA BarsiA MartiniMG.The couch the sofa and everything in between: discussion on the use case scenarios for light field video streaming services.International Young Researcher Summit on Quality of Experience in Emerging Multimedia Services (QEEMS);Erfurt;2017. p.1–4.
20. KaraPA CserkaszkyA BarsiA PappT MartiniMG BokorL.The interdependence of spatial and angular resolution in the quality of experience of light field visualization.International Conference on 3D Immersion (IC3D).Brussels:IEEE;2017. p.1–8.10.1109/IC3D.2017.8251902 ↗
21. KaraPA TamboliRR CserkaszkyA MartiniMG BarsiA BokorL.The perceived quality of light‐field video services.SPIE Applications of Digital Image Processing XLI;San Diego USA;2018. p.1–10.10.1117/12.2320562 ↗
22. 10.1007/978-3-319-49655-9_5810.1007/978-3-319-49655-9_58 ↗
23. CserkaszkyA KaraPA BarsiA MartiniMG.To interpolate or not to interpolate: subjective assessment of interpolation performance on a light field display.IEEE International Conference on Multimedia and Expo (ICME) 8th Workshop on Hot Topics in 3D Multimedia (HOT3D);Hong Kong;2017. p.55–60.10.1109/ICMEW.2017.8026223 ↗
24. TamboliRR VupparaboinaKK ReadyJ JanaS ChannappayyaS.A subjective evaluation of true 3D images.2014 International Conference on 3D Imaging (IC3D). Brussels Belgium:IEEE;2014. p.1–8.10.1109/IC3D.2014.7032603 ↗
25. 10.1016/j.image.2016.05.01010.1016/j.image.2016.05.010 ↗
26. TamboliRR AppinaB ChannappayyaS JanaS.Achieving high angular resolution via view synthesis: quality assessment of 3D content on super multiview lightfield display.2017 International Conference on 3D Immersion (IC3D). Brussels Belgium:IEEE;2017. p.1–8.10.1109/IC3D.2017.8251906 ↗
27. TamboliRR KaraPA AppinaB MartiniMG ChannappayyaSS JanaS.Effect of primitive features of content on perceived quality of light field visualization.10th International Conference on Quality of Multimedia Experience (QOMEX);Sardinia Italy;2018. p.1–3.10.1109/QoMEX.2018.8463421 ↗
28. TamboliRR ReddyMS KaraPA MartiniMG ChannappayyaSS JanaS.A High‐angular‐resolution turntable data‐set for experiments on light field visualization quality.10th International Conference on Quality of Multimedia Experience (QOMEX);Sardinia Italy;2018. p.1–3.10.1109/QoMEX.2018.8463402 ↗
29. 10.1007/s11042-018-5615-310.1007/s11042-018-5615-3 ↗
30. PerraC SongW LiottaA.Effects of light field subsampling on the quality of experience in refocusing applications.2018 Tenth International Conference on Quality of Multimedia Experience (QOMEX). Pula Italy:IEEE;2018. p.1–3.10.1109/QoMEX.2018.8463393 ↗
31. PerraC MurgiaF GiustoDD.An analysis of 3D point cloud reconstruction from light field images.2016 Sixth International Conference on Image Processing Theory Tools and Applications (IPTA);Oulu Finland;2016. p.1–6.10.1109/IPTA.2016.7821011 ↗
32. PerraC AssuncaoP.High efficiency coding of light field images based on tiling and pseudo‐temporal data arrangement.2016 IEEE International Conference on Multimedia & Expo workshops (ICMEW) IEEE;Seattle WA USA;2016. p.1–4.10.1109/ICMEW.2016.7574671 ↗
33. 10.1109/TIP.2018.279418110.1109/TIP.2018.2794181 ↗
34. ViolaI RerabekM BruylantsT SchelkensP PereiraF EbrahimiT.Objective and subjective evaluation of light field image compression algorithms.2016 Picture Coding Symposium (PCS).IEEE;Nuremberg Germany;2016. p.1–5.10.1109/PCS.2016.7906379 ↗
35. A new framework for interactive quality assessment with application to light field coding
36. 10.1109/TBC.2017.270443010.1109/TBC.2017.2704430 ↗
37. 10.1117/12.224027910.1117/12.2240279 ↗
38. DarukumalliS KaraPA BarsiA MartiniMG BaloghT ChehaibiA.Performance comparison of subjective assessment methodologies for light field displays.2016 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT). Limassol Cyprus:IEEE;2016. p.28–33.10.1109/ISSPIT.2016.7886004 ↗
39. PaudyalP GutierrezJ Le CalletP CarliM BattistiF.Characterization and selection of light field content for perceptual assessment.9th International Conference on Quality of Multimedia Experience (QOMEX 2017); Erfurt Germany;2017. p.1–6.10.1109/QoMEX.2017.7965635 ↗
40. GutiérrezJ PaudyalP CarliM BattistiF LeP.Perceptual analysis and characterization of light field content. Issue Overview p. 49.
41. PaudyalP BattistiF CarliM.Effect of visualization techniques on subjective quality of light field images.2017 IEEE International Conference on Image Processing (ICIP). Beijing China:IEEE;2017. p.196–200.10.1109/ICIP.2017.8296270 ↗
42. PaudyalP BattistiF NeriA CarliM.A study of the impact of light fields watermarking on the perceived quality of the refocused data.2015 3DTV‐Conference: The True Vision ‐ Capture Transmission and Display of 3D Video (3DTV‐CON).IEEE;Lisbon Portugal;2015. p.1–4.10.1109/3DTV.2015.7169370 ↗
43. PaudyalP OlssonR SjöströmM BattistiF CarliM.Smart: a light field image quality dataset.Proceedings of the 7th International Conference on Multimedia Systems. Klagenfurt Austria:ACM;2016. p.49.10.1145/2910017.2910623 ↗
44. MurgiaF GiustoD.A database for evaluating the quality of experience in light field applications.2016 24th Telecommunications Forum (TELFOR).IEEE;Belgrade Serbia;2016. p.1–4.10.1109/TELFOR.2016.7818898 ↗
45. ShiL ZhaoS ZhouW ChenZ.Perceptual evaluation of light field image.2018 25th IEEE International Conference on Image Processing (ICIP). Athens Greece:IEEE;2018. p.41–45.10.1109/ICIP.2018.8451077 ↗
46. RerabekM EbrahimiT.New light field image dataset.8th International Conference on Quality of Multimedia Experience (QOMEX);Lisbon Portugal;2016. p.1–2.
47. WangT‐C ZhuJ‐Y HiroakiE ChandrakerM EfrosAA RamamoorthiR.A 4D light‐field dataset and CNN architectures for material recognition.European conference on computer vision. Amsterdam The Netherlands:Springer;2016. p.121–138.10.1007/978-3-319-46487-9_8 ↗
48. WannerS MeisterS GoldlueckeB.Datasets and benchmarks for densely sampled 4D light fields.VMV Citeseer; Lugano Switzerland;2013. p.225–226.
49. 10.1002/jsid.51410.1002/jsid.514 ↗
50. 10.1007/s00371-009-0311-y10.1007/s00371-009-0311-y ↗
51. CserkaszkyA KaraPA BarsiA MartiniMG.The potential synergies of visual scene reconstruction and medical image reconstruction.SPIE Novel Optical Systems Design and Optimization XXI; San Diego California;2018. p.1–7.10.1117/12.2513649 ↗
52. LévêqueL LiuH BarakovićS et al.On the subjective assessment of the perceived quality of medical images and videos.2018 Tenth International Conference on Quality of Multimedia Experience (QOMEX). Pula Italy:IEEE;2018. p.1–6.10.1109/QoMEX.2018.8463297 ↗
53. WijnantsM LievensH MichielsN PutJ QuaxP LamotteW.Standards‐compliant HTTP adaptive streaming of static light fields.Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. Tokyo Japan:ACM;2018. p.4.10.1145/3281505.3281539 ↗
54. 10.3390/s15040864210.3390/s150408642 ↗
55. LaugwitzB HeldT SchreppM.Construction and evaluation of a user experience questionnaire.Symposium of the Austrian HCI and Usability Engineering Group. Graz Austria:Springer;2008. p.63–76.10.1007/978-3-540-89350-9_6 ↗
56. 10.1016/j.cag.2012.06.00510.1016/j.cag.2012.06.005 ↗
57. 10.1016/j.image.2015.04.01210.1016/j.image.2015.04.012 ↗
58. 10.1007/s00371-015-1127-610.1007/s00371-015-1127-6 ↗
59. TamboliRR KaraPA CserkaszkyA et al.3D objective quality assessment of light field video frames.3DTV Conference;Stockholm Sweden;2018. p.1–4.10.1109/3DTV.2018.8478557 ↗
60. 10.1109/MNET.2016.747434110.1109/MNET.2016.7474341 ↗
61. KovácsPT.3D Video on light‐field displays;2010.
62. KaraPA CserkaszkyA BarsiA MartiniMG BaloghT.Towards adaptive light field video streaming. IEEE COMSOC MMTC Communications‐Frontiers.2017;12(4):50–55.
63. 10.1109/TBC.2018.283473610.1109/TBC.2018.2834736 ↗
64. CserkaszkyA BarsiA NagyZ PuhrG BaloghT KaraPA.Real‐time light‐field 3D telepresence.7th European Workshop on Visual Information Processing (EUVIP); Tampere Finland;2018. p.1–5.10.1109/EUVIP.2018.8611663 ↗
65. LevoyM HanrahanP.Light field rendering.Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. New Orleans Louisiana:ACM;1996. p.31–42.10.1145/237170.237199 ↗
66. GeorgievT YuZ LumsdaineA GomaS.Lytro camera technology: theory algorithms performance analysis.Conference Multimedia Content and Mobile Devices vol. 8667 International Society for Optics and Photonics;Burlingame CA;2013. p.86671J.10.1117/12.2013581 ↗
67. LiuD WangL LiL XiongZ WuF ZengW.Pseudo‐sequence‐based light field image compression.2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). Seattle Washington:IEEE;2016. p.1–4.10.1109/ICMEW.2016.7574674 ↗
68. VieiraA DuarteH PerraC TavoraL AssuncaoP.Data formats for high efficiency coding of Lytro‐Illum light fields.2015 International Conference on Image Processing Theory Tools and Applications (IPTA). Orleans France:IEEE;2015. p.494–497.10.1109/IPTA.2015.7367195 ↗
69. 10.1109/MMUL.2016.6410.1109/MMUL.2016.64 ↗
70. DomańskiM. StankiewiczO WegnerK GrajekT.Immersive visual mediampeg‐i: 360 video virtual navigation and beyond.2017 International Conference on Systems Signals and Image Processing (IWSSIP). Poznan Poland:IEEE;2017. p.1–9.10.1109/IWSSIP.2017.7965623 ↗
71. 10.1109/TBC.2011.210467110.1109/TBC.2011.2104671 ↗
72. WangZ SimoncelliEP BovikAC.Multiscale structural similarity for image quality assessment.The thirty‐seventh asilomar conference on signals systems and computers; Pacific Grove California;2003. p.1398–1402.
73. FSIM: a feature similarity index for image quality assessment
74. 10.1109/TIP.2005.85938910.1109/TIP.2005.859389 ↗
75. 10.1007/978-3-642-00234-210.1007/978-3-642-00234-2 ↗