Konsep Desain Multimedia Sinestetik sebagai Pendekatan Baru dalam Penciptaan Pengalaman Visual–Audio Imersif
DOI:
https://doi.org/10.55606/jupikom.v5i1.6135Keywords:
sinestesia, desain multimedia, pengalaman imersif, multisensori, estetika digitalAbstract
Perkembangan teknologi multimedia mendorong penciptaan pengalaman digital yang semakin imersif dan multisensori. Namun, sebagian besar desain multimedia masih berfokus pada aspek visual dan auditif secara terpisah, sehingga belum sepenuhnya menggambarkan keterhubungan persepsi antarindera. Penelitian ini bertujuan untuk mengusulkan Konsep Desain Multimedia Sinestetik sebagai pendekatan baru dalam menciptakan pengalaman visual–audio yang harmonis dan menyeluruh.
Metode penelitian yang digunakan bersifat kualitatif-konseptual melalui analisis literatur dan sintesis teori dari bidang psikologi persepsi, teori warna dan bunyi, serta estetika digital. Proses analisis dilakukan dengan menelaah keterkaitan parameter visual (warna, bentuk, ritme) dan parameter audio (frekuensi, tempo, timbre) untuk merumuskan model konseptual desain multimedia sinestetik.
Hasil kajian menghasilkan model konseptual yang menggambarkan hubungan timbal balik antara elemen visual dan auditif dalam membentuk pengalaman sinestetik yang imersif. Konsep ini berpotensi menjadi dasar pengembangan desain multimedia yang lebih emosional, interaktif, dan responsif terhadap persepsi manusia.
Kesimpulannya, penerapan prinsip sinestetik dapat memperkaya pendekatan desain multimedia dan membuka arah baru bagi penelitian multisensori di bidang desain komunikasi visual dan teknologi kreatif.
References
Anugrah, K. A., & Lukman, A. L. (2024). Sensory design pada arsitektur sekolah playgroup–TK Jagad Alit Waldorf, Bandung. Jurnal RISA (Riset Arsitektur), 4(04), 363-379. https://doi.org/10.26593/risa.v4i04.3939.363-379
Cahyadi, M. H., Prasetya, S. P., Marzuqi, M. I., & Prastiyono, H. (2025). Pengembangan media pembelajaran berbasis metaverse menggunakan Virtual Reality (VR) untuk meningkatkan hasil belajar siswa pada pembelajaran IPS kelas VIII SMP Muhammadiyah 2 Taman Sidoarjo. Jurnal Dialektika Pendidikan IPS. Retrieved from https://ejournal.unesa.ac.id/index.php/PENIPS/article/view/71201
Chen, N., Sørensen, T. A., & Spence, C. (2024). Editorial: Crossmodal correspondence. Frontiers in Psychology, 15, 1385480. https://doi.org/10.3389/fpsyg.2024.1385480
Di Stefano, N., et al. (2024). Perceptual similarity: insights from crossmodal correspondences. Journal of Cognitive Science. https://doi.org/10.1007/s13164-023-00692-y
Elmquist, E., Rind, A., & colleagues. (2024). Parallel Chords: an audio-visual analytics design for parallel coordinates. Personal and Ubiquitous Computing, 28(5), 657-676. https://doi.org/10.1007/s00779-024-01795-8
Ginaryo, R. A., & Mustaji, M. (2024). Pengembangan multimedia interaktif pada materi Prinsip-Prinsip Perancang Visual kelas XI Desain Komunikasi Visual di SMK. Jurnal Mahasiswa Teknologi Pendidikan, 14(2). Retrieved from https://ejournal.unesa.ac.id/index.php/jmtp/article/view/60224
Guiotto Nai Fovino, L., et al. (2024). Evaluating the effectiveness of sonification in science education and communication. Personal and Ubiquitous Computing. https://doi.org/10.1007/s00779-024-01809-5
Hamini, H., & Ardisal, A. (2025). Meningkatkan kemampuan membaca permulaan melalui metode multisensori pada peserta didik disabilitas intelektual. Jurnal Penelitian Pendidikan Khusus, 13(1). https://doi.org/10.24036/juppekhu.v13i1.132944
Jewanski, J. (2020). The evolution of the concept of synesthesia in design and arts. Journal of Design History. https://doi.org/10.1080/0964704X.2019.1675422
Lee, B. P., & colleagues. (2022). Crossmodal correspondences between basic tastes and other sensory attributes: A narrative review. i-Perception. https://doi.org/10.1177/20416695221127325
Li, S., & colleagues. (2021). Synesthetic design of digital elderly products based on big data. Journal of Healthcare Engineering, Article 5596571. https://doi.org/10.1155/2021/5596571
Luo, D., et al. (2024). Multisensory museum experience: an integrative view and framework. International Journal of Heritage Studies. https://doi.org/10.1080/09647775.2024.2357071
Meng, X., et al. (2023). Crossmodal correspondences between visual features and tastes: experimental studies. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2023.1226661
Minciacchi, D., & colleagues. (2023). Editorial: Sonification aesthetic representation of physical quantities. Frontiers in Neuroscience. https://doi.org=10.3389/fnins.2023.1162383
Mansori, M., Kristiono, N., Supriaji, U., Ismaya, R., & Suryana, N. (2023). Transformasi pembelajaran era metaverse: mengintegrasikan teknologi pembelajaran imersif dalam pendidikan modern. Innovative: Journal of Social Science Research, 4(4). https://doi.org/10.31004/innovative.v4i4.14518
Novitasari, K., & Handoko, H. (2023). Pengembangan model multisensori berbasis teknologi multimedia untuk stimulasi kemampuan literasi anak 5-6 tahun. Jurnal Pelita PAUD. https://doi.org/10.33222/pelitapaud.v4i1.816
Padlefi, M. R., Putra, P., Susanti, H., Oktadini, N. R., Meiriza, A., & Sevtiyuni, P. E. (2023). Perancangan Virtual Reality dalam pengenalan Sejarah Perang 5 Hari 5 Malam. ANDHARUPA: Jurnal Desain Komunikasi Visual & Multimedia, 9(1). https://doi.org/10.33633/andharupa.v9i01.7583
Reymore, L., et al. (2025). Color and tone color: audiovisual crossmodal mappings and timbre–color associations. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1520131
Sasu, V. G., et al. (2024). Enhancing multisensory virtual reality environments for psychological therapy. Applied Sciences, 14(19), 8826. https://doi.org/10.3390/app14198826
Spence, C. (2021). Explaining crossmodal correspondences between colours and tastes. i-Perception, 12(3). https://doi.org/10.1177/20416695211018223
Spence, C. (2022). Sensehacking the guest’s multisensory hotel experience. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2022.1014818
Syaputra, E. A., Paninggalih, R., Putri, H. R. D., & Rossalina, N. (2024). Platform visualisasi 3D imersif untuk pelestarian berkelanjutan warisan budaya di Kalimantan Timur. Visual Heritage: Jurnal Kreasi Seni dan Budaya. Retrieved from https://jim.unindra.ac.id/index.php/vhdkv/article/view/16016
Wall, C., et al. (2023). Sonification for personalised gait intervention: narrative review. Sensors, 24(1), 65. https://doi.org/10.3390/s24010065
Xiao, Y., et al. (2024). Research and evaluation of multi-sensory design for virtual packaging. Applied Sciences, 14(17), 7736. https://doi.org/10.3390/app14177736
Xu, H., et al. (2025). Research on the multisensory experience design of interior spaces. Buildings, 15(8), 1393. https://doi.org/10.3390/buildings15081393
Yustina Rensi Dartani, M., & Bimo, D. S. (2024). Potret multimedia interaktif pada pembelajaran daring selama pandemi COVID-19. Jurnal Ilmiah Pendidikan Citra Bakti, 10(3). https://doi.org/10.38048/jipcb.v10i3.1654
Braun, R. (2024). Listening to life: Sonification for enhancing discovery in research and practice. Biotechnology and Bioengineering. https://doi.org/10.1002/bit.28729
Chen, N., Sørensen, T. A., & Spence, C. (2024). Editorial: Crossmodal correspondence. Frontiers in Psychology, 15, 1385480. https://doi.org/10.3389/fpsyg.2024.1385480
Di Stefano, N., et al. (2024). Perceptual similarity: insights from crossmodal correspondences. Journal of Cognitive Science. https://doi.org/10.1007/s13164-023-00692-y
Elmquist, E., Rind, A., & colleagues. (2024). Parallel Chords: An audio-visual analytics design for parallel coordinates. Personal and Ubiquitous Computing, 28(5), 657-676. https://doi.org/10.1007/s00779-024-01795-8
Guiotto Nai Fovino, L., et al. (2024). Evaluating the effectiveness of sonification in science education and communication. Personal and Ubiquitous Computing. https://doi.org/10.1007/s00779-024-01809-5
Lee, B. P., & colleagues. (2022). Crossmodal correspondences between basic tastes and other sensory attributes: A narrative review. i-Perception. https://doi.org/10.1177/20416695221127325
Li, S., & colleagues. (2021). Synesthetic design of digital elderly products based on big data. Journal of Healthcare Engineering, Article 5596571. https://doi.org/10.1155/2021/5596571
Luo, D., et al. (2024). Multisensory museum experience: an integrative view and framework. International Journal of Heritage Studies. https://doi.org/10.1080/09647775.2024.2357071
Matinfar, S., et al. (2023). Sonification as a reliable alternative to conventional visual methods in surgical navigation. Scientific Reports. https://doi.org/10.1038/s41598-023-32778-z
McEwan, J., et al. (2024). Crossmodal correspondence of elevation/pitch and size: new experimental evidence. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-024-02975-7
Meng, X., et al. (2023). Crossmodal correspondences between visual features and tastes: experimental studies. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2023.1226661
Minciacchi, D., & colleagues. (2023). Editorial: Sonification aesthetic representation of physical quantities. Frontiers in Neuroscience. https://doi.org/10.3389/fnins.2023.1162383
Reymore, L., et al. (2025). Color and tone color: audiovisual crossmodal mappings and timbre–color associations. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1520131
Spence, C. (2022). Sensehacking the guest’s multisensory hotel experience. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2022.1014818
Yustina Rensi Dartani, M., & Bimo, D. S. (2024). Potret multimedia interaktif pada pembelajaran daring selama pandemi COVID-19. Jurnal Ilmiah Pendidikan Citra Bakti, 10(3). https://doi.org/10.38048/jipcb.v10i3.1654
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Jurnal Publikasi Ilmu Komputer dan Multimedia
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
