PDF
PDF

Keywords

sonification
multimodality
data analysis

How to Cite

Ear to the Sky: Astronomical Sonification for Accessible Outreach, Education and Research with STRAUSS. (2024). Revista Mexicana De Astrofísica Y Astronomía Serie De Conferencias, 57, 42. https://doi.org/10.22201/ia.14052059p.2024.57.10

Abstract

The visual bias pervading STEM fields is particularly keen in astronomy, with an emphasis on observation and imaging of astronomical phenomena, and a public perception built on "pretty pictures". However, visual focus is exclusionary for a range of people who have non-visual preferences for learning and communication. Efforts are growing to explore a multimodal approach and express data in new ways. Sonification in particular provides many promising possibilities of building real insights and intuition into complex astronomical data sets, harnessing the high dynamic range of human hearing (in terms of both volume and pitch). Challenging the entrenched visual biases in the presentation of astronomy requires widespread and robust testing of alternative modalities, alongside adequate and general tools to sonify data. The Ear to the Sky project aims to tackle these two aspects through investigating a number of promising applications of sonification in astronomy, while using and developing the strauss Python code as a generalised tool for sonifying data for analysis, outreach and education.

Resumen

El sesgo visual que impregna los campos STEM es especialmente notorio en astronomía, con unénfasis en la observación de fenómenos astronómicos, y una percepción pública construida en torno a ‘imágenes bonitas’. Sin embargo, el enfoque visual excluye a diversas personas que tienen preferencias no visuales para el aprendizaje y la comunicación. Actualmente, existen esfuerzos para explorar un enfoque multimodal y expresar datos de nuevas maneras. La sonificación, en particular, ofrece muchas posibilidades prometedoras para construir percepciones e intuiciones reales en conjuntos de datos astronómicos complejos, aprovechando el rango dinámico elevado de la audición humana (tanto en volumen como en tono). Desafiar los sesgos visuales arraigados la astronomía requiere pruebas extensas y sólidas de modalidades alternativas, junto con herramientas adecuadas y generales para sonificar datos. El proyecto Ear to the Sky tiene como objetivo abordar estos dos aspectos mediante la investigación de varias aplicaciones prometedoras de la sonificación en astronomía, al mismo tiempo que utiliza y desarrolla el co ́digo Python strauss como una herramienta generalizada para sonificar datos con fines de análisis, divulgación y educación.

References

Cantrell, S. J., Walker, B. N., & Moseng, Ø. (2021). Highcharts Sonification Studio: An online, open-source, extensible, and accessible data sonification tool. In Proceedings of the Georgia Institute of Technology

Casado, J., de la Vega, G., & García, B. (2024). SonoUno development: A User-Centered Sonification software for data analysis. Journal of Open Source Software, 9(93), 5819. https://doi.org/10.21105/joss.05819

Casado, J., García, B., Gandhi, P., & Díaz-Merced, W. (2023). arXiv e-prints. Retrieved from https://ui.adsabs.harvard.edu/abs/2023arXiv230200085Cdoi:10.48550/arXiv.2302.00085

De La Vega, G., Exequiel Dominguez, L. M., Casado, J., & García, B. (2023). SonoUno web: an innovative user centred web interface. arXiv e-prints. https://doi.org/10.48550/arXiv.2302.00081

Diaz-Merced, W. (2013). Sound for the exploration of space physics data (PhD thesis). School of Computing Science, University of Glasgow. An optional note

Gozman, K. (2023). Notebooks For All: Making Jupyter Notebooks More Accessible

Harrison, C., Trayford, J., Harrison, L., & Bonne, N. (2022a). Audio universe: tour of the solar system. Astronomy and Geophysics, 63(2), 2.38-2.40. https://doi.org/10.1093/astrogeo/atac027

Harrison, C., Zanella, A., Bonne, N., Meredith, K., & Misdariis, N. (2022b). Audible universe. Nature Astronomy, 6, 22-23. https://doi.org/10.1038/s41550-021-01582-y

Harrison, C. M., Zanella, A., & Girdhar, A. (2024). Evaluation and insights from a sonification-based planetarium show intended for improving inclusivity. Communicating Astronomy with the Public, 33, 6-12

Hunter, J. D. (2007). Matplotlib: A 2D graphics environment. Computing in Science & Engineering, 9(3), 90-95. Publisher: IEEE COMPUTER SOC. https://doi.org/10.1109/MCSE.2007.55

Hunter, J., & Dale, D. (2007). The matplotlib user’s guide. Matplotlib 0.90. 0 user’s guide

Kramer, G., Walker, B., Bonebright, T., Cook, P., Flowers, J., Miner, N., ... Tipei, S. (1999). The sonification report: Status of the field and research agenda. Report prepared for the National Science Foundation by members of the International Community for Auditory Display

Lim, F. V., Toh, W., & Nguyen, T. T. H. (2022). Multimodality in the English language classroom: A systematic review of literature. Linguistics and Education, 69, 101048. Elsevier Özcan, E., Grassi, M., Pauletto, S.,

Misdariis, N., Barrass, S., Bresin, R., & Susini, P. (2022). Sound experts’ perspectives on astronomy sonification projects. Nature Astronomy, 6(11), 1249-1255

Misdariis, N., Pauletto, S., Bonne, N., Harrison, C., Meredith, K., & Zanella, A. (2023). The audible universe workshop: An interdisciplinary approach to the design and evaluation of tools for astronomical data sonification. In International Conference on Auditory Displays

Potluri, V., Thompson, J., Devine, J., Lee, B., Morsi, N., De Halleux, P., Hodges, S., & Mankoff, J. (2022). PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor Data

Reinsch, D., & Hermann, T. (2023). sonecules: a Python Sonification Architecture

Trayford, J. W., Harrison, C. M., Hinz, R. C., Kavanagh Blatt, M., Dougherty, S., & Girdhar, A. (2023). Inspecting spectra with sound: proof-of-concept and extension to datacubes. RAS Techniques and Instruments, 2(1), 387-392. https://doi.org/10.1093/rasti/rzad021

Trayford, J. W., & Harrison, C. M. (2023). Introducing STRAUSS: A flexible sonification Python package. arXiv e-prints

Tucker Brown, J., Harrison, C. M., Zanella, A., & Trayford, J. (2022). Evaluating the efficacy of sonification for signal detection in univariate, evenly sampled light curves using ASTRONIFY. Monthly Notices of the Royal Astronomical Society, 516(4), 5674-5683

Worrall, D., Bylstra, M., Barrass, S., & Dean, R. (2007). SoniPy: The design of an extendable software framework for sonification research and auditory display. In Proceedings of the International Conference on Auditory Display (ICAD)

Zanella, A., Harrison, C. M., Lenzi, S., Cooke, J., Damsma, P., & Fleming, S. W. (2022). Sonification and sound design for astronomy research, education and public engagement. Nature Astronomy, 6, 12411248

Zhang, Y., & Zhao, Y. (2015). Astronomy in the big data era. Data Science Journal, 14, 11-11