Auditory Display and Sonification

Mark Ballora, Christopher Roman, Robert Pockalny, Karen Wishner. “Sonification and Science Pedagogy: Preliminary Experiences and Assessments of Earth Science Data Presented in an Undergraduate General Education Course.” Proceedings of the 24th International Conference on Auditory Display (ICAD 2018). June 10-15, 2018, Michigan Technological University.

Presentations at Moogfest 2018: “Sonifying Data and the Sounds of Science.” May 18-19, 2018. Durham, NC.

Daniel George, Duncan Meacher, Mark Ballora, Chad Hanna. "A Carillon of Black Holes.” March 21, 2018. https://arxiv.org/abs/1803.08090

Mark Ballora. Break Presenter: Sonification of Datasets. Geisinger National Symposium: “From Crisis to Cure: Revitalizing America’s Healthcare System.” The Pine Barn Inn, Danville, PA. November 8-10, 2017.

Mark Ballora and Jenni Evans - Spaghetti of Storms - an installation of tropical storm data sonifications. 24th International Conference of Auditory Display (ICAD 2017). June 20-23, 2017, The Pennsylvania State University.

Panelist at DC Art Science Evening Rendezvous (DASER). Presentation: “Seeing with Your Ears: Data Sonification.” Cultural Programs of the National Academy of Sciences, March 16, 2017.

Mark Ballora. “Extended Abstract: Music of Migration and Phenology: Listening to Counterpoints of Musk Ox and Caribou Migrations, and Cycles of Plant Growth.” Proceedings of the 22nd International Conference on Auditory Display (ICAD 2016), July 2-8, 2016, Canberra, Australia, 169-172. https://doi.org/10.21785/icad2016.016 

“Sonifications of the Universe (and more).” Installation/residency. Borland Project Space, Penn State College of Arts and Architecture, November 2 – December 12, 2016.

Mark Ballora. “Piece Description: Growth of the Universe (in log time).” Proceedings of the 41st International Computer Music Conference, September 25 - October 1, 2015, University of North Texas, Denton, TX.

Mark Ballora. “Two examples of sonification for viewer engagement: Hurricanes and squirrel hibernation cycles.” Extended abstract, Proceedings of The 21st International Conference of Auditory Display (ICAD 2015), July 8-10, 2015, Graz, Austria. 

Mark Ballora. “Sonification Strategies for the film Rhythms of the Universe.” Lecture presentation, The 20th International Conference of Auditory Display (ICAD 2014), June 22-25, New York, NY, USA.

Matthew Kenney, Mark Ballora, Susan Brantley. “Isotopic Data Sonification: Shale Hills Critical Zone Observatory.” Poster presentation, The 20th International Conference of Auditory Display (ICAD 2014), June 22-25, New York, NY, USA.

Jeff Rimland, Mark Ballora. “Using Vocal-Based Sounds to Represent Sentiment in Complex Event Processing.” Poster presentation, The 20th International Conference of Auditory Display (ICAD 2014), June 22-25, New York, NY, USA.

Jeffrey C. Rimland, Mark Ballora. “Using Complex Event Processing (CEP) and vocal synthesis techniques to improve comprehension of sonified human-centric data.” Proceedings of the Society for Photo-Optical Instrumentation Engineers (SPIE) v. 9122 Next-Generation Analyst II, 9122-2 (2014).

Mark Ballora (2014). "Sonification, Science and Popular Music: In search of the ‘wow’". Organised Sound, 19, pp 30-40 doi:10.1017/S1355771813000381 

Mark Ballora. “Seeing with Your Ears: Visualizing Data with Sound.” Presentation given at Gordon Research Conference on Visualization in Science and Education, Bryant University, RI, July 21, 2013.

Jeffrey C. Rimland, Mark Ballora, David L. Hall. “Hard and Soft Information Fusion in Sonification for Assistive Mobile Device Technology.” Proceedings of the 19th International Conference on Auditory Display (ICAD 2013). July 6-10, 2013, Lodz, Poland.

Jeffrey C. Rimland, Mark Ballora, Wade Shumaker. “Beyond visualization of big data: a multistage data exploration approach using visualization, sonification, and storification.” Proceedings of the Society for Photo-Optical Instrumentation Engineers (SPIE) v. 8758, Next-Generation Analyst: Information Systems and Networks: Processing, Fusion, and Knowledge Generation 2013, 8758-22.

Mark Ballora, George Smoot III. "Sound: The Music of the Universe.” Huffington Post TED Weekends. February 23, 2013.

Agnieszka Roginska, Mohanraj Hariharan, Mark Ballora, Kent Friedman. “Immersive sonification for displaying brain scan data.” HEALTHINF 2013, 6th International Conference on Biomedical Electronics and Devices, Barcelona, Spain, February 11-14, 2013.

Mark Ballora, Robert J. Cole, Heidi Kruesi, Herbert Greene, Ganesh Mohanan, David L. Hall. “Use of Sonification in the Detection of Anomalous Events.” Proceedings of the Society for Photo-Optical Instrumentation Engineers (SPIE) v. 8407, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012, 84070S (May 1, 2012); doi:10.1117/12.918688.

Mark Ballora, Nicklaus A. Giacobe, Michael McNeese, David L. Hall. "Information Data Fusion and Computer Network Defense," chapter in Situational Awareness in Computer Network Defense: Principles, Methods and Applications. Cyril Onwubiko, and Thomas Owens, eds. IGI Global, Inc. 2012.

Mark Ballora. “Opening Your Ears to Data.” TEDxPSU presentation, Penn State University, November 13, 2011.

Mark Ballora, Robert J. Cole, Heidi Kruesi, Herbert Greene, Ganesh Mohanan, David L. Hall. “Use of Auditory Displays in Anomaly Detection.” National Symposium on Sensor and Data Fusion, October 24-28, 2011, Washington, DC.

Mark Ballora, Nicklaus A. Giacobe, David L. Hall. “Songs of cyberspace: an update on sonifications of network traffic to support situational awareness.” Proceedings of the Society for Photo-Optical Instrumentation Engineers (SPIE) v. 8064, 80640P (2011); doi:10.1117/12.883443.

Mark Ballora, Brian Panulla, Matt Gourley, David L. Hall. “Preliminary Sonification of Web Log Data.” Poster presentation, International Conference of Auditory Display (ICAD), June 11-15, 2010, Washington, DC.

Mark Ballora, Brian Panulla, Matt Gourley, David L. Hall. “Preliminary Sonification of Web Log Data”  Poster/Demonstration, International Computer Music Conference, June 1-5, 2010, Stonybrook University, NY.

Mark Ballora, David L. Hall. “Do you see what I hear? Experiments in multi-channel sound and 3D visualization for network monitoring.” Proceedings of Society of Photo-Optical Instrumentation Engineers (SPIE) vol. 7709, 77090J (2010); doi:10.1117/12.850319.

“Beyond Visualization – Sonification.” Invited chapter in Human-Centered Information Fusion (Artech House Electronic Warfare Library) by David L. Hall and John M. Jordan. Artech House Publishers, 2010.

Workshop leader: “Sound as Information and Sonification.” The 14th International Symposium on Electronic Art (ISEA2008). Held July 25 - August 3, 2008, Singapore.

Mark Ballora, S. Lee Hong, Brian Panulla, David Hall, "Information through Sound: Understanding Data through Sonification." Proceedings of ISEA2008, The 14th International Symposium on Electronic Art. Held July 25 - August 3, 2008, Singapore. pp. 47-49.

Ballora, Mark, Bruce Pennnycook, Plamen Ch. Ivanov, Leon Glass, Ary Goldberger. "Heart Rate Sonification: A New Approach to Medical Diagnosis."  LEONARDO 37(1) pp. 41-46, 2004.

Ballora, Mark, Bruce Pennycook, Plamen Ch. Ivanov, Ary Goldberger, Leon Glass, 2003. "Data Analysis through Auditory Display: Applications in Heart Rate Variability." Poster presentation, Society for Arts in Healthcare Conference. San Diego, CA. April 9-12, 2003.

Ballora, Mark, Bruce Pennycook, Plamen Ch. Ivanov, Ary Goldberger, Leon Glass.  “Detection of obstructive sleep apnea through auditory display of heart rate variability.”  Computers in Cardiology 2000, Cambridge, Massachusetts.

Ballora, Mark, Bruce Pennycook and Leon Glass, 2000.  “Sonification of Heart Rate Variability Data.”  Demonstration/poster at the International Conference on Auditory Display, Atlanta, Georgia.

Ballora, Mark, Bruce Pennycook, Leon Glass, 2000.  “Audification of Heart Rhythms in Csound.”  The Csound Book, R. Boulanger and B. Vercoe, eds.  MIT Press.

Ballora, Mark, 2000. "Data Analysis through Auditory Display: Applications in Heart Rate Variability." Ph.D thesis, McGill University.

 

mark.ballora <at> gmail.com | ballora <at> psu.edu | Contact me