From the 2024 Proceedings
Making Research Data Flow With Python
Making Research Data Flow With Python
The increasing volume of research data in fields such as astronomy, biology, and engineering necessitates efficient distributed data management. This paper presents the Librarian, a custom framework designed for data transfer in large academic collaborations, designed for the Simons Observatory.
Josh Borrow, Paul La Plante, James Aguirre, +1
https://doi.org/10.25080/HWGA5253
Echostack: A flexible and scalable open-source software suite for echosounder data processing
Echostack: A flexible and scalable open-source software suite for echosounder data processing
Water column sonar data collected by echosounders are essential for fisheries and marine ecosystem research, enabling the detection, classification, and quantification of fish and zooplankton from many different ocean observing platforms. We introduce Echostack, a suite of open-source Python software packages that leverage existing distributed computing and cloud-interfacing libraries to support intuitive and scalable data access, processing, and interpretation.
Wu-Jung Lee, Valentina Staneva, Landung “Don” Setiawan, +5
https://doi.org/10.25080/WXRH8633
Python-Based GeoImagery Dataset Development for Deep Learning-Driven Forest Wildfire Detection
Python-Based GeoImagery Dataset Development for Deep Learning-Driven Forest Wildfire Detection
In recent years, leveraging satellite imagery with deep learning architectures has become an effective approach for environmental monitoring tasks, including forest wildfire detection. This paper presents a Python-based methodology for gathering and using a labeled high-resolution satellite imagery dataset for forest wildfire detection.
Valeria Martin, Derek Morgan, K. Brent Venable
https://doi.org/10.25080/YADT7194
Echodataflow: Recipe-based Fisheries Acoustics Workflow Orchestration
Echodataflow: Recipe-based Fisheries Acoustics Workflow Orchestration
With the influx of large data from multiple instruments and experiments, scientists are wrangling complex data pipelines that are context-dependent and non-reproducible. Echodataflow provides transparent reproducible pipelines that can be edited with text "recipes", scaled and monitored.
Valentina Staneva, Soham Butala, Landung (Don) Setiawan, +1
https://doi.org/10.25080/JXDK4427
The annual SciPy Conferences allows participants from academic, commercial, and governmental organizations to:
- showcase their latest Scientific Python projects,
- learn from skilled users and developers, and
- collaborate on code development.
The conferences generally consists of multiple days of tutorials followed by two-three days of presentations, and concludes with 1-2 days developer sprints on projects of interest to the attendees.
- (N.d.). 10.25080/issn.2575-9752