What's Happening?
The National Ecological Observatory Network (NEON) program, managed by Battelle and funded by the National Science Foundation, is migrating its soil water content and water salinity data (DP1.00094.001) to a new instrument processing pipeline. This update,
effective November 9, 2026, involves changing the averaging intervals for provisional data from 1-minute to 5-minute and 30-minute, replacing the previous 1-minute and 30-minute intervals. This decision was made based on feedback from NEON's Soil Sensor Technical Working Group and external researchers who found the 1-minute data volume too large and noted that soil moisture does not significantly change minute-to-minute. The migration also addresses longstanding data problems, including more accurate reporting of sensor measurement depth and adjustments to automated QA/QC flagging thresholds. All soil water content and water salinity data, both provisional and previously released, will be reprocessed to the new 5-minute and 30-minute averaging intervals and made available in RELEASE-2027, expected in late January 2027.
Why It's Important?
This update is significant for ecological research and environmental monitoring in the U.S. The change in data averaging intervals aims to provide more manageable and relevant data for researchers, potentially improving the efficiency and accuracy of ecological studies. By addressing longstanding problems and refining QA/QC flagging, NEON anticipates a substantial increase in the availability of unflagged, high-quality soil water content data. This enhanced data quality and accessibility can lead to more robust scientific findings regarding soil moisture dynamics, which are crucial for understanding ecosystem health, agricultural productivity, and climate change impacts. Researchers relying on NEON data for modeling, analysis, and policy recommendations will benefit from these improvements, enabling more informed decision-making in environmental management and conservation efforts across the nation.
What's Next?
Data users who combine provisional and released soil water content and water salinity data during this transition period should be aware of the discrepancy in averaging intervals. Prior to the publication of RELEASE-2027, expected in late January 2027, users downloading both released (which includes 1-minute data) and provisional (which includes 5-minute data) will need to use neonUtilities R package version 4.1.0 or later, anticipated for release in November 2026. Alternatively, users can avoid this issue by restricting downloads to the 30-minute data or by accessing released and provisional data separately. After RELEASE-2027, the averaging interval will be consistent across the entire period of record. All code used to generate the updated data product is open-source and available in the NEONScience/NEON-IS-data-processing GitHub repository, allowing for transparency and community engagement.
Beyond the Headlines
The shift in NEON's data processing methodology reflects a broader trend in scientific data management towards optimizing data utility and user experience. The feedback-driven approach, incorporating insights from technical working groups and external researchers, highlights the collaborative nature of large-scale scientific initiatives. This continuous refinement of data products is essential for maintaining the relevance and impact of long-term ecological observatories like NEON. Furthermore, the commitment to open-source code for data generation promotes transparency and reproducibility in scientific research, fostering trust and enabling wider adoption of NEON's valuable ecological datasets. This evolution in data handling underscores the dynamic interplay between technological capabilities, scientific needs, and community input in advancing environmental science.
