Dataset is considered complete for the information presented, as described in the abstract. Users are advised to read the rest of the metadata record carefully for additional details.
Horizontal_Positional_Accuracy:
Horizontal_Positional_Accuracy_Report:
Horizontal accuracy was estimated by using 7 submerged ground control points (GCPs) as check points. During acquisition, both submerged and sub-aerial GCPs were deployed near one another. Sub-aerial GCPs were deployed on vertical stakes to provide sufficient elevation to maintain the GCP above the water surface elevation. Submerged GCPs were deployed nearby on the seafloor in water generally less than 1 meter deep. The sub-aerial GCPs were used in the SfM processing and the submerged GCPs were withheld to serve as check points to evaluate the accuracy of the SfM products. The horizontal RMSE for the SfM derived positions of the submerged GCPs relative to their PPK GPS-measured positions was 0.133 meters. The addition of the estimated horizontal GPS accuracy (0.050 meters) in quadrature results in a total horizontal accuracy estimate of 0.142 meters for the point cloud. It should be noted that this error estimate is for areas near where GCPs were placed and in similar water depths. The effects of refraction at the air-water interface are likely to have caused significant displacement of the apparent position of objects relative to their true position, especially in deep water, or near the edges of the point cloud where the position of objects was likely derived from off-nadir sectors of the raw imagery. Additional sources of error such as poor image-to-image point matching due poor water clarity (such as on the shallow reef flat neat the shoreline), uniform substrate texture (such as mud and sand near the shoreline), or greater water depths resulting in poor surface reconstruction likely caused additional localized errors in some portions of the point cloud which exceed this estimate.
Vertical_Positional_Accuracy:
Vertical_Positional_Accuracy_Report:
Vertical accuracy was estimated by comparing the points in the central portion of the point cloud (between UTM easting 691605 and 691720, and UTM northing 2332805 and 2333245) to individual points in the 2013 USACE NCMP Topobathy Lidar data set. For this area, the vertical accuracy analysis was performed by selecting points from the NCMP lidar point cloud that were within 5 cm of a point in the SfM point cloud. For each SfM point only the nearest point was retained, resulting in a set of 130,444 point pairs. The vertical differences between these point pairs were compared and the vertical residuals were tabulated. The resulting vertical RMSE for these points was found to be 0.241 meters (MAE 0.154 meters), with a mean residual of -0.010 meters. The refraction-corrected point cloud showed a significant improvement over the uncorrected point cloud: the same analysis for the uncorrected point cloud showed an RMSE of 0.426 meters (MAE 0.343 meters), with a mean residual of -0.334 meters. To estimate total accuracy of the point cloud, the estimated vertical accuracy of the NCMP lidar (approximately 0.250 meters, calculated based on depth relative to a WSE of 16.327) was added to the RMSE in quadrature resulting in a total vertical accuracy estimate of 0.347 meters for the point cloud. It should be noted that this error estimate is for the defined central portion of the point cloud only. The effects of refraction at the air-water interface are likely to have caused significant vertical errors of the apparent position of objects relative to their true position, especially in deep water, or near the edges of the point cloud where the position of objects was likely derived from off-nadir sectors of the raw imagery. Additional sources of error such as poor image-to-image point matching due poor water clarity (such as on the shallow reef flat neat the shoreline), uniform substrate texture (such as mud and sand near the shoreline), or greater water depths resulting in poor surface reconstruction likely caused additional localized errors in some portions of the point cloud which exceed this estimate.
Source_Information:
Source_Citation:
Citation_Information:
Originator: Dietrich, J.T.
Publication_Date: 2017
Title:
Bathymetric Structure-from-Motion: extracting shallow stream bathymetry from multi-view stereo photogrammetry
Publication_Information:
Publication_Place: journal article
Publisher: Earth Surface Processes and Landforms
Online_Linkage: https://doi.org/10.1002/esp.4060
Type_of_Source_Media: online
Source_Time_Period_of_Content:
Time_Period_Information:
Single_Date/Time:
Calendar_Date: 2017
Source_Currentness_Reference: publication date
Source_Citation_Abbreviation: Dietrich (2017a)
Source_Contribution:
Journal article describing technique to correct structure from motion data for the effects of refraction in shallow water.
Source_Information:
Source_Citation:
Citation_Information:
Originator: Dietrich, J.T.
Publication_Date: 2017
Title: py_sfm_depth
Publication_Information:
Publication_Place: online software repository
Publisher: GitHub
Online_Linkage: https://github.com/geojames/py_sfm_depth
Type_of_Source_Media: online
Source_Time_Period_of_Content:
Time_Period_Information:
Single_Date/Time:
Calendar_Date: 2017
Source_Currentness_Reference: publication date
Source_Citation_Abbreviation: py_sfm_depth (Dietrich, 2017b)
Source_Contribution:
Online software repository with python script to correct structure from motion point clouds for the effects of refraction in shallow water.
Source_Information:
Source_Citation:
Citation_Information:
Originator:
U.S. Army Corps of Engineers, Joint Airborne Lidar Bathymetry Technical Center of Expertise (JALBTCX)
Publication_Date: 2016
Title: 2013 USACE NCMP Topobathy Lidar: Molokai (HI)
Geospatial_Data_Presentation_Form: lidar point data
Publication_Information:
Publication_Place: online
Publisher:
National Oceanic and Atmospheric Administration (NOAA) Digital Coast Data Access Viewer, NOAA Office for Coastal Management
Online_Linkage: https://coast.noaa.gov/dataviewer
Type_of_Source_Media: online database
Source_Time_Period_of_Content:
Time_Period_Information:
Range_of_Dates/Times:
Beginning_Date: 20131009
Ending_Date: 20131115
Source_Currentness_Reference: ground condition at time data were collected
Source_Citation_Abbreviation: 2013 USACE NCMP Topobathy Lidar
Source_Contribution: Topobathy lidar used for validation of SfM data.
Process_Step:
Process_Description:
Aerial imagery was collected using a Department of Interior-owned 3DR Solo quadcopter fitted with a Ricoh GR II digital camera featuring a global shutter. The UAS was flown on pre-programmed autonomous flight lines which were oriented roughly shore-normal and were spaced to provide approximately 75 percent overlap between images from adjacent lines, at an approximate altitude of 100 meters above ground level (AGL). The camera was triggered at 1 Hz using a built-in intervalometer. Before each flight, the camera’s digital ISO, aperture, and shutter speed were adjusted for ambient light conditions. A total of five flights were conducted for the survey between 16:40 and 17:45 UTC (06:40 and 07:45 HST). Flight F01 was a reconnaissance flight, and no mapping imagery was collected during the flight. Flights F02 and F03 were conducted at an approximate altitude of 100 meters above ground level (AGL), resulting in complete coverage of the mapping area with a nominal ground-sample-distance (GSD) of approximately 2.5 centimeters per pixel. Flights F04 and F05 were conducted using the same flight lines and altitudes of F02 and F03, but the camera was fitted with a circular polarizing filter to reduced reflections and provide improved imaging of the seafloor through the water surface. Only the images collected with the polarizing filter (F04 and F05) were used for the creation of the point cloud presented in this data release.
Process_Date: 20180624
Process_Contact:
Contact_Information:
Contact_Person_Primary:
Contact_Person: Joshua Logan
Contact_Organization:
U.S. Geological Survey, Pacific Coastal and Marine Science Center
Contact_Position: Physical Scientist
Contact_Address:
Address_Type: mailing address
Address: 2885 Mission Street
City: Santa Cruz
State_or_Province: CA
Postal_Code: 95060
Country: US
Contact_Voice_Telephone: 831-460-7519
Contact_Facsimile_Telephone: 831-427-4748
Contact_Electronic_Mail_Address: jlogan@usgs.gov
Process_Step:
Process_Description:
Survey control was established using twenty temporary ground control points (GCPs) distributed throughout the survey area. The GCPs were placed using a combination of kayaking, wading, and snorkeling. The GCPs consisted of: nine submerged targets consisting of small (80 centimeter X 80 centimeter) square tarps with black-and-white cross patterns anchored to the shallow (less than 1.5 meters deep) seafloor using 2 pound fishing weights; nine sub-aerial targets consisting of orange plastic five-gallon bucket lids (32 centimeter diameter) painted with a black “X” pattern and affixed in a horizontal orientation to vertical rebar stakes placed in areas of reef rubble to provide the targets with sufficient elevation to remain above the water surface during the survey; and two sub-aerial ground targets consisting of small (80 centimeter X 80 centimeter) square tarps with black-and-white cross patterns placed in the sand at the shoreline. Two of the submerged targets were disturbed by waves or currents during the survey and were not used for SfM processing. All GCP positions were measured using post-processed kinematic (PPK) GPS, using corrections from a GPS base station on a temporary benchmark (MK02) located approximately 1 kilometer away from the study area. Reference coordinates for MK02 were established using the mean position derived from four static GPS occupations with durations greater than 4 hours submitted to the National Geodetic Survey Online Positioning User Service (NGS OPUS).
Process_Date: 20180624
Process_Contact:
Contact_Information:
Contact_Person_Primary:
Contact_Person: Joshua Logan
Contact_Organization:
U.S. Geological Survey, Pacific Coastal and Marine Science Center
Contact_Address:
Address_Type: mailing and physical
Address: 2885 Mission Street
City: Santa Cruz
State_or_Province: CA
Postal_Code: 95060
Contact_Voice_Telephone: 831-460-7519
Contact_Electronic_Mail_Address: jlogan@usgs.gov
Process_Step:
Process_Description:
To measure approximate water surface elevations during the survey, a pressure sensor was temporarily deployed at a central location within the mapping area approximately 450 meters offshore. Water depths were recorded at 1 Hz and were adjusted to compensate for atmospheric pressure using an atmospheric pressure sensor concurrently deployed nearby. The elevation of the pressure sensor port was measured using the same PPK GPS used for the GCPs. The water surface elevation (WSE) was calculated using the sum of the measured ellipsoidal height of the sensor and the mean water depth measured during the duration of the UAS flights. To correct for potential low-frequency water level fluctuations during the survey (such as those caused by tidal fluctuation, or wind and wave setup), separate WSE were calculated for flights F02 and F03 (unfiltered, “non-polarized” imagery) and for F04 and F05 (imagery collected with a circular polarizing filter). Wave action was minimal during both time periods: depths varied by 0.138 meters with a standard deviation of 0.021 meters, and 0.170 meters with a standard deviation of 0.020 meters during the acquisition of the non-polarized and polarized imagery, respectively. Longer-frequency water level changes were also found to be minimal during the time period. Despite the different time periods, the resulting final mean WSE of the time periods for F02 and F03, and F04 and F05 differed by less than 0.001 meters. The final resulting mean WSE for both time periods was calculated as 16.327 meters above the NAD83 GRS80 ellipsoid.
Process_Date: 20180624
Process_Contact:
Contact_Information:
Contact_Person_Primary:
Contact_Person: Joshua Logan
Contact_Organization:
U.S. Geological Survey, Pacific Coastal and Marine Science Center
Contact_Address:
Address_Type: mailing and physical
Address: 2885 Mission Street
City: Santa Cruz
State_or_Province: CA
Postal_Code: 95060
Contact_Voice_Telephone: 831-460-7519
Contact_Electronic_Mail_Address: jlogan@usgs.gov
Process_Step:
Process_Description:
The image files were renamed using a custom python script. The file names were formed using the following pattern Fx-YYYYMMDDThhmmssZ_Ryz.*, where:
- Fx = Flight number
- YYYYMMDDThhmmssZ = date and time in the ISO 8601 standard, where 'T' separates the date from the time, and 'Z' denotes UTC ('Zulu') time.
- Ry = RA or RB to distinguish camera 'RicohA' from 'RicohB'
- z = original image name assigned by camera during acquisition
- * = file extension (JPG or DNG)
The approximate image acquisition coordinates were added to the image metadata (EXIF) ('geotagged') using the image timestamp and the telemetry logs from the UAS onboard single-frequency 1-Hz autonomous GPS. The geotagging process was done using the GeoSetter software package. To improve timestamp accuracy, the image acquisition times were adjusted to true ('corrected') UTC time by comparing the image timestamps with several images taken of a smartphone app ('Emerald Time') showing accurate time from Network Time Protocol (NTP) servers. For this survey, + 00:00:02 (2 seconds) were added to the image timestamp to synchronize with UTC time. The positions stored in the EXIF are in geographic coordinates referenced to the WGS84(G1150) coordinate reference system (EPSG:7660), with elevation in meters relative to the WGS84 ellipsoid.
Additional information was added to the EXIF using the command-line 'exiftool' software with the following command:
exiftool ^
-P ^
-Copyright="Public Domain. Please credit U.S. Geological Survey." ^
-CopyrightNotice="Public Domain. Please credit U.S. Geological Survey." ^
-ImageDescription="Low-altitude aerial image of the shallow coral reef off Waiakane, Molokai, HI, USA, from USGS Unmanned Aircraft System (UAS) survey 2018-617-FA." ^
-Caption-Abstract="Coral reef off Waiakane, Molokai, HI, USA, from USGS survey 2018-617-FA." ^
-Caption="Aerial image of the shallow coral reef off Waiakane, Molokai, HI, USA, from USGS Unmanned Aircraft System (UAS) survey 2018-617-FA." ^
-sep ", " ^
-keywords="coral reef, Molokai, Maui County, Hawaii, Waiakane, 2018-617-FA, Unmanned Aircraft System, UAS, drone, aerial imagery, U.S. Geological Survey, USGS, Pacific Coastal and Marine Science Center" ^
-comment="Low-altitude aerial image from USGS Unmanned Aircraft System (UAS) survey 2018-617-FA." ^
-Credit="U.S. Geological Survey" ^
-Contact="pcmsc_data@usgs.gov" ^
-Artist="U.S. Geological Survey, Pacific Coastal and Marine Science Center"
Process_Date: 2018
Process_Contact:
Contact_Information:
Contact_Person_Primary:
Contact_Person: Joshua Logan
Contact_Organization:
U.S. Geological Survey, Pacific Coastal and Marine Science Center
Contact_Address:
Address_Type: mailing and physical
Address: 2885 Mission Street
City: Santa Cruz
State_or_Province: CA
Postal_Code: 95060
Contact_Voice_Telephone: 831-460-7519
Contact_Electronic_Mail_Address: jlogan@usgs.gov
Process_Step:
Process_Description:
Structure-from-motion (SfM) processing techniques were used to create the point clouds in the Agisoft Photoscan/Metashape software package using the following workflow with the JPG images from F04 and F05 (images collected with a polarizing filter):
1. Preliminary image alignment and sparse point cloud error reduction was performed using shoreline imagery to develop an a priori camera lens model. The lens model was then fixed for the subsequent SfM processing steps.
2. Additional image alignment for all the images was performed with the following parameters - Accuracy: 'high'; Pair selection: 'reference', 'generic'; Key point limit: 0 (unlimited); Tie point limit: 0 (unlimited).
3. Sparse point cloud error reduction was performed using an iterative gradual selection and camera optimization process in which all sparse points exceeding a Reconstruction Uncertainty of 10 were removed from the sparse point cloud. Additional sparse points obviously above or below the true surface were manually deleted after the last error reduction iteration, and a final camera optimization was performed.
4. Ground control points (GCPs) were manually marked for all GCPs. All submerged GCPs were disabled in subsequent processing steps to serve as validation check points.
5. A final camera optimization was performed, and a dense point cloud was created using the 'high' accuracy setting, with 'aggressive' depth filtering.
6. Some manual editing was performed to delete obvious high and low noise from the point cloud. Classification was run on the point cloud to identify 'low noise' and 'ground' points.
7. The estimate camera positions were exported for use in further processing.
8. The point cloud was exported to an LAZ file for further processing.
Process_Date: 2018
Process_Contact:
Contact_Information:
Contact_Person_Primary:
Contact_Person: Joshua Logan
Contact_Organization:
U.S. Geological Survey, Pacific Coastal and Marine Science Center
Contact_Position: Physical Scientist
Contact_Address:
Address_Type: mailing address
Address: 2885 Mission Street
City: Santa Cruz
State_or_Province: CA
Postal_Code: 95060
Country: US
Contact_Voice_Telephone: 831-460-7519
Contact_Facsimile_Telephone: 831-427-4748
Contact_Electronic_Mail_Address: jlogan@usgs.gov
Process_Step:
Process_Description:
Post-processing of the point cloud was performed to reduce the effect of refraction at the air-water interface using the multi-view refraction correction python script (py_sfm_depth.py) described in Dietrich (2017a). The script was used as part of the following workflow:
1. The point cloud was thinned to 5 cm point spacing using the LAStools 'lasthin' utility using the 'lowest' operator, keeping only points that were classified as 'ground'.
2. The thinned point cloud was exported to a csv text file using the LAStools 'las2txt' utility.
3. The water surface elevation of 16.327 meters relative to the GRS80 ellipsoid, was added as a field in the point cloud text file.
4. Multi-view refraction correction was performed on the point cloud text file using the 'py_sfm_depth' script (Dietrich, 2017b), with the estimated camera positions from the SfM processing steps, above.
5. The resulting refraction-corrected point cloud was converted to LAZ format using the LAStools 'txt2las' utility.
Process_Date: 2018
Process_Contact:
Contact_Information:
Contact_Person_Primary:
Contact_Person: Joshua Logan
Contact_Organization:
U.S. Geological Survey, Pacific Coastal and Marine Science Center
Contact_Position: Physical Scientist
Contact_Address:
Address_Type: mailing address
Address: 2885 Mission Street
City: Santa Cruz
State_or_Province: CA
Postal_Code: 95060
Country: US
Contact_Voice_Telephone: 831-460-7519
Contact_Facsimile_Telephone: 831-427-4748
Contact_Electronic_Mail_Address: jlogan@usgs.gov