Identification_Information: Citation: Citation_Information: Originator: Andrew C. Ritchie Originator: Gerald A. Hatcher Originator: Jonathan A. Warrick Publication_Date: 20230221 Title: Unprocessed aerial imagery from 5 February 2016 coastal survey of Central California. Geospatial_Data_Presentation_Form: raster image format Series_Information: Series_Name: data service Issue_Identification: DOI:10.5066/P9M3NYWI Publication_Information: Publication_Place: Pacific Coastal and Marine Science Center, Santa Cruz, California Publisher: U.S. Geological Survey Online_Linkage: https://doi.org/10.5066/P9M3NYWI Larger_Work_Citation: Citation_Information: Originator: Andrew C. Ritchie Originator: Peter J. Triezenberg Originator: Jonathan A. Warrick Originator: Gerald A. Hatcher Originator: Daniel D. Buscombe Publication_Date: 20230221 Title: RSCC Simple Data Distribution Service Series_Information: Series_Name: data service Issue_Identification: DOI:10.5066/P9M3NYWI Publication_Information: Publication_Place: Santa Cruz, California Publisher: U.S. Geological Survey - Pacific Coastal and Marine Science Center Online_Linkage: https://doi.org/10.5066/P9M3NYWI Description: Abstract: This is a set of 3494 oblique aerial photogrammetric images and their derivatives, collected from San Francisco to Monterey with a fixed-lens digital camera from a crewed light aircraft, for processing using structure-from-motion photogrammetry and machine learning to study coastal geomorphic processes at high temporal and spatial resolution. JPG files in each folder follow the following naming convention: {CAM###}_{YYYYMMDDHHMMSS_ss}.jpg, where {CAM###} is the last 3 digits of the camera serial number, preceded by the letters "cam", and where {YYYYMMDDHHMMSS_ss} is the image acquisition time in {YearMonthDayHourMinuteSecond_hundredths} expressed in 24-hour time, as recorded by the camera's internal clock and written to the SubSecondDateTime field in the image EXIF data (for example CAM001_202009182311_50 would be the timestamp for an image with a SubSecondDateTime EXIF time/date stamp of September 18th, 2020 at 11:11.50 pm. Purpose: Recording ground condition at a high temporal and spatial resolution, and after high-magnitude disturbance events, for processing using structure-from-motion photogrammetry and machine learning to study coastal geomorphic processes at high temporal and spatial resolution and to improve our understanding of earth surface processes (natural hazards) affecting coastal resources. Supplemental_Information: Additional information about the field activities from which these data were derived is available online at: https://cmgds.marine.usgs.gov/fan_info.php?fan=2016-658-FA Any use of trade, product, or firm names is for descriptive purposes only and does not imply endorsement by the U.S. Government. Time_Period_of_Content: Time_Period_Information: Range_of_Dates/Times: Beginning_Date: 20160205 Beginning_Time: 134256 Ending_Date: 20160205 Ending_Time: 150232 Currentness_Reference: ground condition Status: Progress: Complete Maintenance_and_Update_Frequency: None planned Spatial_Domain: Bounding_Coordinates: West_Bounding_Coordinate: -122.537073 East_Bounding_Coordinate: -121.790951 North_Bounding_Coordinate: 37.782446 South_Bounding_Coordinate: 36.606183 Keywords: Theme: Theme_Keyword_Thesaurus: USGS Metadata Identifier Theme_Keyword: USGS:596c36c3-df26-4296-8a2b-08e899619543 Theme: Theme_Keyword_Thesaurus: ISO 19115 Topic Category Theme_Keyword: geoscientificInformation Theme_Keyword: imageryBaseMapsEarthCover Theme_Keyword: environment Theme: Theme_Keyword_Thesaurus: Data Categories for Marine Planning Theme_Keyword: Distributions Theme_Keyword: Physical Habitats and Geomorphology Theme_Keyword: habitat Theme_Keyword: infrastructure Theme_Keyword: structures Theme: Theme_Keyword_Thesaurus: USGS Thesaurus Theme_Keyword: image analysis Theme_Keyword: remote sensing Theme_Keyword: aerial photography Theme_Keyword: image collections Theme_Keyword: visible light imaging Theme_Keyword: datasets Theme_Keyword: geospatial datasets Theme_Keyword: earth sciences Theme_Keyword: geography Theme_Keyword: geology Theme_Keyword: ecology Theme_Keyword: coastal processes Theme_Keyword: geologic processes Theme_Keyword: slope processes Theme_Keyword: coastal ecosystems Theme: Theme_Keyword_Thesaurus: Marine Realms Information Bank (MRIB) keywords Theme_Keyword: aerial and satellite photography Theme_Keyword: geography Theme_Keyword: geology Theme_Keyword: ecology Theme_Keyword: coastal processes Theme_Keyword: agents of coastal change Theme_Keyword: anthropogenic agents of coastal change Theme_Keyword: coastal development Theme_Keyword: coastal erosion Theme_Keyword: coastal landslides Theme: Theme_Keyword_Thesaurus: None Theme_Keyword: U.S. Geological Survey Theme_Keyword: USGS Theme_Keyword: Coastal and Marine Hazards and Resources Program Theme_Keyword: CMHRP Theme_Keyword: Pacific Coastal and Marine Science Center Theme_Keyword: PCMSC Place: Place_Keyword_Thesaurus: None Place_Keyword: United States Place_Keyword: United States and Territories Access_Constraints: None Use_Constraints: USGS-authored or produced data and information are in the public domain from the U.S. Government and are freely redistributable with proper metadata and source attribution. Please recognize and acknowledge the U.S. Geological Survey as the originator(s) of the dataset and in products derived from these data. Point_of_Contact: Contact_Information: Contact_Organization_Primary: Contact_Organization: U.S. Geological Survey, Pacific Coastal and Marine Science Center Contact_Person: PCMSC Science Data Coordinator Contact_Address: Address_Type: mailing and physical Address: 2885 Mission Street City: Santa Cruz State_or_Province: CA Postal_Code: 95060 Contact_Voice_Telephone: 831-427-4747 Contact_Electronic_Mail_Address: pcmsc_data@usgs.gov Native_Data_Set_Environment: Images were collected with a fixed-lens digital camera in raw camera raw format. Hardware and software specifications for capture and conversion are detailed in camera EXIF data. Cross_Reference: Citation_Information: Originator: Jin-Si R. Over Originator: Andrew C. Ritchie Originator: Christine J. Kranenburg Originator: Jenna A. Brown Originator: Daniel D. Buscombe Originator: Tom Noble Originator: Christopher R. Sherwood Originator: Jonathan A. Warrick Originator: Phillipe A. Wernette Publication_Date: 2021 Title: Processing coastal imagery with Agisoft Metashape Professional Edition, version 1.6-Structure from motion workflow documentation Online_Linkage: https://doi.org/10.3133/ofr20211039 Cross_Reference: Citation_Information: Originator: Jonathan A. Warrick Originator: Andrew C. Ritchie Originator: Gabrielle Adelman Originator: Kenneth Adelman Originator: Patrick W. Limber Publication_Date: 20170101 Title: New Techniques to Measure Cliff Change from Historical Oblique Aerial Photographs and Structure-from-Motion Photogrammetry Online_Linkage: https://doi.org/10.2112/JCOASTRES-D-16-00095.1 Data_Quality_Information: Attribute_Accuracy: Attribute_Accuracy_Report: Camera EXIF position data are generally accurate to within a few hundred meters, and time data are accurate to within a few minutes. Camera clock was UTC through 7 March 2018, and switched to PST starting 29 March 2018 (to simplify processing across UTC date changes). Logical_Consistency_Report: RGB values are 8-bit, generally not saturated or underexposed. In a few cases of high or low light conditions, some imagery may be under- or over-exposed. Completeness_Report: Data are considered complete for the information presented, as described in the abstract. Users are advised to read the rest of the metadata record carefully for additional details, and to examine EXIF data for individual flights to determine camera settings such as exposure mode and shutter speed. Positional_Accuracy: Horizontal_Positional_Accuracy: Horizontal_Positional_Accuracy_Report: A formal accuracy assessment of the horizontal positional information in the image data set has not been conducted. Most images have EXIF stamps from a consumer-grade GPS, updated every few seconds. Position accuracy for these images is generally within about 200m. Some images may lack GPS position in EXIF data, but in most cases, we apply interpolated positions or positions derived through onboard survey-grade GNSS or 4D structure-from-motion. High-precision positions, when available, are published as a flight derivative product with separate metadata describing their derivation and accuracy. Lineage: Process_Step: Process_Description: Acquisition -- Aerial imagery was collected using a DOI-contracted aircraft operated by EcoScan Resource Data LLC and piloted by Bob Van Wagenen. Integrated GNSS and Camera hardware designed and built by the U.S. Geological Survey, Pacific Coastal and Marine Science Center and mounted inside the aircraft was oriented to capture [orientation] imagery through a port in a cargo door. Images were acquired in camera raw format. The camera is triggered by an intervalometer integrated with a survey-grade GNSS and triggered using a PPS signal from the GNSS, routed through a microcontroller to the camera remote shutter, and recording an event mark to the GNSS when the shutter is actuated, through the flash-sync port on the camera. A consumer-grade GPS attached to the camera keeps camera time synced with UTC time and provides approximate coordinates for EXIF data. Process_Date: 20160205 Source_Produced_Citation_Abbreviation: raw imagery Source_Produced_Citation_Abbreviation: raw GNSS data Process_Step: Process_Description: Image renaming -- Raw Images are renamed using Phil Harvey's EXIFTOOL with the following command: exiftool -r -d %Y%m%d%H%M%S "-testname" *. -define tiff:bits-per-sample=8 _thumbnail_contact_sheet.tif where is the path to the directory of images, is the image extension, and is the unique name of the survey folder. The GraphicsMagick version is recorded to the multipage contact sheet in the tiff metadata under the TIFFTAG_SOFTWARE tag. A csv file of a subset of image EXIF tags is then generated with the following exiftool command: exiftool -Model -LensID -ExposureProgram -FocalLength -ExposureTime -FNumber -ISO -SubSecDateTimeOriginal -DateTimeOriginal -GPSDateTime -GPSLatitude# -GPSLongitude# -GPSAltitude# -GPSPosition# -GPSAltitudeRef -GPSSatellites -CreatorTool -CameraProfile -SerialNumber -ImageNumber -f -csv -ext _EXIF.csv where is the file extension of the converted images used for photogrammetry and is the name of the folder for a specific survey. The csv file is processed with a custom python script to add camera positions from GNSS- or SfM-derived position files, or to interpolate or extrapolate positions, depending on available data. Process_Date: 2016 Process_Step: Process_Description: GNSS data processing -- when collected, GNSS data are post-processed to derive the precise position of ground control points, check points, and/or the GNSS antenna at the time of image acquisition. If necessary for rapid processing, approximate (provisional) positions are produced from rapid ephemeris data. After precise ephemerides are available, GNSS data are post-processed to calculate GNSS trajectory, and precise positions are derived from station occupations or event marks recorded with precision timing, placed along the GNSS trajectory. Processing workflows, accuracy estimates, software and version are detailed in GNSS metadata. Camera and ground control positions are post-processed together with images, camera lever arm data and photogrammetric software to derive accurate camera position and pose. Process_Date: 2016 Process_Step: Process_Description: Photogrammetric Processing -- 3D or 4D structure-from-motion (SfM) processing, as described in Over and others (2021) and Warrick and others (2017), is used to derive camera positions for surveys missing position data if necessary. This processing is done with reduced accuracy to provide approximate location only. Process_Date: 2016 Process_Step: Process_Description: Imagery EXIF coordinates reconciliation -- EXIF camera positions are not intended to be suitable accuracy for precise photogrammetric surveys but are used to populate the EXIF metadata field and locate the image in space relative to other images for reference purposes. GNSS/SfM position data published separately from images should be used for SfM reconstruction if available. Camera positions are not always recorded for individual images due to GNSS collection conditions, malfunctioning equipment, or other reasons. Depending on availability of position data, coordinates for image EXIF position data are recorded to imagery with one of the following methods, with the appropriate indicator written to the EXIF:GPSAreaInformation tag: 1) Image positions recorded to the EXIF field with the attached consumer-grade GPS device are labeled with the EXIF tag EXIF:GPSAreaInformation="camera-integrated GPS". 2) Image positions recorded to the EXIF field from timing-based GNSS event marks are labeled with the EXIF tag EXIF:GPSAreaInformation="GNSS event mark". 3) Image positions derived from 3D or 4D SfM processing with or without ground control points are labeled with the EXIF tag EXIF:GPSAreaInformation="structure-from-motion". 4) Image positions interpolated or extrapolated from between GPS, GNSS, or SfM-derived positions using adjacent image positions and a time-averaged velocity and direction algorithm are labeled with the EXIF tag EXIF:GPSAreaInformation="interpolated" or (EXIF:GPSAreaInformation="extrapolated". 5) If imagery needs to be published without more precise positioning to support emergency response or timely best science, or if no other way exists to locate images more accurately, then an approximate location is assigned to some or all images based on best estimate of location. This may include assigning a single location to all images to approximately locate them based on the geographic area of a survey. Any images located with this method are labeled with the EXIF tag EXIF:GPSAreaInformation="estimated approximate location" Process_Date: 2016 Process_Step: Process_Description: Image EXIF annotation -- Additional information was added to individual image EXIF tags using the command-line 'exiftool' software with the following command, as appropriate: #tags for provisional data exiftool ^ -P ^ -IPTC:Credit="U.S. Geological Survey" ^ -IPTC:Contact="pcmsc_data@usgs.gov" ^ -EXIF:Copyright="Public Domain" ^ -XMP:UsageTerms="These data are preliminary or provisional and are subject to revision. They are being provided to meet the need for timely best science. The data have not received final approval by the U.S. Geological Survey (USGS) and are provided on the condition that neither the USGS nor the U.S. Government shall be held liable for any damages resulting from the authorized or unauthorized use of the data." ^ -overwrite_original *.JPG #tags for approved data exiftool ^ -P ^ -IPTC:Credit="U.S. Geological Survey" ^ -IPTC:Contact="pcmsc_data@usgs.gov" ^ -EXIF:Copyright="Public Domain" ^ -XMP:UsageTerms="Unless otherwise stated, all data, metadata and related materials are considered to satisfy the quality standards relative to the purpose for which the data were collected. Although these data and associated metadata have been reviewed for accuracy and completeness and approved for release by the U.S. Geological Survey (USGS), no warranty expressed or implied is made regarding the display or utility of the data for other purposes, nor on all computer systems, nor shall the act of distribution constitute any such warranty." ^ -EXIF:ImageDescription="[single_image_EXIF_desc]" ^ -XMP:AttributionURL="https://doi.org/10.5066/P9M3NYWI ^ -EXIF:GPSAreaInformation="[position_method]" ^ -EXIF:GPSMapDatum="EPSG:4326 (WGS 84)" ^ -overwrite_original *.JPG tags were then duplicated to XMP headers to increase tag compatibility for image viewing software with the following exiftool command #tag duplication per phil harvey exiftool ^ -P ^ "-XMP-photoshop:Credit