Metadata: Identification_Information: Citation: Citation_Information: Originator: Nadine E. Golden Originator: Seth D. Ackerman Originator: Evan T. Dailey Publication_Date: 2015 Title: Coastal Marine Geology Program Video and Photograph Portal Geospatial_Data_Presentation_Form: Web page Publication_Information: Publication_Place: Santa Cruz, CA Publisher: U.S. Geological Survey Online_Linkage: https://doi.org/10.5066/F7JH3J7N Description: Abstract: Access to the U.S. Geological Survey (USGS) Coastal and Marine Geology Program’s (CMGP) vast collection of unique and valuable seafloor and coastal imagery is made available in the CMGP Video and Photograph Portal. The portal provides a single location for data discovery and viewing. The CMGP and our research partners invest immense resources collecting, processing, and archiving seafloor and oblique coastal video and photographs. Until the publication of the CMGP Video and Photograph Portal in 2015, only a small number of these data sets were available to the public through static web interfaces. Prior to development of the data portal, retrieving this imagery most often required internal USGS access with specific hardware and software. Furthermore, it was difficult to manage and challenging to share such a large amount of information. The Coastal and Marine Geology Program (CMGP) Video and Photograph Portal contains imagery spanning from 2003 to the present. Video and photographs originally collected on analog film media have been digitized and processed along with more recently collected digital video and photographs to meet a common standard for all CMGP video/photo imagery. The Portal is based on an interactive map allowing users to zoom into an area of interest and find available USGS imagery. The co-located video and still photographs are displayed simultaneously, just as they were acquired in the field. In the portal, videos are ultimately stored and streamed as embedded YouTube videos, and photographs are stored in Picasa. Presenting the imagery in this way requires multiple processing steps and tools, including video and photo editing, database management, and computer scripting to automate processing, formatting and quality assurance tasks. A robust set of processing tools have been developed to streamline and automate portions of the workflow based on the wide range of data types processed so far. However, sometimes the data received are uniquely organized and formatted, requiring individualized processing. In that case processing tools are updated to accept a wider range of data formats and organizational structures. Purpose: The Coastal and Marine Geology Program Video and Photograph Portal hosts imagery from many of the regions where CMGP scientists work, including California, Oregon, Puget Sound, Hawaii, Alaska, Massachusetts, Florida, the Gulf of Mexico and Atlantic Coasts, and American Samoa, as well as numerous other projects. The USGS Coastal and Marine Geology Program collects imagery during field surveys for a variety of purposes, including ground-truth verification of remotely sensed geophysical data, documenting change to coastal features, and understanding sediment transport processes. Seafloor video and still images are collected using underwater sampling devices and other techniques. Oblique aerial imagery is collected from both fixed-wing aircraft, helicopters, and unmanned drones flown over coastal areas before and after storms or other events to document changes to sensitive coastal formations and structures. Time_Period_of_Content: Time_Period_Information: Range_of_Dates/Times: Beginning_Date: 2003 Ending_Date: present Currentness_Reference: ground conditions at the time the imagery were acquired Status: Progress: In work Maintenance_and_Update_Frequency: As needed Spatial_Domain: Bounding_Coordinates: West_Bounding_Coordinate: -179.82421874282 East_Bounding_Coordinate: -56.777343747733 North_Bounding_Coordinate: 72.127936279759 South_Bounding_Coordinate: 23.402764904526 Keywords: Theme: Theme_Keyword_Thesaurus: USGS Metadata Identifier Theme_Keyword: USGS:fa1a6827-fbde-442a-80f6-b607892854a5 Theme: Theme_Keyword_Thesaurus: ISO 19115 Topic Category Theme_Keyword: geoscientificInformation Theme_Keyword: oceans Theme_Keyword: biota Theme: Theme_Keyword_Thesaurus: Data Categories for Marine Planning Theme_Keyword: Physical Habitats and Geomorphology Theme_Keyword: Biodiversity Theme_Keyword: Water Column Features Theme_Keyword: Substrate Theme: Theme_Keyword_Thesaurus: Global Change Master Directory (GCMD) Theme_Keyword: Continental Margins Theme: Theme_Keyword_Thesaurus: USGS Thesaurus Theme_Keyword: aerial photography Theme_Keyword: image collections Theme_Keyword: photographs Theme_Keyword: coastal ecosystems Theme_Keyword: marine ecosystems Theme_Keyword: geology Theme_Keyword: videography Theme_Keyword: videos Theme: Theme_Keyword_Thesaurus: None Theme_Keyword: U.S. Geological Survey Theme_Keyword: USGS Theme_Keyword: Pacific Coastal and Marine Science Center Theme_Keyword: PCMSC Theme_Keyword: Coastal and Marine Geology Theme_Keyword: imagery Theme_Keyword: still imagery Place: Place_Keyword_Thesaurus: Geographic Names Information System (GNIS) Place_Keyword: United States of America Place_Keyword: State of California Place_Keyword: Pacific Ocean Place_Keyword: Atlantic Ocean Place_Keyword: State of Hawaii Place_Keyword: America Samoa Place_Keyword: State of Oregon Place_Keyword: Puget Sound Place_Keyword: Commonwealth of Massachussets Place_Keyword: Rhode Island Place_Keyword: State of Louisiana Place_Keyword: State of Mississippi Place_Keyword: State of Alabama Place_Keyword: State of Florida Place: Place_Keyword_Thesaurus: None Place_Keyword: Gulf Coast Access_Constraints: None Use_Constraints: USGS-authored or produced data and information are in the public domain from the U.S. Government and are freely redistributable with proper metadata and source attribution. Please recognize and acknowledge the U.S. Geological Survey as the originator(s) of the dataset and in products derived from these data Point_of_Contact: Contact_Information: Contact_Organization_Primary: Contact_Organization: U.S. Geological Survey, Pacific Coastal and Marine Science Center Contact_Person: PCMSC Science Data Coordinator Contact_Address: Address_Type: mailing and physical Address: 2885 Mission Street City: Santa Cruz State_or_Province: CA Postal_Code: 95060 Country: United States Contact_Voice_Telephone: 831-427-4747 Contact_Electronic_Mail_Address: pcmsc_data@usgs.gov Native_Data_Set_Environment: ExifTool [Computer software], 2015. accessed on July 27, 2015, at http://owl.phy.queensu.ca/~phil/exiftool/ FFmpeg [Computer software], 2016. accessed on August 1, 2016, at https://www.ffmpeg.org ImageMagick Studio LLC [Computer software], 2015. accessed on March 28, 2016, at http://www.imagemagick.org Picasa [website]. 2016. accessed on August 1, 2016, at https://support.google.com/picasa Python Software Foundation [Computer software]. 2015. accessed on July 27, 2015 at https://www.python.org R Core Team. 2014. R Foundation for Statistical Computing, Vienna, Austria. YouTube [website]. 2016. accessed on August 1, 2016, at https://support.google.com/youtube Data_Quality_Information: Attribute_Accuracy: Attribute_Accuracy_Report: No formal attribute accuracy tests were conducted Logical_Consistency_Report: No formal logical accuracy tests were conducted Completeness_Report: Data set is considered complete for the information presented, as described in the abstract. Additional imagery will be added as datasets become available. Users are advised to read the rest of the metadata record carefully for additional details. Positional_Accuracy: Horizontal_Positional_Accuracy: Horizontal_Positional_Accuracy_Report: A formal accuracy assessment of the horizontal positional information in the data set has either not been conducted, or is not applicable. Vertical_Positional_Accuracy: Vertical_Positional_Accuracy_Report: NA formal accuracy assessment of the horizontal positional information in the data set has either not been conducted, or is not applicable. Lineage: Process_Step: Process_Description: Formatting: After video and/or photographic imagery is acquired from its source (the principal investigator of a survey, survey technicians, archives or other USGS databases), the imagery is manipulated and reviewed to ensure it is “portal-ready.” Videos and photos containing extraneous frames, such as boat deck shots, extensive water column sequences, blank or distorted imagery from equipment malfunction, and other content not directly relevant to seafloor and coastal understanding is removed. The imagery must also be edited to meet proper file formatting and resolution for its publication in the portal. Raw video files recorded during surveys may be too large and/or an unsuitable format for web-streaming. Video are compressed to a standard codec (such as MPEG-4) and uploaded in a suitable container (such as MP4) so that the videos meet the necessary YouTube specifications. Compressing the video reduces the file size, thus making web-streaming feasible, while only slightly reducing video quality of the original recording. Other video processing steps may include stripping audio tracks and creating video text overlays displaying survey information such as survey ID, date, and station. Older video collected on film is converted to digital format to enable it to be uploaded to the portal. Video stored in DVD format, which contains multiple different files (such as VOB files) for a single video, is reformatted to a single video file with the standard codec and container. File type reformatting is generally not required for photographs, as Picasa, the web-hosting platform for photographs in the portal, accepts a wide range of standard image file types. Photographs published in the portal contain exchangeable image file format (Exif) metadata tags. These tags are either created during collection by the recording equipment or are added during processing stages. During processing, photographs are checked for Exif information including: credit for creation, contact information, geographic coordinates, and tags may also contain summary information about the survey. This metadata can be used to identify, locate, and provide contact information for a given image. Photographs that do not already contain the proper Exif metadata for the portal are updated using a set of processing tools described below. Process_Date: 20150101 Process_Step: Process_Description: Imagery formatting tools: Multiple tools are used to edit, format, review, and upload imagery to the portal. These include video and photograph editing software, command-line tools, and computer scripts. Editing, formatting and compressing videos is accomplished using command-line functionality from the free software project FFmpeg. The software meets most processing requirements for the videos, and can trim extraneous video frames, remove or edit audio tracks, create text overlays, cut a single video into multiple videos, concatenate videos, as well as convert codecs, containers, filters and compress videos as required by the data. ExifTool, another free software project, provides command-line functionality to edit a photo’s Exif metadata tags. For this purpose, the ExifTool has been incorporated into Python scripts, allowing large numbers of photos to be edited with data from spreadsheets containing geographic coordinates, citations and summary text. Other Python computer scripts have been written that also utilize ExifTool, FFmpeg, as well as standard operating system tools, to edit, name, catalog and organize video files. Process_Date: 20150101 Process_Step: Process_Description: Uploading: After navigation records are compiled and completed for all imagery, the photographs and videos are uploaded using scripts written and provided by the portal’s web developing contractors. Additional structured query language (SQL) scripts then create a final spreadsheet record containing internet links to imagery (such as YouTube IDs and Picasa Album and image IDs), latitude, longitude, and the number of seconds into a video for every row in the record. This final record with imagery and location is shared with the contractors, and the data is added to the interactive portal. Additionally, metadata and a summary of the survey with links to publications and funding programs is uploaded for each YouTube video, and a summary of the data with links is added to the portal’s data catalog web pages. Surveys in the portal’s data catalog are organized and grouped according to geographic regions and survey themes. Process_Date: 20150101 Process_Step: Process_Description: Keywords section of metadata edited for consistency across the USGS Pacific Coastal and Marine Science Center and to further optimize discovery in search engines and data catalogs. Metadata was modified to bring up to current USGS PCMSC standards. Minor typos were corrected. No data information was changed. Process_Date: 20180907 Process_Contact: Contact_Information: Contact_Person_Primary: Contact_Person: Susan A Cochran Contact_Organization: U.S. Geological Survey, Pacific Coastal and Marine Science Center Contact_Position: Geologist Contact_Address: Address_Type: mailing and physical address Address: 2885 Mission Street City: Santa Cruz State_or_Province: CA Postal_Code: 95060-5792 Country: USA Contact_Voice_Telephone: (831) 460-7545 Contact_Electronic_Mail_Address: scochran@usgs.gov Process_Step: Process_Description: Edited metadata to add keywords section with USGS persistent identifier as theme keyword. No data were changed. Process_Date: 20201019 Process_Contact: Contact_Information: Contact_Organization_Primary: Contact_Organization: U.S. Geological Survey Contact_Person: VeeAnn A. Cross Contact_Position: Marine Geologist Contact_Address: Address_Type: Mailing and Physical Address: 384 Woods Hole Road City: Woods Hole State_or_Province: MA Postal_Code: 02543-1598 Contact_Voice_Telephone: 508-548-8700 x2251 Contact_Facsimile_Telephone: 508-457-2310 Contact_Electronic_Mail_Address: vatnipp@usgs.gov Spatial_Data_Organization_Information: Indirect_Spatial_Reference: Navigation data provides the basis for visualizing the CMGP video and photograph imagery in the portal. Accurate geographic coordinates combined with date and time information are required to display data on the portal’s interactive map. These coordinates are generally acquired from a survey’s GPS navigation records. Every data point on the map represents a time value along a survey trackline which also has an associated date, latitude, longitude, video (if applicable) and photo (if applicable). Each data point can be associated with a video and photo, or just one of the imagery types if the other does not exist (but at least one is required). The imagery is tied to the navigation records using time as a common field. The portal uses this record to display, for each coordinate containing imagery, the corresponding video and/or photo, as linked by their YouTube file ID and/or Picasa and Picasa album ID. This master navigation file is created for each survey containing imagery uploaded to the portal. Multiple Python scripts are used to reformat GPS navigation records depending on their source and original format. USGS online databases contain navigation records for some surveys, while other navigation data are provided by science projects in various formats. A Python script reformats these records into the standard format used by the portal, containing date, time, latitude and longitude fields, as well as survey identification fields (#Appendix: Scripts). This process requires parsing date-time values and reformatting date and time to separate values, converting coordinates to decimal degree format, as well as organizing the other values into spreadsheet format. One common format for navigation records is the National Marine Electronics Association (NMEA) GPS strings, as collected using HYPACK navigation hardware, for example. A Python script parses and reformats the complex NMEA strings into a standard format with date, time, latitude and longitude formats. Optionally, the script can be run to group or batch reformat numerous files collected over multiple survey dates, thus expediting processing times. Distribution_Information: Distributor: Contact_Information: Contact_Organization_Primary: Contact_Organization: U.S. Geological Survey, Pacific Coastal and Marine Science Center Contact_Person: Nadine E. Golden Contact_Address: Address_Type: mailing and physical Address: 2885 Mission Street City: Santa Cruz State_or_Province: CA Postal_Code: 95060 Country: USA Contact_Voice_Telephone: 831-460-7530 Contact_Electronic_Mail_Address: ngolden@usgs.gov Distribution_Liability: These data, identified as video and photograph data, have been approved for release and publication by the U.S. Geological Survey (USGS). Although these data have been subjected to rigorous review and are substantially complete, the USGS reserves the right to revise the data pursuant to further analysis and review. Furthermore, they are released on condition that neither the USGS nor the United States Government may be held liable for any damages resulting from its authorized or unauthorized use. Metadata_Reference_Information: Metadata_Date: 20201019 Metadata_Contact: Contact_Information: Contact_Organization_Primary: Contact_Organization: U.S. Geological Survey, Pacific Coastal and Marine Science Center Contact_Person: PCMSC Science Data Coordinator Contact_Address: Address_Type: mailing and physical Address: 2885 Mission Street City: Santa Cruz State_or_Province: CA Postal_Code: 95060 Country: United States Contact_Voice_Telephone: 831-427-4747 Contact_Electronic_Mail_Address: pcmsc_data@usgs.gov Metadata_Standard_Name: Content Standard for Digital Geospatial Metadata Metadata_Standard_Version: FGDC-STD-001-1998