- Date: 2006 (process 1 of 17)
-
The data files were transferred from the acquisition computer via a USB thumb drive. The first step is to check the navigation recorded in the *.gps file for each line of acquisition. Although the navigation fixes themselves appear to be okay, the fathometer data is not. To verify this, I extracted the $GPRMC line from the CRP GPS files using an AWK script. (* refers to the line name, which for this day are l1f1, l2f1, l3f1, l4f1, l5f1 and l6f1)
awkpullgprmc:
BEGIN {
FS = ","
}
{
FS = ","
if ($1=="$GPRMC")
{
print $0
}
endif
}
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 2 of 17)
-
Used an AWK script to reformat the GPRMC navigation to a comma-delimited ANSI text navigation file suitable for loading in the GIS. (* refers to the line name, which for this day are l1f1, l2f1, l3f1, l4f1, l5f1 and l6f1). The text editor VI was used to add the necessary header line to each file.
awk_justgprmc:
BEGIN {
FS=","
}
{
FS= ","
ARGC = 2
if ($1=="$GPRMC") {
gpstime = $2
hr = substr($2,1,2)
min = substr($2,3,2)
sec = substr($2,5,2)
latdeg = substr($4,1,2)
latmin = substr($4,3,6)
londeg = substr($6,2,2)
lonmin = substr($6,4,6)
declat = latdeg + (latmin/60)
declon = (londeg + (lonmin/60)) * -1
date = $10
day = substr($10,1,2)
month = substr($10,3,2)
year = substr($10,5,2)
printf("%8.6f, %8.6f, %s:%s:%s, %s\n",declon, declat, hr, min, sec, date)
}
}
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 3 of 17)
-
Using ArcView 3.3 this comma-delimited ANSI text file was loaded as an event theme. This event theme was then saved as a shapefile using Theme - Convert to shapefile. (* refers to the line name, which for this day are l1f1, l2f1, l3f1, l4f1, l5f1 and l6f1)
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 4 of 17)
-
An ANSI text file containing the ship's navigation and fathometer information was transferred from the ship's system using a thumb drive.
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources produced in this process:
- Date: 2006 (process 5 of 17)
-
This text file was reformatted using an AWK script into a comma-delimited ANSI text file suitable for loading in the GIS.
awknav:
{
shipdate = $1
gpstime = $2
latdeg = substr($5,1,2)
latdecmin = $6
declat = latdeg + (latdecmin/60)
londeg = substr($7,1,3)
londecmin = $8
declon = -1 * (londeg + (londecmin/60))
depmeters = $10
printf("%s, %s, %9.6f, %9.6f, %s\n",shipdate, gpstime, declat, declon, depmeters)
}
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 6 of 17)
-
The ANSI text file was loaded into ArcView 3.3 as an event theme and then saved as a shapefile using Theme - convert to shapefile.
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 7 of 17)
-
Within ArcView 3.3 I used the spatial join capabilities to join the ship navigation and fathometer information to each line of resistivity navigation. This is accomplished by opening both attribute tables in ArcView. Then make the source table active (the table that I want to join to the other table). In this case, that's the attribute table for shippnts_249.shp. Within this table, click the Shape field's name. Then make the other attribute table active (*.shp where * represents the line name such as l1f1). Select the Shape field's name. Then from the table menu, choose "Join". This essentially finds the closest positional point in shippnts_249.shp and joins it to the *.shp attribute table. (* refers to the line name, which for this day are l1f1, l2f1, l3f1, l4f1, l5f1 and l6f1)
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
- Date: 2006 (process 8 of 17)
-
The only information I need from this joined table is the bathymetry information. So using the table properties, I turn off (uncheck the visible option) everything but the depth values. Once this is done, I use File - Export to export the table to a delimited text file. (* refers to the line name, which for this day are l1f1, l2f1, l3f1, l4f1, l5f1 and l6f1)
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 9 of 17)
-
I then ran an AWK script which would take the each line of the bathymetry information and convert it to the $SDDPT format that a GPS system would record. (* refers to the line name, which for this day are l1f1, l2f1, l3f1, l4f1, l5f1 and l6f1). The $SDDPT refers to the water depth relative to the transducer, in meters. The sentence is of the format "$SDDPT, DATA_METERS, OFFSET_METERS, MAXIMUM_METERS*hh<0D><0A> where the portion after the * is a checksum value. I manually defined everything except the actual depth values, since those are the only values I'll use.
awk_sddpt:
{
depthval = $1
printf("$SDDPT,%s,0.0*65\n",depthval)
}
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 10 of 17)
-
For every line in the extracted GPRMC data, I now have a separate files with the same number of lines containing bathymetry information in the $SDDPT format. Using CYGWIN (a UNIX like environment that runs under Windows) I use the "paste" command to join the two files using a newline character as the delimiter between the two files. Essentially what this does is generate a file with a line of GPRMC data, then SDDPT and so for and so on. The syntax with the paste command I used for the resistivity navigation is:
paste -d '\n' filename1 filename2 > output
where filename1 is the GPRMC text file, filename2 is the bathymetry text file, and the output is the repaired GPS navigation file. (* refers to the line name, which for this day are l1f1, l2f1, l3f1, l4f1, l5f1 and l6f1)
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2006 (process 11 of 17)
-
I then ran an AWK script on the resulting GPS files to generate a single comma-delimited text file with the information of interest. I then used VI to add the appropriated header line.
AWK script awkit:
BEGIN {
FS=","
}
{
FS= ","
ARGC = 2
if ($1=="$GPRMC") {
gpstime = $2
hr = substr($2,1,2)
min = substr($2,3,2)
sec = substr($2,5,2)
latdeg = substr($4,1,2)
latmin = substr($4,3,6)
londeg = substr($6,2,2)
lonmin = substr($6,4,6)
declat = latdeg + (latmin/60)
declon = (londeg + (lonmin/60)) * -1
date = $10
day = substr($10,1,2)
month = substr($10,3,2)
year = substr($10,5,2)
}
else if ($1=="$SDDPT") {
depth = $2
printf("%8.6f, %8.6f, %s:%s:%s, %s, %s, %s\n",declon, declat, hr, min, sec, date, depth, ARGV[2])
}
}
The running of the script was initiated with a simple executable shell script under CYGWIN (a Unix like environment that runs under Windows
"doawk":
files=`ls *.gps | cut -d. -f1`
for file in $files
do
awk -f awkit $file.gps $file >> resnav_jd249.txt
done
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
- l1f1fix.gps
- l2f1fix.gps
- l3f1fix.gps
- l4f1fix.gps
- l5f1fix.gps
- l6f1fix.gps
Data sources produced in this process:
- Date: 2009 (process 12 of 17)
-
The comma-delimited text file was imported to ArcMap 9.2: Tools - Add XY Data. The X field is longitude; Y field is latitude, and the Coordinate System was defined as Geographic, NAD83. Because of the format of the "gpstime" field, the default for ArcMap is to import this as a date/time field. Because I wanted this field to remain a text field, I edited the schema.ini file in the folder with the text file to define each attributes definition. I also made sure the DATE field imported as a text attribute to preserve the leading zero. I then used the data export (right-mouse click on the event theme, Data - Export Data) to save the event theme as a shapefile.
schema.ini:
[resnav_jd249.txt]
Format=CSVDelimited
ColNameHeader=True
Col1=longitude Double
Col2=latitude Double
Col3=gpstime Text Width 8
Col4=gpsdate Text Width 10
Col5=depth_m float
Col6=linename Text Width 11
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 2009 (process 13 of 17)
-
Using ArcMap 9.2 added the attributes "gps_src' and "bathy_src" so that I could differentiate the source of each navigation fix and bathymetry value. On this particular day, all the navigational fixes came from the Lowrance system, while the bathymetry values came from the ship's gps/fathometer system.
Person who carried out this activity:
VeeAnn A. Cross
U.S. Geological Survey
Marine Geologist
Woods Hole Coastal and Marine Science Center
Woods Hole,
MA
(508) 548-8700 x2251 (voice)
(508) 457-2310 (FAX)
vatnipp@usgs.gov
Data sources used in this process:
Data sources produced in this process:
- Date: 20-Oct-2016 (process 14 of 17)
-
Edits to the metadata were made to fix any errors that MP v 2.9.34 flagged. This is necessary to enable the metadata to be successfully harvested for various data catalogs. In some cases, this meant adding text "Information unavailable" or "Information unavailable from original metadata" for those required fields that were left blank. Other minor edits were probably performed (title, publisher, publication place, etc.). The source information was incomplete and had to be modified to meet the standard. The distribution format name was modified in an attempt to be more consistent with other metadata files of the same data format. The metadata date (but not the metadata creator) was edited to reflect the date of these changes. The metadata available from a harvester may supersede metadata bundled within a download file. Compare the metadata dates to determine which metadata file is most recent.
Person who carried out this activity:
U.S. Geological Survey
Attn: VeeAnn A. Cross
Marine Geologist
384 Woods Hole Road
Woods Hole,
MA
508-548-8700 x2251 (voice)
508-457-2310 (FAX)
vatnipp@usgs.gov
- Date: 20-Jul-2018 (process 15 of 17)
-
USGS Thesaurus keywords added to the keyword section.
Person who carried out this activity:
U.S. Geological Survey
Attn: VeeAnn A. Cross
Marine Geologist
384 Woods Hole Road
Woods Hole,
MA
508-548-8700 x2251 (voice)
508-457-2310 (FAX)
vatnipp@usgs.gov
- Date: 18-Nov-2019 (process 16 of 17)
-
Crossref DOI link was added as the first link in the metadata.
Person who carried out this activity:
U.S. Geological Survey
Attn: VeeAnn A. Cross
Marine Geologist
384 Woods Hole Road
Woods Hole,
MA
508-548-8700 x2251 (voice)
508-457-2310 (FAX)
vatnipp@usgs.gov
- Date: 08-Sep-2020 (process 17 of 17)
-
Added keywords section with USGS persistent identifier as theme keyword.
Person who carried out this activity:
U.S. Geological Survey
Attn: VeeAnn A. Cross
Marine Geologist
384 Woods Hole Road
Woods Hole,
MA
508-548-8700 x2251 (voice)
508-457-2310 (FAX)
vatnipp@usgs.gov
