documenting multitudinous little scripts

This commit is contained in:
Philip Sargent 2020-04-26 00:48:38 +01:00
parent a233c4880b
commit 04976f6ed8
7 changed files with 231 additions and 87 deletions

View File

@ -372,8 +372,142 @@ A short 2m climb through a boulder choke leads to break down chamber directly be
----Little boy bolt climbs---- ----Little boy bolt climbs----
<dd> <dd>
From the grand prix, left from little boy beneath the boulders is a large hanging boulder. Traverse along massive choked boulder on left hand side of grand prix. Not derigged. Climbs up steep mud slope into rift that shortly forks (station 4). P15 qmc down from here, leads probably to lbbeneaththeboulders. Sketchy rift climb qmc from here, dispute about seeing a human sized passage beyond here. From the grand prix, left from little boy beneath the boulders is a large hanging boulder. Traverse along massive choked boulder on left hand side of grand prix. Not derigged. Climbs up steep mud slope into rift that shortly forks (station 4). P15 qmc down from here, leads probably to lbbeneaththeboulders. Sketchy rift climb qmc from here, dispute about seeing a human sized passage beyond here.
</dl>
<h3>List of jobs in :loser:/docs/Questions.txt</h3>
<dt>Jan 2015, Dec 2013, Apr 2013. 2012
<dd>
<pre>
Jan 2015
Arge dataset merge:
32/links.svx says
"*export 27_5 ; neu2013.0" in ARGE dataset
"*export 27_5 ; forever.5" in ours.
are both right?
There is also an "Anschluss Schnellzug" exported in our dataset, biut not theirs.
32/forever has p1-p22 in it, which is confusing given our 'p' convention for entrances.
outstanding issues:
named instead of numbered caves:
loutotihoele, blaubeer, gassischacht etc
*fix in each cave (but commented)
File headers outside surveys
All single-line exports
Named caves should go to
Dec 2013
p87 moved 46m between ARGE git dataset and cucc dataset. Check!
flusstunnel was missing from CUCC dataset. added.
lengths:
944 99680m CUCC: 59666m Arge: 40027m All fixed (50m difference in 40)
936 98786m CUCC: 59666m Arge: 39120m 142 missing, and Data missing in 40
880 97915m CUCC: 59175m Arge: 38741m
Arge in git repo 2012 39017m
Comparing arge per-cave length spreadsheet finds that 40 and 41 are
500 and 600m shorter in CUCC dataset than ARGE one. 41 is due to 142
being separated out in our dataset. 40 is due to more missing
flusstunnel data.
alice-umgehang (bypass) file from 1998 exists in RobertW dataset,
unconnected.
March/April 2013 stuff
BS17 data added.
There are two 233s. How shall we fix this? 'blaubeer' has no entrance
fix so not connected.
144 merged. should me2 be better called meander2.svx?
88 merged. sophy survey moved out of lerche1
merged all olly's date adittions back in merged set
merged olaf's gps recalcs into merged set
merged olly's changes in plateau area (2004_03 gps point replaced with
surface survey). other surafce survey connection to p107 fixed.
In 143/canyon.svx this line was added:
; anpassung zu vermessung
3_6_7 6_7 0 0 0
to 2010 survey. Was this in fact done in 2011 or 2012? when the
; Messteam: Andreas Scheurer, Schnitzel, Lothar Midden
; Zeichner: Lothar Midden
*date 2011.08.07
survey was done?
If so it should have relevant metadata, or infact just be put down at
the bottom with a note about where it refers to.
You've commented it out in latest dataset.
"; wozu? auskommentiert 2011-11-19 (thomas)"
where did 143/krone.svx go? Just superceded?
41 merged:
germanrt split out of e41 survey
115: b9 duplicate survey - keep or remove?
CUCC surveys all moved into cucc subdir. Old SU conversions replaced
with newer ones. Akte surveys renamed. Stream split in surveys.
Juttahoehle: 'jutta.svx'. This is 1984 data from Franz Lindenmayr. Has
been under '40' since 2000. Now moved to Juttahoehle dir. Is it really
a separate cave?
We don't have entrance locations for: E08, E16, E18, Nachbarschacht
(in 233 dir), gruenstein. Does data exist?
------------
-- 233. Robert Seebacher's kataster spreadsheet has 233 = Betthupferle, and the length and depth match the svx file betthupferle.svx. I have thus renamed betthupferle.svx to 233/233.svx and copied the ent coords out of RS's file. But Blaubeerschacht also claims to be no. 233. I have put blaubeerschacht in but not linked it, as we don't have an entrance fix.
-- Which points of Griesskogelschacht are entrances?
-- File "neu.svx". What is the deal with this? Does the cave have a name or a number?
Example data file for 'new survey'?
-- 41/entlink.svx -- what does this do?
-- The 1987 extension in 87. This doesn't match anything in the ARGE data,
whereas the original 1980 survey data looks like the ARGE data rotated
somewhat. I have left this unlinked. Perhaps best to ask Robert Winkler.
-- 87 location fix and the 115 connection. The entrance fix for 87 in ARGE's file is over 50m different from the entrance fix from our surface survey. Bizarrely, CUCC's ent fix gives a smaller misclosure than ARGE's when you tie into 115.
-- 113. ARGE's data and CUCC's data cover different bits of the cave and don't really match very well.
-- 145. I have combined CUCC's data and ARGE's for the upper level resurvey. Any comments?
-- 41-144 connection. Is the line
*equate 144.144verb.58 41.entlueft.9_10
correct? It appears in some of the ARGE index files and not others!
113 cucc replaced by ARGE
2012:
why is e142 survey inside 41? 142 is separate cave. We have an
antrance location for it. Is it in fact used in any of the surveys?
152 (bananahoehle) is connected to 113 (sonnetrahlhoehle). but p152=Q3
on stogersteig. No GPS or fixed point in ents file. Why not?
136 cannot be processed on its own due to 136d not being connected.
Need to get better info on errors with/without surface and GPS and old
and new. And decide wht to do about caves that can't be processed
alone. Put fixes into all cave files? How do we do updates then?
</pre>
</dl> </dl>
<!-- ------------------- Do not touch anything below here either ------------------------> <!-- ------------------- Do not touch anything below here either ------------------------>
<!--2020-03-26 Testing.. --> <!--2020-03-26 Testing.. -->

View File

@ -99,7 +99,11 @@ input[type=checkbox]:checked ~ dl dd {
b { b {
font-size: 10pt; font-size: 10pt;
} }
dt, p { p {
font-size: 10pt;
}
dt{
font: 1.0em Calibri, sanserif; font: 1.0em Calibri, sanserif;
font-weight: bold; font-weight: bold;
} }

View File

@ -38,11 +38,6 @@ If a heading is in italics, then there are hidden items.
<h3>Process Documentation</h3> <h3>Process Documentation</h3>
<dl> <dl>
<dt><!--2020-03-26 psargent-->Wallets and new-cave</dt> <dt><!--2020-03-26 psargent-->Wallets and new-cave</dt>
<dd><!--2020-03-26 psargent-->Explain (in the wallets process) how to view the surveys
online so that <br>&nbsp;&nbsp;(1) you can see an example of how to do your new one,
and <br>&nbsp;&nbsp;(2) so that you can check that you have done it properly when you
have finished.</dd>
<dd><!--2020-03-26 psargent-->Explain how to link a new cave into the other caves in <dd><!--2020-03-26 psargent-->Explain how to link a new cave into the other caves in
troggle filesystem</dd> troggle filesystem</dd>
<dd><!--2020-03-26 psargent-->Explain how to add photos with the correct URL format to sub-HTML files attached to New Caves</dd> <dd><!--2020-03-26 psargent-->Explain how to add photos with the correct URL format to sub-HTML files attached to New Caves</dd>
@ -53,11 +48,21 @@ If a heading is in italics, then there are hidden items.
<dd>explain how to put stuff in the wallet folder and how to look at expofiles/photos/xml/ <dd>explain how to put stuff in the wallet folder and how to look at expofiles/photos/xml/
<dd>Add to user data manual how to upload to expofiles - in the "survey manual" <dd>Add to user data manual how to upload to expofiles - in the "survey manual"
<dd>Add in description of *where* to put the drawings files <dd>Add in description of *where* to put the drawings files
<dt><!--2020-04-13 psargent-->QMs check</dt>
<dd>explain when to use svx2qm.py -> qms.csv-> tablize-qms.pl <a href="troggle/scriptscurrent.html">current scripts</a>
<dd>explain when to use find-dead-qms.py and qmreader.pl <a href="troggle/scriptscurrent.html">current scripts</a>
</dl> </dl>
<h3>Surveys data entry documentation</h3>
<dl>
<dt>Write code to automatically extract ref info about wallets from tunnel xml files
<dd><!--2020-04-03 psargent-->This will replace :drawings:chk-xml.txt as used by :drawings:check-xml.sh
<dd><!--2020-04-03 psargent-->Do similar for Therion files when people start using #REF comments
<dt><!--2020-03-26 psargent-->2019 surveyscans
<dd><!--2020-03-26 psargent-->edit all the content.json</dd>
<dd><!--2020-03-26 psargent-->try to autocomplete the content.json by parsing .svx files</dd>
<dd><!--2020-03-26 psargent-->Put personal names into canonical form</dd>
<dt>2014 contents.json
<dd><!--2020-04-03 psargent-->parse all the svx files to extract people, dates & svx references
</dl>
<h3>Handbook</h3> <h3>Handbook</h3>
<dl> <dl>
@ -67,8 +72,6 @@ If a heading is in italics, then there are hidden items.
<dd><!--2020-04-11 psargent-->Diagrams of major sections: survey handbook, rigging handbook, computing handbook, Areas, cave data..</dd> <dd><!--2020-04-11 psargent-->Diagrams of major sections: survey handbook, rigging handbook, computing handbook, Areas, cave data..</dd>
<dd><!--2020-04-11 psargent-->Chase Airoa to help fix <a href="../troggle/menudesign.html">the menus for phones</a></dd> <dd><!--2020-04-11 psargent-->Chase Airoa to help fix <a href="../troggle/menudesign.html">the menus for phones</a></dd>
<dd><!--2020-04-11 psargent-->Look at <a href="https://www.gov.uk/guidance/government-design-principles">gov.uk guidelines</a> for inspiration</dd> <dd><!--2020-04-11 psargent-->Look at <a href="https://www.gov.uk/guidance/government-design-principles">gov.uk guidelines</a> for inspiration</dd>
<dt><!-- 2020-04-11 psargent -->NOEDIT flag
<dd><!-- 2020-04-11 psargent -->When editing multiple pages (using git), describe how this is implemented using &lt;meta name="keywords" content="NOEDIT"&gt;
<dt>Editing Logbooks <dt>Editing Logbooks
<dd><!--2020-04-20 psargent-->DOCUMENT how to pout the "cave" or "locatoion" into the logbook entry title <dd><!--2020-04-20 psargent-->DOCUMENT how to pout the "cave" or "locatoion" into the logbook entry title
<dd><!--2020-04-20 psargent-->add the triptitle "location - " to logbook template (example) file (where?) <dd><!--2020-04-20 psargent-->add the triptitle "location - " to logbook template (example) file (where?)
@ -88,22 +91,7 @@ If a heading is in italics, then there are hidden items.
</dl> </dl>
<h3>Surveys data entry documentation</h3>
<dl>
<dt><!--2020-04-13 psargent-->QMs check</dt>
<dd>3 ways to do it: archaic (as in databaseRest, new troggle & the Withnall script)
<dt>Write code to automatically extract ref info about wallets from tunnel xml files
<dd><!--2020-04-03 psargent-->This will replace :drawings:chk-xml.txt as used by :drawings:check-xml.sh
<dd><!--2020-04-03 psargent-->Do similar for Therion files when people start using #REF comments
<dt><!--2020-03-26 psargent-->2019 surveyscans
<dd><!--2020-03-26 psargent-->edit all the content.json</dd>
<dd><!--2020-03-26 psargent-->try to autocomplete the content.json by parsing .svx files</dd>
<dd><!--2020-03-26 psargent-->Put personal names into canonical form</dd>
<dt>2014 contents.json
<dd><!--2020-04-03 psargent-->parse all the svx files to extract people, dates & svx references
</dl>
<h3>Laptop config.</h3> <h3>Laptop config.</h3>
<dl> <dl>
<dt><!-- 2020-04-11 psargent --> imagemagick convert <dt><!-- 2020-04-11 psargent --> imagemagick convert
@ -120,8 +108,6 @@ If a heading is in italics, then there are hidden items.
<dt><!--2020-04-20 psargent-->:loser:/docs/ files <dt><!--2020-04-20 psargent-->:loser:/docs/ files
<dd>Questions.txt <dd>Questions.txt
<dd>SMKlog.txt <dd>SMKlog.txt
<dt><!--2020-04-20 psargent-->"other scripts" - DOCUMENT
<dd>finish writing notes on files already identified
<dt><!--2020-03-26 psargent-->Troggle architecture</dt> <dt><!--2020-03-26 psargent-->Troggle architecture</dt>
@ -139,6 +125,8 @@ If a heading is in italics, then there are hidden items.
<dt>non-troggle scripts <dt>non-troggle scripts
<dd><!--2020-04-03 psargent-->DOCUMENT them all - have we got <a href="../troggle/otherscripts.html">a full list</a>? <dd><!--2020-04-03 psargent-->DOCUMENT them all - have we got <a href="../troggle/otherscripts.html">a full list</a>?
<dt>Makefile
<dd>Get it working !
</dl> </dl>
@ -146,17 +134,18 @@ If a heading is in italics, then there are hidden items.
<h3>Troggle</h3> <h3>Troggle</h3>
<dl> <dl>
<dt>Better import error messages <dt>Better import error messages
<dd><!--2020-04-03 psargent-->REPORT if import surveyscan file failure into database error log <dd><!--2020-04-03 psargent-->REPORT if import surveyscan file failure into database error log -> "DataIssue" register
<dd><!--2020-04-20 psargent-->REPORT 'folder not recognised' errors into error log inside database <dd><!--2020-04-20 psargent-->REPORT 'folder not recognised' errors into error log inside database -> "DataIssue" register
<dd><!--2020-04-03 psargent-->WHY are total lengths of surveyed cave different between expo server and WSL server for 2019 and a few other years only ? <dd><!--2020-04-03 psargent-->WHY are total lengths of surveyed cave different between expo server and WSL server for 2019 and a few other years only ?
<dd><!--2020-04-20 psargent-->DEBUG - too many messages - reduce the number unless we need them <dd><!--2020-04-20 psargent-->DEBUG - too many messages - reduce the number unless we need them
<dd><!--2020-04-20 psargent-->Why is "kataster' not found ?! <dd><!--2020-04-20 psargent-->Why is "kataster' not found ?!
<dd><!--2020-04-20 psargent-->What is "GPS "not parsed in survex" mean <dd><!--2020-04-20 psargent-->What is "GPS "not parsed in survex" mean
<dt>Test import when: <dt>Test import when:
<dd><!--2020-04-20 psargent-->no profile logging .json file present <dd><!--2020-04-20 psargent-->no profile logging .json file present
<dt><!-- 2020-04-11 psargent -->Troggle Menus <dt>Missing .3d files
<dd>Explain how FLATPAGES work <dd><!--2020-04-25 psargent-->REPORT if there is no .3d file - make it if it is not there ? O rjust leave it to Makefile ?
<dd><!-- 2020-04-11 psargent -->NOEDIT flag Describe how this is implemented using &lt;meta name="keywords" content="NOEDIT"&gt; e.g. for auto-generated pages such as folk script <dt><!-- 2020-04-11 psargent -->Troggle parser/viewer
<dd>Explain how FLATPAGES work. refer to computing/hbmanual1.html
<dt>Logbook data model: unfilled fields? <dt>Logbook data model: unfilled fields?
<dd><!--2020-04-03 psargent-->'cave' of location field missing on nearly all logbook entries. Missing from logbook templates. Fill in manually for pre-2017 logbooks. <dd><!--2020-04-03 psargent-->'cave' of location field missing on nearly all logbook entries. Missing from logbook templates. Fill in manually for pre-2017 logbooks.
@ -166,9 +155,8 @@ If a heading is in italics, then there are hidden items.
<h3>Expo Server</h3> <h3>Expo Server</h3>
<dl> <dl>
<dt><!--2020-03-26 psargent--> document directory structure <dt><!--2020-03-26 psargent--> document directory structure
<dd><!--2020-04-03 psargent-->as per Julian's GitHub list - then close that issue</dd> <dd><!--2020-04-03 psargent-->as per Julian's GitHub list - then close that issue.
<dt>Makefile Use 'tee' to cretae ascii art for this.</dd>
<dd>Get it working !
<dt>permissions <dt>permissions
<dd><!--2020-04-03 psargent-->do we need a cron job or has the group membership fix fixed it ? either way, document it. <dd><!--2020-04-03 psargent-->do we need a cron job or has the group membership fix fixed it ? either way, document it.
@ -178,6 +166,8 @@ If a heading is in italics, then there are hidden items.
<dd><!--2020-04-03 psargent-->DOCUMENT How to set up a server <dd><!--2020-04-03 psargent-->DOCUMENT How to set up a server
<dd><!--2020-04-10 psargent-->Fix and document permissions for cron jobs <dd><!--2020-04-10 psargent-->Fix and document permissions for cron jobs
<dd><!--2020-04-10 psargent-->Explain why Docker containers can be a maintenance nightmare <dd><!--2020-04-10 psargent-->Explain why Docker containers can be a maintenance nightmare
<dd><!--2020-04-25 psargent--> /expofiles/ needs config , refer to apache/django docm.
<dd><!--2020-04-25 psargent--> /static/ needs config - refer to django docm.
</dl> </dl>

View File

@ -15,7 +15,7 @@
<li><a href="scriptscurrent.html#folk">make-folklist.py</a> turns the folk.csv file into a webpage. <li><a href="scriptscurrent.html#folk">make-folklist.py</a> turns the folk.csv file into a webpage.
<li><a href="scriptscurrent.html#gps">make_essentials.sh</a> generates GPS tracks and routes for surface walking <li><a href="scriptscurrent.html#gps">make_essentials.sh</a> generates GPS tracks and routes for surface walking
<li><a href="scriptscurrent.html#photos">updatephotos</a> generates navigable webpages from annual directories of photo images <li><a href="scriptscurrent.html#photos">updatephotos</a> generates navigable webpages from annual directories of photo images
<li><a href="scriptscurrent.html#dplong">create_dplong_table.py</a> Creates and updates the lengths and depths of all the caves
<li><a href="scriptscurrent.html#area">make-areaindices.py</a> (unmaintained?) <li><a href="scriptscurrent.html#area">make-areaindices.py</a> (unmaintained?)
<li><a href="scriptscurrent.html#prosp">make-prospectingguide-new.py</a> and <a href="">prospecting_guide_short.py</a> - (unmaintained?)</li><br /> <li><a href="scriptscurrent.html#prosp">make-prospectingguide-new.py</a> and <a href="">prospecting_guide_short.py</a> - (unmaintained?)</li><br />
<li><a href="../bankofexpo.html">boe</a> Bank of Expo (perl) runs the accounts preceding and during expo <li><a href="../bankofexpo.html">boe</a> Bank of Expo (perl) runs the accounts preceding and during expo
@ -29,7 +29,11 @@
<li><a href="scriptscurrent.html#svxtrace">svxtrace.py</a> analyses Survex tracks to help find errors <li><a href="scriptscurrent.html#svxtrace">svxtrace.py</a> analyses Survex tracks to help find errors
<li><a href="scriptscurrent.html#survex">chk-refs.sh</a> analyses Survex files and wallets files to find reference errors</li><br /> <li><a href="scriptscurrent.html#survex">chk-refs.sh</a> analyses Survex files and wallets files to find reference errors</li><br />
<li><a href="scriptscurrent.html#loser1624">convert.py</a> Scripts working on Loser-1624 Uebersicht_2011.svx</li> <li><a href="scriptscurrent.html#loser1624">convert.py</a> Scripts working on Loser-1624 Uebersicht_2011.svx</li>
<li><a href="scriptscurrent.html#cavestats">cavestats</a> extracts overall lengths and depths from all the survex files <li><a href="scriptscurrent.html#dplong">create_dplong_table.py</a> Creates and updates the lengths and depths of all the caves.
<li><a href="scriptscurrent.html#cavestats">cavestats</a> and <a href="scriptscurrent.html#cavestats">smklengths </a> extract overall lengths and depths from all the survex files
<li><a href="scriptscurrent.html#summ">summarizecave.sh</a> gets .3d file contents using survex
<li><a href="scriptscurrent.html#tabular">caves-tabular.html</a> a re-sortable table of cave data
<li><a href="scriptscurrent.html#makefile">Makefile</a> coordinates running many of these scripts (needs maintenance) <li><a href="scriptscurrent.html#makefile">Makefile</a> coordinates running many of these scripts (needs maintenance)
</ul> </ul>
@ -41,6 +45,7 @@
<ul> <ul>
<li><a href="scriptscurrent.html#glossary">make-glossary.pl</a> - used while documenting very complex caves (161 and 204). <li><a href="scriptscurrent.html#glossary">make-glossary.pl</a> - used while documenting very complex caves (161 and 204).
We may need this again for Tunnocks/Balkon. We may need this again for Tunnocks/Balkon.
<li><a href="scriptscurrent.html#alljs">make-fb-map.pl</a> does coordinate transformations
<li><a href="scriptscurrent.html#alljs">make-alljs.py</a> - extracts legs and entrances - still used? <li><a href="scriptscurrent.html#alljs">make-alljs.py</a> - extracts legs and entrances - still used?
<li><a href="scriptscurrent.html#indxl4">make-indxal4.pl</a> - is this obsolete? <li><a href="scriptscurrent.html#indxl4">make-indxal4.pl</a> - is this obsolete?
</ul> </ul>

View File

@ -40,49 +40,48 @@ p {
<p><a href="">updatephotos</a> (in the :loser: repo) uses the BINS package to generate photo albums. BINS uses the EXIF data (date, location if available) in the uploaded image files to produce a page showing the information available about the picture. All image meta-data are stored in XML files. <p><a href="">updatephotos</a> (in the :loser: repo) uses the BINS package to generate photo albums. BINS uses the EXIF data (date, location if available) in the uploaded image files to produce a page showing the information available about the picture. All image meta-data are stored in XML files.
<p>BINS is no longer maintained by its author so expo has taken on the responsibility for keeping it running. (Wookey is in the process of packaging it as a proper debian package). <p>BINS is no longer maintained by its author so expo has taken on the responsibility for keeping it running. (Wookey is in the process of packaging it as a proper debian package).
<h4 id="svx2qm">svx2qm.py</a> and QMs</h4> <h4>svx2qm.py, tablize-qms.pl, find-dead-qms.py,qmreader.pl</h4>
<p>Philip Withnall's QM extractor (in :loser:/qms/). It generates a list of all the QMs in all the svx files in either text or CSV format. This will produce a text output of all the QMs: See the entire page devoted to the various
<pre><code>cd loser <a href="scriptsqms.html">QM scripts</a>.
find -name '*.svx' | xargs ./svx2qm.py --format csv
</code></pre>
<h4 id="tabqmsqms">tablize-qms.pl</h4>
<p>Takes a CSV file name as the program's argument (e.g. qm.csv as generated by svx2qm.py) and generates an HTML page listing all the QMs.
<p>In :expoweb:/1623/204/ and several other subdirectories of /1623/
<h4 id="find-dead-qms">find-dead-qms.py</h4>
<p>This finds references to completed qms in the cave descriptions.
<p>Also
<a href="#qmreader">qmreader.pl</a> which reads and parses qm.html (why?)
<p>In :expoweb:/1623/204/ - Nial Peters (2011)
<h4 id="svxtrace">svxtrace.py</h4> <h4 id="svxtrace">svxtrace.py</h4>
<p>Traces all the svx file dependencies via the *include statements. In :expoweb:/ . <p>Traces all the svx file dependencies via the *include statements. In :expoweb:/ . The documented workflow today does not appear to need this, but that might be a documentation fault. It might do a key job. <span style="color:red">[to be investigated]</span>
<h4 id="survex">Survex files</a> - reference checking</h4> <h4 id="survex">Survex files</a> - reference checking</h4>
<p>Survex files contain a reference to the wallet which contains the original survey notes for that surveyed passage. These sometimes have errors and also get out of date as caves get renamed when they get a kataster number issued. Each online survey wallet also has a reference to the survex file(s) which have been typed up from that data. <p>Survex files contain a reference to the wallet which contains the original survey notes for that surveyed passage. These sometimes have errors and also get out of date as caves get renamed when they get a kataster number issued. Each online survey wallet also has a reference to the survex file(s) which have been typed up from that data.
<p>Validating the references is checked by scripts check-svx.sh, check-refs.sh, check-refs.awk in the :loser: repository to produce <a href="../../svxvalid.html">svxvalid.html</a> which lists mismatches between the svx files and the survey scan wallets. <p>Validating the references is checked by scripts check-svx.sh, check-refs.sh, check-refs.awk in the :loser: repository to produce <a href="../../svxvalid.html">svxvalid.html</a> which lists mismatches between the svx files and the survey scan wallets.
<p>This is a horrible proof-of-concept hack that needs replacing with a proper python script instead of an assemblage of awk, bash and sed.
<h4 id="draw">Drawings files</a> - reference checking</h4> <h4 id="draw">Drawings files</a> - reference checking</h4>
<p>Tunnel files contain references to the wallet which contained the original survey notes for that surveyed and drawn passage. <p>Tunnel files contain references to the wallet which contained the original survey notes for that surveyed and drawn passage.
<p>The results of validation checks are in <a href="../../xmlvalid.html">xmlvalid.html</a> and generated by script check-xml.sh in the :drawings: repository. <p>The results of validation checks are in <a href="../../xmlvalid.html">xmlvalid.html</a> and generated by script check-xml.sh in the :drawings: repository.
<p>(Therion files would too, if people inserted "#Ref" comments. In which case the script would need improving.) <p>(Therion files would too, if people inserted "#Ref" comments. In which case the script would need improving.)
<p>Currently the intermediate data it works from has to be hand-generated so a <span style="color:red">proper parsing script needs to be written</span>.
<h4 id="tabular">caves-tabular.html</h4>
<p> This webpage <a href="../../caves-tabular.html">caves-tabular.html</a> uses a page-specifc JavaScript file TableSort.js which allows the user to resort the table of all the cave data by any of the columns by clicking on it [by Radost]. The exact source (i.e. the report or script) of the data in the table is unknown.
<h4 id="gps">make_essentials.sh GPS</h4>
<p>In :expoweb:/noinfo/
<p>Makes essentials.gpx - see <a href="../essentials.html">GPS on expo</a>.
<h4 id="dplong">create_dplong_table.py</h4> <h4 id="dplong">create_dplong_table.py, <span id="cavestats">cavestats</span>
<p>In :expoweb:/noinfo/ and smklengths</h4>
<p>"cavestats" is compiled by noinfo/cavestats.build source code and is used by
"create_dplong_table.py".
<p><em>:loser:/docs/smklengths</em> is a brief bash script that runs cavern on all the top-level cave svx files and extracts the total lengths.
<h4 id="surface">make_svx.sh</h4>
<p><span style="color:red">[to be documented]</span> <p><span style="color:red">[to be documented]</span>
<h4 id="area">make-areaindices.py</h4> <h4 id="area">make-areaindices.py</h4>
<p>In :expoweb:/noinfo/ <p>In :expoweb:/noinfo/ - a key part (?) of generating the prospecting guides ? See below.
<p><span style="color:red">[to be documented]</span> <p><span style="color:red">[to be documented]</span>
<h4 id="prosp">make-prospectingguide-new.py</h4> <h4 id="prosp">make-prospectingguide-new.py</h4>
<p>In :expoweb:/noinfo/prospecting_guide_scripts/ <p>In :expoweb:/noinfo/prospecting_guide_scripts/
<p><span style="color:red">[to be documented]</span> <p><span style="color:red">[to be documented] - We need a whole webpage on how to construct the various prospecting guides.</span>
<h4 id="latex">seshbook, bierbook & protractors</h4> <h4 id="latex">seshbook, bierbook & protractors</h4>
<p>How these are used once produced is <a href="../bierbook.html">documented in the the handbook</a> <p>How these are used once produced is <a href="../bierbook.html">documented in the the handbook</a>
<p>These are LaTeX files and the instructions for how to process them are in each .tex file. The protractors do not change but the others need a configuration file for all the cavers expected to attend expo. <p>These are LaTeX files and the instructions for how to process them are in each .tex file. The protractors do not change but the others need a configuration file for all the cavers expected to attend expo.
@ -94,15 +93,14 @@ Due to the way LaTeX works out table column witdths, these commands may need to
The design of these files is intended to confine all changes year to year to the names.txt and dates.txt files, thanks to LaTeX's capability to read an external file and iterate through line by line performing the same action for each name. The design of these files is intended to confine all changes year to year to the names.txt and dates.txt files, thanks to LaTeX's capability to read an external file and iterate through line by line performing the same action for each name.
<h4 id="surface">make_svx.sh</h4> <h4 id="summ">summarizecave.sh</h4>
<p><span style="color:red">[to be documented]</span> <p>This runs "cavern" (a commandline tool installed as part of survex) to produce a text (or HTML) report of the key statistics from the master svx file for a cave (the one that includes all the svx files for the individual passages).
<h4 id="cavestats">cavestats</h4>
<p><span style="color:red">[to be documented]</span> <h4 id="gps">make_essentials.sh GPS</h4>
<p>In :expoweb:/noinfo/
<p>Makes essentials.gpx - see <a href="../essentials.html">GPS on expo</a>.
<h3 id="inscripts">Old and possibly obsolete scripts</a></h3>
<h4 id="alljs">make-alljs.py</h4>
<p>Writes out legs and entrances in json format. In :loser:/fixedpts/
<h4 id="glossary">make-glossary.pl</h4> <h4 id="glossary">make-glossary.pl</h4>
<p>In :expoweb:/1623/204/ and /1623/161/. It reads a cave-specific glossary.csv and produces the HTML files for caves 161 and 204: <p>In :expoweb:/1623/204/ and /1623/161/. It reads a cave-specific glossary.csv and produces the HTML files for caves 161 and 204:
@ -110,25 +108,34 @@ The design of these files is intended to confine all changes year to year to the
<li><a href="/1623/204/atoz.html">/1623/204/atoz.html</a> <li><a href="/1623/204/atoz.html">/1623/204/atoz.html</a>
<li><a href="/1623/161/a-z.htm">/1623/161/a-z.htm</a> <li><a href="/1623/161/a-z.htm">/1623/161/a-z.htm</a>
</ul> </ul>
<p>which are indexes to passage names and locations in the very extensive vcave descriptions for Kaninchenhohle and Steinbruckenhohle. <p>which are indexes to passage names and locations in the very extensive cave descriptions for Kaninchenhohle and Steinbruckenhohle. We may need this again for Tunnocks/Balkonhohle.
<h4 id="alljs">make-alljs.py</h4>
<p>Writes out legs and entrances in json format. In :loser:/fixedpts/ (along with <em>make-fb-map.pl</em>which does Austrian coordinate transformations).
Also in the :loser:fixedpts/scripts/convert_shx/ folder is a 135-line short script convert_shx.ml written in
<a href="https://en.wikipedia.org/wiki/OCaml">OCaml</a> which constructs input to the
<a href="https://gdal.org/programs/ogr2ogr.html">ogr2ogr</a> GIS feature file format conversion utility.
<p>The documented workflow today does not appear to need this, but that might be a documentation fault. It might do a key job. <span style="color:red">[to be investigated]</span>
<h4 id="indxl4">make-indxal4.pl</h4> <h3 id="inscripts">Old and possibly obsolete scripts</a></h3>
<p>Obsolete.
<p>See history documents which refer to CAVESTATS.CSV
<p><span style="color:red">[to be documented - for historic interest only]</span>
<h4 id="logbk">logbk.pl</h4>
<p>Obsolete.
<p>This function is now done by the troggle input parsers.
<p><span style="color:red">[to be documented - for historic interest only]</span>
<h4 id="loser1624">Loser-1624 scripts</h4> <h4 id="loser1624">Loser-1624 scripts</h4>
<p> <p>
In /scripts/noinfo/scripts/loser-caves1624-raw-data/ there is convert.py and split.sh which operate on In /scripts/noinfo/scripts/loser-caves1624-raw-data/ there is convert.py and split.sh which operate on
Uebersicht_2011.svx doing coinversions on a dataset generated from dataset generated from CaveRenderer. Uebersicht_2011.svx doing conversions on a dataset generated from dataset generated from CaveRenderer. The documented workflow today does not appear to need this, but that might be a documentation fault. It might do a key job. <span style="color:red">[to be investigated]</span>
</p> </p>
<h4 id="logbk">logbk.pl</h4>
<p>Obsolete.
<p>This function is now done by the troggle input parsers.
<p>[for historic interest only]
<h4 id="indxl4">make-indxal4.pl</h4>
<p>Obsolete.
<p>See the history document which refers to CAVETAB2.CSV and make-indxal4.pl during the
"script and spreadsheet" phase of the system development from the mid 1990s to the mid 2000s:
<a href="../website-history.html">website history</a>
<hr /> <hr />
Return to: <a href="otherscripts.html">Other scripts</a><br /> Return to: <a href="otherscripts.html">Other scripts</a><br />

View File

@ -1,3 +1,4 @@
[Last Updated 8th Feb. 2016 by Wookey]
OK, executive summary is that theshortlist of things that we ought to be able OK, executive summary is that theshortlist of things that we ought to be able
to feed to Robert is: to feed to Robert is:

View File

@ -1,13 +1,12 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"> <!DOCTYPE html>
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<html> <html>
<head> <head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>2009 Expo Logbook</title></head> <title>2020 Expo Logbook</title></head>
<link rel="stylesheet" type="text/css" href="../../css/main2.css" /> <link rel="stylesheet" type="text/css" href="../../css/main2.css" />
<body id="logbk"> <body id="logbk">
<h1>Expo 2009</h1> <h1>Expo 2020</h1>
<!--fragment for each trip--> <!--fragment for each trip-->
@ -15,18 +14,22 @@
<hr /> <hr />
<div class="tripdate" id="tyyyy-mm-dd">yyyy-mm-dd</div> <div class="tripdate" id="tyyyy-mm-dd">yyyy-mm-dd</div>
<div class="trippeople">people on the trip</div> <div class="trippeople">people on the trip</div>
<div class="triptitle">title of trip </div> <div class="triptitle">cave or area - title of trip </div>
<p>text here</p>
<p>Note that " - " delimits the "cave" (which could be "basecamp", or "plateau")
from the rest of the title. The "cave" is parsed by the troggle logbook importer.</p>
<p>text here</p> <p>text here</p>
<div class="timeug">T/U 6hrs</div> <div class="timeug">T/U 6hrs</div>
</div> </div>
<!--end of fragment--> <!--end of fragment-->
<div id="menu">
<ul id="links"> <ul id="links">
<li><a href="index.html">Back to 2009 Index</a></li> <li><a href="index.html">Back to 2020 Index</a></li>
<li><a href="../../pubs.htm">Index</a> to all publications</li> <li><a href="../../pubs.htm">Index</a> to all publications</li>
<li><a href="../../index.htm">Back to Expeditions intro page</a></li> <li><a href="../../index.htm">Back to Expeditions intro page</a></li>
<li><a href="../../../index.htm">CUCC Expo Home Page</a></li> <li><a href="../../../index.htm">CUCC Expo Home Page</a></li>
</ul> </ul>
</div>
</body> </body>
</html> </html>