Philip Sargent
092c8bb913
stopped storing survex legs
2020-06-12 14:06:03 +01:00
Philip Sargent
d807e3de7d
Object storage as alternative to SQL
2020-06-08 21:33:32 +01:00
Philip Sargent
9237a6262e
Make import robust against duplicate kataster numbers
2020-06-07 17:49:58 +01:00
Philip Sargent
fda50ed570
attempt to simplify wnt horribly wrong
2020-06-06 22:51:55 +01:00
Philip Sargent
90dc3dac3b
Change troggle horizontal menu items
2020-06-01 17:41:41 +01:00
Philip Sargent
8c4c2ad1cf
Progress dots on importing data
2020-06-01 00:42:48 +01:00
Philip Sargent
5d89cf9474
Delete SURVEYS.CSV code
2020-05-31 21:03:40 +01:00
Philip Sargent
69d2c0887c
Adding progress dots to import print output and fix SURVEY_SCANS
2020-05-31 19:23:07 +01:00
Philip Sargent
8e577022b2
Reducing input print output
2020-05-31 19:21:54 +01:00
Philip Sargent
3264b6edef
bug fix in logbook parser
2020-05-30 20:31:20 +01:00
Philip Sargent
01e098339e
Imposrt mad more specific
2020-05-30 12:35:15 +01:00
Philip Sargent
d857cc9084
format tidy & normalise paths in survex *inlcude
2020-05-30 02:35:05 +01:00
Philip Sargent
6a755598b2
Moved classes to models_caves and fixed imports
2020-05-28 04:54:53 +01:00
Philip Sargent
df3917a677
Expunge cavetab
2020-05-28 02:20:50 +01:00
Philip Sargent
cb4128436c
expung imagekit and clean import lists
2020-05-28 01:38:35 +01:00
Philip Sargent
6cc578435c
Refactor to avoid loading unused surveystations
2020-05-28 01:16:45 +01:00
Philip Sargent
c9657aeb8c
preparing to clean up LoadPos
2020-05-26 16:41:11 +01:00
Philip Sargent
50d753a87b
Convert codebase for python3 usage
2020-05-24 20:56:27 +01:00
Philip Sargent
b69bdcd126
tidying and prep for python3
2020-05-24 13:35:47 +01:00
Philip Sargent
40ad04b79f
unused code commented out
2020-05-24 13:30:39 +01:00
Philip Sargent
15d0d05185
bugfix
2020-05-20 13:40:09 +01:00
Philip Sargent
e017c6effc
Indented msgs for recursive file traversal
2020-05-15 21:45:23 +01:00
Philip Sargent
d4ac28af18
Remove PHOTOS_ROOT and DPhoto class
2020-05-15 21:32:55 +01:00
Philip Sargent
931aa4e3cb
add mysql startup documentation
2020-05-14 19:37:46 +01:00
Philip Sargent
ccc5813b3f
indent recursion and update comments
2020-05-14 17:21:34 +01:00
Philip Sargent
e4290c4ab0
adding *ref to troggle svx parser
2020-05-13 19:57:07 +01:00
Philip Sargent
39c622d5bf
dbReset now loads into memory first (fast err checking), then into db
2020-04-30 23:15:57 +01:00
Philip Sargent
ecf92e2079
getting the LoadPos to work better
2020-04-28 21:50:53 +01:00
Philip Sargent
b4c0c4d219
Understanding and speeding up LoadPos
2020-04-28 18:26:08 +01:00
Philip Sargent
4be8c81291
reducing clutter in output
2020-04-28 01:18:57 +01:00
Philip Sargent
a8460065a4
Thorough spring clean and profiling
2020-04-27 23:51:41 +01:00
b123f6ada7
Dumps loaded data into a .sql file
2020-04-16 20:36:42 +01:00
e5c288c764
get the profile display working & bug fix
2020-04-15 23:29:59 +01:00
78f8ea2b5b
bug fixed for new logbook
2020-04-13 17:35:58 +01:00
e08b4275a9
2010 is html format not wiki format.
...
Or at least, now it is.
2020-04-12 23:03:00 +01:00
ac9f3cf061
New cacheing for parsed logbooks. All logbooks load in 75 seconds now.
2020-04-12 22:29:30 +01:00
79a31a41f9
Fixed bad import of surveyscans references from tunnel files
2020-04-11 00:36:27 +01:00
d71e31417b
scanned image files importing
2020-04-09 02:40:32 +01:00
53b797fb53
Validation of mugshot or blrub file added
2020-04-01 19:58:31 +01:00
Philip Sargent
b07c888c7a
debug for crashing tunnel import
2020-02-25 14:22:50 +00:00
Sam Wenham
e77aa9fb84
Changes needed to stop the survex parser having to go through the data twice
...
Taken from the Django 1.10 upgrade branch
2020-02-21 15:57:07 +00:00
Philip Sargent
2fc60f9f74
Fixing logbooks with parse errors
2020-02-20 15:26:33 +00:00
Philip Sargent
c5055e7f34
backport order of operations in reset() and change logbook parser to do paragraphs differently
2020-02-20 14:13:38 +00:00
Sam Wenham
a26109cb30
Allow comments against names in logbooks in brackets
...
Convert accent chars in names into simple chars as this is what people enter in the logbook
2019-07-11 12:29:38 +01:00
Sam Wenham
2ebb37552f
Just commit the logbook parser this time (can we move to git now!!!)
2019-06-26 21:21:37 +01:00
Sam Wenham
97426a0ddb
Backed out changeset: 4552f42bdf54
2019-06-26 20:57:24 +01:00
Sam Wenham
8a1be45aac
Remove this stupid hard coded name match
2019-06-26 20:56:08 +01:00
expo on server
02d3cc84d5
Add SURVEX_TOPNAME (top-level survex file) as a setting item in settings.py so it's not hardcoded.
2019-06-26 03:32:18 +01:00
Sam Wenham
b42249890e
Updating caves and entrances is no longer nuclear!
...
Big overhaul of people processing, fullname added to the model
lastname is now names -1 unless you only have one (yes you Wookey)
this allows for Jon Arne Toft and Wookey to live it the same DB
names can now have html chars in them, this should be real unicode but that can
only happen when we go to Python 3!
2019-04-19 22:52:54 +01:00
Sam Wenham
cc313246bb
missed objects
2019-04-18 19:27:23 +01:00
Sam Wenham
bfe018cde6
Clear data issues for logbooks before reloading
2019-04-18 19:26:09 +01:00
Sam Wenham
23df89cf31
Fix CSRF issues in svx form
...
Set date formats
Add DataIssue model and add errors to it to allow us to give people a list of
stuff to fix
2019-04-14 22:45:31 +01:00
Sam Wenham
d1d0c24ed8
Sort people by notability
...
Better errors and tidy
Nicer date formats
2019-04-02 02:04:38 +01:00
Wookey
b3089fafe9
Merge lots of troggle fixes
2019-04-02 00:57:54 +01:00
Wookey
e913a56a6b
folk.csv has moved into 'folk' dir out of 'noinfo'
2019-04-02 00:57:13 +01:00
Sam Wenham
10f1cdb458
Better error messages
2019-03-31 16:44:58 +01:00
Sam Wenham
9df91b221b
Support html and wiki logbook entrys
...
Move nearest_station to nearest_station_name and make nearest_station a foreign
key to SurvexStation
Lots of tidying
2019-03-31 15:39:53 +01:00
Sam Wenham
a4532a29da
Update new management command for DB reset
...
Switch to content_type from mimetype
Make DB reset not nuke so much
Tidy logbook parser
2019-03-30 13:58:38 +00:00
Sam Wenham
b4296f1736
Fix people list
...
Cope with Jimmy McFoo as a name!
Don't set the top expo value in the code whin it is piss easy to calculate
Fix typo from last commit
2019-03-09 18:21:10 +00:00
Sam Wenham
1bac650aee
There is no point having two functions do basicaly the same thing so make the
...
load all logbooks call load logbook(expo)
Remove the return message from load logbook as it isn't used
2019-03-09 11:18:44 +00:00
Sam Wenham
9fc80bed35
Make the logbook parser a little more sane
...
Move the parser to expo mapping to settings
Set a default parser
Iterate over the expo years rather than the mapping list!
2019-03-06 23:20:34 +00:00
Sam Wenham
77a6015ad6
Fix the All Survex page to work with 1623 area
2019-02-25 20:13:28 +00:00
Sam Wenham
b4f4db5754
Deal better with the wallet letter number combo of 2019#X01
2019-02-24 18:55:30 +00:00
Sam Wenham
e6fa54d0e5
Fix survey scans
...
Remove the assert for folders in survey wallets, this does mean currently they
will be ignored by troggle.
2019-02-24 16:46:02 +00:00
Sam Wenham
f16b4e3f47
Make the suryeys importer not explode
2019-02-24 14:29:14 +00:00
Sam Wenham
4ad5b68433
Make things more compatiable with newer python
...
Fix the expeditions list
Improvements to make it compatiable with django 1.8
Bump the years to add 2018
Update the .hgignore file to ignore junk
2019-02-24 13:03:34 +00:00
expoonserver
9802f45452
Add missing linefeed on survey-parsing error message
2018-06-18 23:43:20 +01:00
expoonserver
1ad58d6b5d
Make sure that cave parser only reads .html files in cave_data dir (to stop foo~ causing 'duplicate cave' error)
2018-06-18 23:17:05 +01:00
Sam Wenham
798ae591c6
Django 1.7 mostly working. Big refactor so probably bugs
2018-04-15 16:28:13 +01:00
Sam Wenham
7877efba0a
Up to 1.6.11 on stretch. New manage.py. Some tidying
2018-04-15 12:00:59 +01:00
Sam Wenham
c939013b14
Add ref as a valid survex command to prevent errors
2018-04-14 16:13:21 +01:00
expoonserver
6652e3f160
remove code saying we can't do interlaced pngs. It's fine now.
2015-10-02 15:07:03 +01:00
Sam Wenham
7056f9a8b2
Remove balkonhoehle from the QM parser as this will need a lot of effort to get working
2015-06-28 12:28:18 +01:00
expo
03cad0a37f
Survex parser fix to avoid allocation on error (by martin).
2015-06-24 04:09:19 +01:00
DWalker
e84d990366
Add in balkon hoehle QM list
2015-05-25 21:55:54 +01:00
Wookey
fe6750e824
Fix up obvious URLs containing subarea names (smkridge)
2015-04-08 03:40:57 +01:00
Sam Wenham
4560e0da84
Revert all of this the date is needed and is a not null in the db
2015-01-26 21:53:32 +00:00
Sam Wenham
f9c2e0e170
One more try
2015-01-26 21:15:17 +00:00
Sam Wenham
cf413dd03c
Ooops that wasn't right
2015-01-26 21:13:47 +00:00
Sam Wenham
4965678443
Don't assert an error on bad date formats
2015-01-26 21:12:27 +00:00
Sam Wenham
67f94f9436
A little more verbosity
2015-01-19 22:48:50 +00:00
Sam Wenham
1186662960
Add a little verbosity
2015-01-19 22:41:48 +00:00
Sam Wenham
3010961383
Try and ignore files that don't end .html (We really need to change to .xml) eg .html.orig!!
...
Change the index on troggle to move on with the year
2015-01-19 21:28:35 +00:00
Wookey
f4f1b3ca6d
Allow comma in starcommands (*,fix) (comma is default valid *set blank)
2014-07-01 02:26:26 +01:00
Wookey
4a93790c7e
Fix survex parser to allow whitespace between * and command (as survex
...
does).
2014-07-01 02:12:34 +01:00
expoonserver
b1d6e1c3d5
Replace assert on unrecognised commands with print, so that a minor
...
parsing issue doesn't completely kill a parsing update.
Add parsing for requires and alias commands.
2014-06-26 02:34:19 +01:00
wookey
3f98470af8
Add a function for running people parser
...
And comments on how logbooks can't be read in until 'year' exists in database
2013-06-25 15:59:19 +01:00
Wookey
3057d2a232
Add checking for compass too
...
Only print filenames on error by default
2013-05-22 02:33:47 +01:00
Wookey
d1ac659d4f
Add error check in place where parser died
2013-05-22 02:10:58 +01:00
wookey
bb1989d0f0
Add some exception checking to parsers/caves.py so that missing entrance
...
slugs don't blow up the import. Also reduce the noise, so
you just get a warning about missing slugs printed out
2012-09-24 23:23:38 +01:00
wookey
418e5e1d3f
Add debug for which entrance file was being read so we get a clue where to look when 'databasereset newcaves' falls over
2012-09-24 22:38:35 +01:00
Wookey
3b12e6d975
Add some debug to cave parser as it's easy to make it fail
...
e.g. by referring to slugs that don't exist.
2012-09-24 22:29:18 +01:00
Martin
1a0e577606
Bug fixing of cave and entrance forms removal of slugs
2012-08-14 22:51:15 +02:00
Martin Green
79b7d32664
Made a prospecting guide and fixed survex station description. Removed parsing of underground descriptions to wikis.
2012-08-10 19:02:13 +02:00
expo
dd66ad835a
Fixed directory names for the survey scans such that surveys could be found. It did not seem possible to simply change the localsettings.py file to get it to work.
2012-08-08 11:29:15 +02:00
expo
05004aa874
Fix up parser paths so everything is found
2012-08-05 00:26:05 +02:00
Martin Green
c2029df3c9
New parser for new cave format
2012-06-10 16:56:12 +01:00
Martin Green
711fefb0da
Start to change dataformat for caves, along with there editing. Start to change survex reader to cope better with equates/tags.
2012-06-10 14:59:21 +01:00
Wookey
ae693ca4c5
Add 2010 and 2011 logbooks to parsing list (can we make this auto
...
somehow - by agreeing a logbook format, or letting it guess)?
2011-09-15 12:12:18 +01:00
Wookey
c23fcc5b06
rest of martin's changes, without reverting lineend issues
2011-07-11 23:28:23 +01:00
