Commit Graph

630 Commits

Author SHA1 Message Date
e01bd39609 refactored logbooks parser 2023-01-27 23:21:07 +00:00
6565b3f9c4 refactored, faster deletion prior to loading 2023-01-27 17:41:10 +00:00
2fee216e80 Remove logdataissues from TROG 2023-01-27 17:24:31 +00:00
a321625f35 fix number of entries expected 2023-01-26 21:52:56 +00:00
0c4ce6dc3c deleted old parser code 2023-01-26 21:33:17 +00:00
733765802e reformatted all old logbook formats 2023-01-26 21:33:06 +00:00
1be3a3892c ruff removed unused imports 2023-01-19 21:34:09 +00:00
ba2ae6cd82 reformatted using black 2023-01-19 21:18:42 +00:00
939d3970aa sort imports using isort. tested. 2023-01-19 18:33:04 +00:00
1b70ccea3e consistent tests with logbooks junk removal 2023-01-16 19:52:05 +00:00
822965ebe5 remove %s old formatting style (last bits) 2023-01-02 22:26:33 +00:00
5bbb363f12 Adding docstrings, deleting unused code 2022-12-23 23:32:59 +00:00
194470841e logbooks correct numberss of entries expected 2022-12-23 22:13:43 +00:00
a72c2bd96a Using Path() wherever possible in localsettings.py 2022-12-22 16:04:16 +00:00
f23764c486 diagnosing missing entrance file 2022-12-22 00:56:46 +00:00
ec040824f6 fix frontmatter/endmatter 2022-12-21 02:05:26 +00:00
517da57a0c All broken logbooks now parsing correctly. 2022-12-20 23:48:56 +00:00
5ee3ebad3e converting 1988 logboog 2022-12-20 21:53:56 +00:00
05df2e084c converting 1987 logbook 2022-12-20 19:59:36 +00:00
dc3a61addd convert old logbooks to modern format 2022-12-20 16:38:32 +00:00
9169abdb05 2019 blog edits 2022-12-20 15:18:07 +00:00
f24f283a07 attempted speedup, explicit dates wallet objects 2022-12-20 00:07:55 +00:00
bb14c94ab1 Updates to make 2018 blog merge work (faster) 2022-12-19 20:13:26 +00:00
7e9bb73777 Vital fix to stop parsing terminating too early 2022-12-19 11:38:34 +00:00
43a98b4421 Not quite getting all the blog post contents 2022-12-19 00:33:32 +00:00
f1d5df9933 fix author display for logbook entry 2022-12-18 21:20:30 +00:00
8ce86aabee strip spaces from titles 2022-12-18 20:36:11 +00:00
d1b94763b4 Fixing wiki-parsing for 2009 logbook 2022-12-18 19:33:56 +00:00
73b710d53f fix more logbook parsing 2022-12-17 17:05:55 +00:00
0a4471e039 Fixed round-trip import-export-import bugs 2022-12-17 03:02:08 +00:00
f80e4efed8 parse several UK caving blogs per year - working 2022-12-16 19:57:56 +00:00
5e9fd7fd77 bug in python 3.9? 2022-12-15 01:06:54 +00:00
5cc6c26606 blog parsing working 2022-12-15 00:35:48 +00:00
cb50528e2d exptl parse UK Caving blog 2022-12-14 23:46:14 +00:00
0e47909704 tidy and comments 2022-12-10 13:00:57 +00:00
cabcada0b8 2003 logbook export/re-import as now HTML format 2022-12-09 23:45:07 +00:00
17b2b7b89c fix comments and 2019 LB parsing 2022-12-07 18:22:09 +00:00
1eab261b30 fix bugs made visible by py 3.11 2022-11-23 21:59:42 +00:00
Philip Sargent
45a640dfe9 Convert .format() to f-strings 2022-11-23 10:41:14 +00:00
Philip Sargent
ca9a3b5c7b tidy up 2022-11-23 10:36:02 +00:00
Philip Sargent
0b32d51ba3 bugfix 2022-11-23 00:49:47 +00:00
Philip Sargent
1a9e17a7e8 remove entry-type and tidy cache bits 2022-11-23 00:36:44 +00:00
Philip Sargent
259f85742a moved parser settings 2022-11-21 16:47:25 +00:00
Philip Sargent
a795707552 cache tidy and move settings into parser 2022-11-21 16:41:52 +00:00
Philip Sargent
bcb61f9cd9 remove cache and setdatesfromlogbook 2022-11-21 16:26:30 +00:00
Philip Sargent
4260b0f092 Removed misguided ObjStore as we do need multiuser db 2022-11-21 00:04:33 +00:00
Philip Sargent
4514eda311 make compatible with python 3.11 as well as 3.10 2022-11-18 20:42:03 +00:00
Philip Sargent
725c5ad0cd Updating comments 2022-11-17 01:24:39 +00:00
Philip Sargent
0b89979418 bug found by python 3.11 2022-11-15 23:56:35 +00:00
Philip Sargent
43bf2620f1 dump3d --legs future possibility 2022-11-15 22:25:39 +00:00
Philip Sargent
e0ac09d5ec add 'lastvisit' field to entrances, for the date 2022-10-12 23:12:55 +03:00
Philip Sargent
45f06293f5 Add 'foreign friends' to names alias list 2022-10-12 23:10:48 +03:00
Philip Sargent
ff8eaa241e *team parsing much improved. Copes with everything now. 2022-10-10 15:40:21 +03:00
Philip Sargent
52a035e4cf more fixes 2022-10-10 01:08:37 +03:00
Philip Sargent
8c8b6966a7 sort output, accept more comma use 2022-10-10 00:28:57 +03:00
Philip Sargent
861980a8e9 More fixes to name resolution checking 2022-10-09 23:50:32 +03:00
Philip Sargent
3c31c333f2 Widen the recognizer capabilities for names 2022-10-09 02:32:34 +03:00
Philip Sargent
e6ca20b1ed new report to make aliases visible 2022-10-09 00:17:53 +03:00
Philip Sargent
e9790e70d6 abbrv. names now accepted when parsing logbooks, survex 2022-10-08 01:52:10 +03:00
Philip Sargent
55bc042798 bugfixes 2022-10-08 00:48:21 +03:00
Philip Sargent
4e9680a3ad big changes to cope with survexblock not yet dated, no *date yet 2022-10-07 23:48:41 +03:00
Philip Sargent
f51d1e114e small chnages to name resolution 2022-10-07 23:47:05 +03:00
Philip Sargent
c76cd38d76 use generator when reading individual survex files too, saves anothe 6MB 2022-10-07 11:41:46 +03:00
Philip Sargent
b4c4f2aefc reduce mem use by 21.2MB by using a generator 2022-10-07 10:57:30 +03:00
Philip Sargent
70709c505c Fixing bugs and better error msgs 2022-10-06 21:02:15 +03:00
Philip Sargent
8d08a67302 strip spaces in pending caves list 2022-10-06 12:51:43 +03:00
Philip Sargent
29c5c82337 polishing outputs for importing unseen survex files 2022-10-05 23:18:11 +03:00
Philip Sargent
7e47fe1f30 Parse all files, not just those in the *include tree 2022-10-05 21:11:18 +03:00
Philip Sargent
9e5bdace2c make cache work even if timestamps wrong 2022-10-05 21:10:05 +03:00
Philip Sargent
a6e60c0bf7 working on loading all the non*inlcuded svx files 2022-10-04 00:00:55 +03:00
Philip Sargent
c8163ab0cd fix bug for wallet with empty fpath 2022-10-03 21:18:35 +03:00
Philip Sargent
b60e1f2493 rename data issue tag 2022-09-27 21:37:45 +03:00
Philip Sargent
78a62a1551 error msg was incorrect. fix. 2022-09-26 00:18:41 +03:00
Philip Sargent
2f64e2d4c1 FIx pending caves which had got a bit garbled 2022-09-25 21:43:00 +03:00
Philip Sargent
f3ecdd6d87 Cleaner monitoring output when importing wallets and scans 2022-09-24 00:17:51 +03:00
Philip Sargent
6e3fdd35c1 Replaced maintenance headache with cleaner folder walking 2022-09-23 23:43:34 +03:00
Philip Sargent
97b0ce8c96 removing technical debt, replace convoluted code 2022-09-23 00:49:40 +03:00
Philip Sargent
aa20692ad6 bugfixes and enabling older wallets to be found and listed 2022-09-22 22:41:42 +03:00
Philip Sargent
11b1d41a55 increase entires to 64 2022-09-22 00:22:09 +03:00
Philip Sargent
36995ec051 handling survex files not linked in completely 2022-09-20 02:36:40 +03:00
Philip Sargent
61f9863a06 bug fixes and coping with a list of cave ids in JSON 2022-09-20 01:02:06 +03:00
Philip Sargent
0611c3f00f documn improvements 2022-09-19 21:54:51 +03:00
Philip Sargent
2648bada30 remove URL field from wallet as seen and edited 2022-09-19 20:55:34 +03:00
Philip Sargent
d2c6c4d7fb find perps guilty of bad *ref brhaviour 2022-09-18 23:53:04 +03:00
Philip Sargent
68865a80ef Fixing bad date parsing, better warning msgs 2022-09-16 22:54:22 +03:00
Philip Sargent
f12d0bd580 Remove unneeded code now svx files have been edited 2022-09-15 22:55:16 +03:00
Philip Sargent
0853bbdd19 Many fixes and speedups 2022-08-30 17:58:49 +03:00
Philip Sargent
6daa96b69e correcting output comment 2022-08-30 17:30:46 +03:00
Philip Sargent
ab184bccf3 comment updates 2022-08-25 16:31:38 +03:00
Philip Sargent
79672dd4b3 bugfix 2022-08-25 16:12:13 +03:00
Philip Sargent
760abe1a9e cope with swapped people/title 2022-08-25 15:54:00 +03:00
Philip Sargent
7e9fd0f353 Better display of wallet names copied from svx files 2022-08-24 18:28:15 +03:00
Philip Sargent
96b2c6c9ed fix url for cave edit page in error msg 2022-08-24 14:15:40 +03:00
Philip Sargent
41c68aef26 detecting empty wallets where we only have JSON and no files 2022-08-16 20:02:28 +03:00
Philip Sargent
aaba4fd2a9 minor refactoring 2022-08-16 17:42:37 +03:00
Philip Sargent
3c13f62bd1 re-fettled scan upload, creates Wallet object earlier 2022-08-14 23:40:56 +03:00
Philip Sargent
284e044a03 Fix wallets scan upload faults 2022-08-14 22:52:14 +03:00
Philip Sargent
b093d00ff4 match therion files to wallets, scans names therein 2022-08-14 01:47:53 +03:00
Philip Sargent
8e93680146 personrole is not just about roles 2022-08-13 23:57:57 +03:00
Philip Sargent
edfba8d355 git commit edits to wallet data 2022-08-13 23:56:56 +03:00
Philip Sargent
25c425cff8 QMs grayed out for survex files 2014 and earlier 2022-08-07 23:41:45 +03:00
Philip Sargent
f33c6cc057 bugfix in new wallet 2022-08-06 22:23:39 +03:00
Philip Sargent
0fd3cf43e8 formatting 2022-08-01 17:32:49 +03:00
Philip Sargent
bc3da1182b starting jsn population when we know the data 2022-07-29 17:49:07 +03:00
Philip Sargent
7872e98cb2 fixing pending caves system to be cleaner 2022-07-28 18:36:57 +03:00
Philip Sargent
c29e240c2b creating new wallet now copies nd commits 2022-07-28 18:36:40 +03:00
Philip Sargent
93622b111f obscure bug fixed for lines ;*include 2022-07-28 15:15:11 +03:00
Philip Sargent
fea69c0371 Extend wallets by cave report 2022-07-28 01:48:22 +03:00
Philip Sargent
dd0fcc28dd update todo strings 2022-07-27 23:24:53 +03:00
Philip Sargent
3d7cb78e47 copies all wallet data to drawings repo as backup 2022-07-27 23:24:53 +03:00
Philip Sargent
039792e320 improve reifying process 2022-07-25 15:03:58 +03:00
Philip Sargent
cddcb0e321 fix minor bug in setting dummy entrance 2022-07-25 11:31:43 +03:00
Philip Sargent
476ee482fa Pending caves with 1626 properly 2022-07-25 02:57:00 +03:00
Philip Sargent
5007393536 better error handling 2022-07-23 20:05:58 +03:00
Philip Sargent
a1e538e93a making it work with 1626 no schonberg 2022-07-23 19:26:47 +03:00
Philip Sargent
7288bd9da3 add comment on point where it crashes 2022-07-22 13:42:04 +03:00
Philip Sargent
31b912f3ca bugfixes 2022-07-22 12:40:42 +03:00
Philip Sargent
38eb65ac0e remove unused code 2022-07-22 11:23:00 +03:00
Philip Sargent
796dbf1438 more dead chicken waving 2022-07-21 21:52:10 +03:00
Philip Sargent
f46942fadf typo again 2022-07-21 21:04:49 +03:00
Philip Sargent
3a52d790f0 typo 2022-07-21 21:03:54 +03:00
Philip Sargent
ce7dfd6510 working on MariaDB crash on server 2022-07-21 21:01:57 +03:00
Philip Sargent
931c33cfdb Clean DataIssues output, new therionrefs.log file 2022-07-21 19:01:04 +03:00
Philip Sargent
d058942084 revert, this was a bad idea 2022-07-20 21:04:59 +03:00
Philip Sargent
0a158db97d Trial QM tick mechanism in survex files 2022-07-20 20:47:29 +03:00
Philip Sargent
a215ebd62c fix QM regex for number and rearrange url code 2022-07-20 17:02:38 +03:00
Philip Sargent
549c1649b4 QMs now have working url to survexfile & tick description 2022-07-20 14:44:56 +03:00
Philip Sargent
2e14be61a2 bugfix 2022-07-19 20:54:46 +03:00
Philip Sargent
d9d75b3aee another attempt to avoid non-null parent pseudo error 2022-07-19 20:00:35 +03:00
Philip Sargent
1395ac76e9 Attempt fix to MariaDB crash in databasereset 2022-07-19 19:48:11 +03:00
Philip Sargent
145540caf5 more weirdness in circumventing MariaDB/Django misunderstandings 2022-07-17 16:08:01 +03:00
Philip Sargent
8aab01c126 cleaner zeroth cave setting 2022-07-15 16:44:02 +03:00
Philip Sargent
73e9ae54fa cleaner survexdirectory creation 2022-07-15 16:17:40 +03:00
Philip Sargent
b8355cbf8d fix bugs and tidyup in recent changes 2022-07-15 15:11:49 +03:00
Philip Sargent
86a18c3ebc catch nonUTF8 survex files, DataIssues url editor 2022-07-15 14:09:32 +03:00
Philip Sargent
91c9cf0c31 2019 logbook error fix 2022-07-09 01:55:11 +03:00
Philip Sargent
278a84a485 better error msg 2022-07-09 01:54:48 +03:00
Philip Sargent
8d31ab763d improve date parse eror messages 2022-07-09 01:30:49 +03:00
Philip Sargent
9803ebe2e8 fix bug in Area creation 2022-07-08 22:19:07 +03:00
Philip Sargent
ca5586fc42 Report badly formatted ;QM lines 2022-07-08 20:08:42 +03:00
Philip Sargent
d3572e18c3 QM reports all working 2022-07-06 17:35:08 +03:00
Philip Sargent
7dc3cc3b91 fix for individual QM display from survex 2022-07-06 15:38:53 +03:00
Philip Sargent
da4d7d6d5e shorten slug to fit 2022-07-06 11:10:50 +03:00
Philip Sargent
0ea3ed1ef2 Not quite so broken QMs from survex files 2022-07-05 22:40:58 +03:00
Philip Sargent
2bd617b543 Fixed QM report for survex-imported QMs 2022-07-05 20:24:51 +03:00
Philip Sargent
87fd260051 import diagnostics 2022-07-05 16:30:42 +03:00
Philip Sargent
5d7d2b82b2 Fixing non-null error, even though it should be allowed 2022-07-05 15:57:49 +03:00
Philip Sargent
779afc2f2a QM report pages now not crashing, working.. 2022-07-05 15:38:23 +03:00
Philip Sargent
b5f2d0641d Provide dummy expedition_id to keep MariaDB happy 2022-06-22 23:08:32 +03:00
Philip Sargent
3813b21dcf regularising _URL and _ROOT idiom 2022-04-18 22:48:49 +03:00