Commit graph

3270 commits

Author SHA1 Message Date
Lance Edgar
7d369df322 Refactor how we read some config values for datasync
in order to avoid the deprecated `RattailConfig.has_option()` call
2018-12-12 12:25:50 -06:00
Lance Edgar
8c78a2d870 Update changelog 2018-12-11 13:55:27 -06:00
Lance Edgar
3f2f2d8a36 Fix population logic when making batch from file via filemon
i.e. let handler to normal setup/teardown when populating batch
2018-12-11 13:54:26 -06:00
Lance Edgar
67504b4ae2 Update changelog 2018-12-05 12:12:23 -06:00
Lance Edgar
1d8083bc60 Add clue for checking perms, when pruning non-existing filemon folder 2018-12-05 11:25:16 -06:00
Lance Edgar
2db9d8359c Overhaul datasync consumer thread logic a bit
this does two things mainly:

 * loses the concept of "isolated" vs. "common" consumer threads (all threads
   in use thus far were isolated, now that's the only option)

 * consumer no longer processes "all" available changes, "batched up" by the
   'obtained' timestmap.  instead it now will only process that "first batch"
   in a given run.  that lets us use SQL to separate batches more simply, as
   well as ensures smaller processing times between DB commits, which leads to
   better progress transparency from the outside
2018-12-04 23:31:54 -06:00
Lance Edgar
01498a2a50 Add "sync me" flag to LabelProfile model, honor it within importers
meant to allow datasync of LabelProfile records, but only for those records
which have "opted in" to the sync
2018-12-04 18:55:20 -06:00
Lance Edgar
9657949a08 Add way to extend available types, for rattail make-config 2018-12-03 19:48:23 -06:00
Lance Edgar
cd941ae750 Add Object.setdefault() method
for use as 'env' object with fabric2
2018-12-03 00:49:33 -06:00
Lance Edgar
a8e3288026 Update changelog 2018-12-02 15:24:21 -06:00
Lance Edgar
562705d9ee Update sample config and new project template
various things encountered when making a new project
2018-12-01 19:36:43 -06:00
Lance Edgar
42047ffc87 Add old_price_margin column for pricing batch rows 2018-11-30 19:24:06 -06:00
Lance Edgar
750e0129ee Tweak some label batch logic per python3
regarding "batch from CSV file" logic
2018-11-30 18:30:32 -06:00
Lance Edgar
bebfe1b519 Allow override of decimal places when converting hours 2018-11-30 16:59:32 -06:00
Lance Edgar
af340c79f7 Fix "margin threshold" bug in pricing batch logic
also make sure to flush session once every 200 new rows when populating
2018-11-26 18:56:08 -06:00
Lance Edgar
2773663d70 Grow some "margin" columns in pricing batch row table
to account for 1000% margins and the like
2018-11-26 18:55:41 -06:00
Lance Edgar
8aa28cb95b Add basic "min % diff" logic for pricing batches 2018-11-25 20:25:56 -06:00
Lance Edgar
25d32aec03 Bit o' cleanup 2018-11-25 19:40:14 -06:00
Lance Edgar
aa4346d140 Don't log "topo sortkey" definitions for datasync
that's a lot of noise, and basically not useful.  can uncomment this as needed
for local testing
2018-11-24 15:57:11 -06:00
Lance Edgar
4541a6ae7d Add rattail datasync check-watchers subcommand
this lets us better monitor datasync health from Shinken etc.
2018-11-24 15:56:27 -06:00
Lance Edgar
058eb5d2bd Coerce generic import batch row keys to string, for description 2018-11-22 20:22:55 -06:00
Lance Edgar
3a38460383 Tweak source data file attribute for CSV importers 2018-11-22 20:22:36 -06:00
Lance Edgar
3c2ec56557 Add some default magic for importers reading from CSV file 2018-11-22 15:28:02 -06:00
Lance Edgar
aa3daae879 Add some workarounds when importer command has no config
this maybe only happens in a test?
2018-11-21 15:42:53 -06:00
Lance Edgar
f7c4f2c4fd Update changelog 2018-11-19 21:33:59 -06:00
Lance Edgar
6207645f29 Tweak how we assign 'runas' user for commands 2018-11-19 21:27:57 -06:00
Lance Edgar
d3f327e396 Update changelog 2018-11-19 14:12:46 -06:00
Lance Edgar
5b14774fba Add margin_diff, price_diff_percent for pricing batch rows 2018-11-18 21:11:25 -06:00
Lance Edgar
550392d2b8 Add suggested_price to pricing batch row table
and populate it
2018-11-18 20:01:21 -06:00
Lance Edgar
0d855cb8d9 Add Customer.wholesale flag 2018-11-17 19:25:57 -06:00
Lance Edgar
081fe2625a Add rattail purge-batches command 2018-11-17 17:55:44 -06:00
Lance Edgar
fd30035e60 Update changelog 2018-11-14 09:56:58 -06:00
Lance Edgar
a183b2e745 Add "suggested price" hack for old-style rattail -> rattail datasync
this whole thing should go away at some point, since importer-based datasync
should work just fine..?  guess we'll see when we try
2018-11-14 09:54:55 -06:00
Lance Edgar
a286682bf3 Grow column for Role.name to 100 chars 2018-11-13 10:48:00 -06:00
Lance Edgar
97614d941f Update changelog 2018-11-09 17:55:19 -06:00
Lance Edgar
22650566d2 Add index for trainwreck Transaction.receipt_number 2018-11-09 17:54:42 -06:00
Lance Edgar
7a75d2d3cc Update changelog 2018-11-09 08:46:17 -06:00
Lance Edgar
463b6b4486 Add product_suggested_price field for ProductPrice model importer 2018-11-09 08:45:19 -06:00
Lance Edgar
1644a4b840 Update changelog 2018-11-08 15:42:50 -06:00
Lance Edgar
11fefa2170 Add "suggested price" features for Product model, importer 2018-11-08 09:31:33 -06:00
Lance Edgar
fa12dd1fa6 Add setup/teardown to handler, for batch populate
er, make sure we call these methods..
2018-11-07 16:46:16 -06:00
Lance Edgar
61464ce754 Detect non-numeric entry when locating row for purchase batch
i.e. don't try to convert to GPC if non-numeric
2018-11-07 13:08:15 -06:00
Lance Edgar
5909884d7c Update changelog 2018-11-07 10:04:16 -06:00
Lance Edgar
212b4e8355 Add client IP address to user feedback email 2018-11-05 11:23:42 -06:00
Lance Edgar
174fb79bd6 Add "true" unit cost, margin to pricing batch rows
also grow existing margin field slightly, to allow 100.000
2018-11-02 18:58:53 -05:00
Lance Edgar
6834d193a4 Add "current discount" fields for ProductCost model 2018-11-01 21:37:06 -05:00
Lance Edgar
2c9130d281 Update changelog 2018-10-25 21:18:20 -05:00
Lance Edgar
7b9712785e Add simple datasync check command
basic sanity check, to discover when changes hang around too long in the queue
2018-10-25 14:47:37 -05:00
Lance Edgar
b6daf4e853 Update changelog 2018-10-24 19:18:02 -05:00
Lance Edgar
0e167470e3 Add transform_pack_to_unit() method for purchase batch handler
this is really just for truck dump parent receiving batches, for now..?
2018-10-24 18:49:18 -05:00