rattail/rattail
2
0
Fork 0
Code Issues 7 Pull requests Actions Packages Projects Releases Wiki Activity
1074 commits 4 branches 853 tags 5.2 MiB
Commit graph

1074 commits

This branch
This branch
All branches
Author SHA1 Message Date
Lance Edgar 9db47cc5b0 Update changelog 2016-04-25 19:48:01 -05:00
Lance Edgar f528e871b1 Add bulk Rattail importer, plus various tweaks 
Tweaks are mostly for the sake of a `host_session`, if one is involved.
 2016-04-25 19:39:03 -05:00
Lance Edgar d4707a80cc Add WorkedShift data model to schema, importer 2016-04-25 19:37:59 -05:00
Lance Edgar 176fb8e4c1 Update changelog 2016-04-24 17:29:44 -05:00
Lance Edgar 3459876c00 Add invoke_importer() method to datasync import consumers 
Also tweak `process_change()` to allow caller to specify host data.
 2016-04-23 20:11:35 -05:00
Lance Edgar 0099e54bc1 Fix setup bug in bulk Postgres importer 2016-04-23 16:00:13 -05:00
Lance Edgar cc5840deb4 Add initial begin/rollback/commit abstraction to import handlers 
Hopefully lets each handler define local/host behavior as needed.
 2016-04-22 18:35:02 -05:00
Lance Edgar 8adc8caf4e Alter make_utc() function to allow returning zone-aware time 2016-04-22 17:20:27 -05:00
Lance Edgar 82c3e173bb Add data kwarg to Importer.cache_instance_data() method 
This was needed for a POS transaction importer, so it could auto-filter
local data based on date range which was derived from host data.
 2016-04-21 22:39:55 -05:00
Lance Edgar 5c28719f8b Provide method by which importers may prevent create/update/delete 
One needn't pass flags on command line to invoke default behavior.
 2016-04-21 22:38:49 -05:00
Lance Edgar 295f2d53c4 Add multi-batch change transaction support for datasync consumers 
Otherwise it was possible for the rattail transaction to fall out of
sync from consumer, if it was committing more often than us.
 2016-04-21 19:26:28 -05:00
Lance Edgar d7cb42a98b Add RattailConfig.production() method 
Convenience to differentiate when running in production mode.
 2016-04-21 17:51:39 -05:00
Lance Edgar 5db81bfe79 Add --start-date and --end-date args to importer command 
Also stash the args in the importer, so extra args are always available.
 2016-04-21 17:36:47 -05:00
Lance Edgar a3c4921270 Add base importer and handler for PostgreSQL "bulk copy" importing 2016-04-21 13:41:43 -05:00
Lance Edgar 739629eab9 Add model_mapper and model_table attributes to base importer class 2016-04-21 13:41:37 -05:00
Lance Edgar 2cfa543e05 Add Consumer.setup() method for datasync 2016-04-21 13:33:22 -05:00
Lance Edgar 01357e7164 Stop assuming handler will return changes from import 2016-04-21 13:33:01 -05:00
Lance Edgar 3564178d8d Add config.parse_bool() function 
For those generic needs...
 2016-04-21 13:32:17 -05:00
Lance Edgar 9ff8f9ca11 Skip data sync for "empty" host record, in importer-based consumers 
I.e. if the importer normalizes the host record to `None`, there is no
need to sync to the local system.
 2016-04-18 09:52:59 -05:00
Lance Edgar 9d72f723e8 Add Watcher.setup() method for datasync 2016-04-18 09:49:15 -05:00
Lance Edgar 9c487a7a33 Add add_mail_alias() fabric function 2016-04-14 17:19:34 -05:00
Lance Edgar 5b0dfd2ee8 Update changelog 2016-04-12 14:27:24 -05:00
Lance Edgar 1ef8f1ec7c Fix bug where usedb flag wasn't being set from make_config() 
Whatever was in the config file would override what was passed in.
 2016-04-07 00:11:48 -05:00
Lance Edgar c4be67d6bf Update changelog 2016-04-06 11:45:44 -05:00
Lance Edgar c0a302b112 Fix bug in ProductCode importer when new records are created 
Seems like this still could be better somehow...
 2016-04-06 11:41:59 -05:00
Lance Edgar b6b41fcb9d Update changelog 2016-04-05 22:16:24 -05:00
Lance Edgar 4c602dc87e Fix config bug for recording changes in rattail db 
Was turning ON the flag if the setting name was present at all.  Now we
interpret the setting value as a boolean instead.
 2016-04-05 21:04:18 -05:00
Lance Edgar 8c662831bf Update changelog 2016-04-05 13:12:56 -05:00
Lance Edgar fa745e1a29 Fix rattail importer bugs, when updating local instance 
Must track the instance returned by that method now.
 2016-04-05 11:12:17 -05:00
Lance Edgar 374756dfa2 Add Importer.get_single_instance() for easier customization 
That way `get_instance()` can keep checking the cache, then fallback to
this new method.
 2016-03-24 21:37:08 -05:00
Lance Edgar 84ef87d183 Add deletion support to importer-based datasync 2016-03-23 23:59:10 -05:00
Lance Edgar 50c3c3c27f Add handler convenience when defining importers for datasync consumer 2016-03-23 23:59:10 -05:00
Lance Edgar b2581bcf00 Skip change if host instance not found, in importer-based datasync 2016-03-23 23:59:10 -05:00
Lance Edgar a8386400bb Add mechanism to record changes only for sessions on certain engines 
Finally!
 2016-03-23 23:59:10 -05:00
Lance Edgar 80f7caf3a5 Remove some unwanted logging noise 2016-03-23 23:59:07 -05:00
Lance Edgar 41d4c20348 Tweak unicode rendering of User objects 2016-03-23 23:52:09 -05:00
Lance Edgar f184f7f30f Add host session to main transaction, when importing from SQLAlchemy 
Not really the same transaction, but you get the idea.
 2016-03-23 23:50:58 -05:00
Lance Edgar 80ceb09b60 Fix bug in User model importer 2016-03-23 23:49:45 -05:00
Lance Edgar db4708962a Tweak logging when recording a data change 2016-03-22 17:54:02 -05:00
Lance Edgar 509014826f Make a copy of the RecordRenderer class for new importer framework 
I'm still not so sure about this whole 'record renderer' concept, but
for now at least wanted to stop relying on the old 'importing' package.
Still have one place left, the 'import-csv' command...
 2016-03-21 15:21:12 -05:00
Lance Edgar f7fa9a812b Add new importer-based datasync consumer class 
Yay, I'm really hoping this simplifies things going forward.  Ideally
one should only have to define the real data mapping logic once, in the
importer.  The datasync consumer should then lean on that "entirely".
 2016-03-21 15:15:50 -05:00
Lance Edgar d734f658e2 Improve the core importer class to better allow non-SQLAlchemy targets 
I.e. stop forcing the 'local' data update process to use the Rattail
session, etc.  This commit also improves the default progress message.
 2016-03-21 15:14:39 -05:00
Lance Edgar 281f33990f Tweak import warnings email template 
Improve some styles, and embed the actual host and local title strings
in the summary paragraph.
 2016-03-21 15:12:10 -05:00
Lance Edgar 951615ebcf Tweak some logging when basic changes are recorded 
Hoping this makes the logs prettier to look at etc.
 2016-03-21 15:11:05 -05:00
Lance Edgar 8f2f96fbd1 Tweak some logging when an import command begins 2016-03-21 15:09:36 -05:00
Lance Edgar f63f6f5e2e Add 'humanize' to dependency list 2016-03-19 18:59:04 -05:00
Lance Edgar afd56d074e Tweak importer logging and warning email template, to add more info 2016-03-19 18:20:14 -05:00
Lance Edgar 5970f06684 Tweak some column header labels on the import warning email diff tables 2016-03-19 12:12:43 -05:00
Lance Edgar 1ac97fb3b8 Update changelog. 2016-03-11 17:22:34 -06:00
Lance Edgar 1b84b90f7e Tweak default import warning email template, ever so slightly. 2016-03-11 17:21:26 -06:00