rattail/rattail
2
0
Fork 0
Code Issues 7 Pull requests Projects Releases Packages Wiki Activity Actions
2622 commits 4 branches 857 tags 5.3 MiB
Commit graph

2622 commits

This branch
This branch
All branches
Author SHA1 Message Date
Lance Edgar
d4707a80cc Add WorkedShift data model to schema, importer 2016-04-25 19:37:59 -05:00
Lance Edgar
176fb8e4c1 Update changelog 2016-04-24 17:29:44 -05:00
Lance Edgar
3459876c00 Add invoke_importer() method to datasync import consumers 
Also tweak `process_change()` to allow caller to specify host data.
 2016-04-23 20:11:35 -05:00
Lance Edgar
0099e54bc1 Fix setup bug in bulk Postgres importer 2016-04-23 16:00:13 -05:00
Lance Edgar
cc5840deb4 Add initial begin/rollback/commit abstraction to import handlers 
Hopefully lets each handler define local/host behavior as needed.
 2016-04-22 18:35:02 -05:00
Lance Edgar
8adc8caf4e Alter make_utc() function to allow returning zone-aware time 2016-04-22 17:20:27 -05:00
Lance Edgar
82c3e173bb Add data kwarg to Importer.cache_instance_data() method 
This was needed for a POS transaction importer, so it could auto-filter
local data based on date range which was derived from host data.
 2016-04-21 22:39:55 -05:00
Lance Edgar
5c28719f8b Provide method by which importers may prevent create/update/delete 
One needn't pass flags on command line to invoke default behavior.
 2016-04-21 22:38:49 -05:00
Lance Edgar
295f2d53c4 Add multi-batch change transaction support for datasync consumers 
Otherwise it was possible for the rattail transaction to fall out of
sync from consumer, if it was committing more often than us.
 2016-04-21 19:26:28 -05:00
Lance Edgar
d7cb42a98b Add RattailConfig.production() method 
Convenience to differentiate when running in production mode.
 2016-04-21 17:51:39 -05:00
Lance Edgar
5db81bfe79 Add --start-date and --end-date args to importer command 
Also stash the args in the importer, so extra args are always available.
 2016-04-21 17:36:47 -05:00
Lance Edgar
a3c4921270 Add base importer and handler for PostgreSQL "bulk copy" importing 2016-04-21 13:41:43 -05:00
Lance Edgar
739629eab9 Add model_mapper and model_table attributes to base importer class 2016-04-21 13:41:37 -05:00
Lance Edgar
2cfa543e05 Add Consumer.setup() method for datasync 2016-04-21 13:33:22 -05:00
Lance Edgar
01357e7164 Stop assuming handler will return changes from import 2016-04-21 13:33:01 -05:00
Lance Edgar
3564178d8d Add config.parse_bool() function 
For those generic needs...
 2016-04-21 13:32:17 -05:00
Lance Edgar
9ff8f9ca11 Skip data sync for "empty" host record, in importer-based consumers 
I.e. if the importer normalizes the host record to `None`, there is no
need to sync to the local system.
 2016-04-18 09:52:59 -05:00
Lance Edgar
9d72f723e8 Add Watcher.setup() method for datasync 2016-04-18 09:49:15 -05:00
Lance Edgar
9c487a7a33 Add add_mail_alias() fabric function 2016-04-14 17:19:34 -05:00
Lance Edgar
5b0dfd2ee8 Update changelog 2016-04-12 14:27:24 -05:00
Lance Edgar
1ef8f1ec7c Fix bug where usedb flag wasn't being set from make_config() 
Whatever was in the config file would override what was passed in.
 2016-04-07 00:11:48 -05:00
Lance Edgar
c4be67d6bf Update changelog 2016-04-06 11:45:44 -05:00
Lance Edgar
c0a302b112 Fix bug in ProductCode importer when new records are created 
Seems like this still could be better somehow...
 2016-04-06 11:41:59 -05:00
Lance Edgar
b6b41fcb9d Update changelog 2016-04-05 22:16:24 -05:00
Lance Edgar
4c602dc87e Fix config bug for recording changes in rattail db 
Was turning ON the flag if the setting name was present at all.  Now we
interpret the setting value as a boolean instead.
 2016-04-05 21:04:18 -05:00
Lance Edgar
8c662831bf Update changelog 2016-04-05 13:12:56 -05:00
Lance Edgar
fa745e1a29 Fix rattail importer bugs, when updating local instance 
Must track the instance returned by that method now.
 2016-04-05 11:12:17 -05:00
Lance Edgar
374756dfa2 Add Importer.get_single_instance() for easier customization 
That way `get_instance()` can keep checking the cache, then fallback to
this new method.
 2016-03-24 21:37:08 -05:00
Lance Edgar
84ef87d183 Add deletion support to importer-based datasync 2016-03-23 23:59:10 -05:00
Lance Edgar
50c3c3c27f Add handler convenience when defining importers for datasync consumer 2016-03-23 23:59:10 -05:00
Lance Edgar
b2581bcf00 Skip change if host instance not found, in importer-based datasync 2016-03-23 23:59:10 -05:00
Lance Edgar
a8386400bb Add mechanism to record changes only for sessions on certain engines 
Finally!
 2016-03-23 23:59:10 -05:00
Lance Edgar
80f7caf3a5 Remove some unwanted logging noise 2016-03-23 23:59:07 -05:00
Lance Edgar
41d4c20348 Tweak unicode rendering of User objects 2016-03-23 23:52:09 -05:00
Lance Edgar
f184f7f30f Add host session to main transaction, when importing from SQLAlchemy 
Not really the same transaction, but you get the idea.
 2016-03-23 23:50:58 -05:00
Lance Edgar
80ceb09b60 Fix bug in User model importer 2016-03-23 23:49:45 -05:00
Lance Edgar
db4708962a Tweak logging when recording a data change 2016-03-22 17:54:02 -05:00
Lance Edgar
509014826f Make a copy of the RecordRenderer class for new importer framework 
I'm still not so sure about this whole 'record renderer' concept, but
for now at least wanted to stop relying on the old 'importing' package.
Still have one place left, the 'import-csv' command...
 2016-03-21 15:21:12 -05:00
Lance Edgar
f7fa9a812b Add new importer-based datasync consumer class 
Yay, I'm really hoping this simplifies things going forward.  Ideally
one should only have to define the real data mapping logic once, in the
importer.  The datasync consumer should then lean on that "entirely".
 2016-03-21 15:15:50 -05:00
Lance Edgar
d734f658e2 Improve the core importer class to better allow non-SQLAlchemy targets 
I.e. stop forcing the 'local' data update process to use the Rattail
session, etc.  This commit also improves the default progress message.
 2016-03-21 15:14:39 -05:00
Lance Edgar
281f33990f Tweak import warnings email template 
Improve some styles, and embed the actual host and local title strings
in the summary paragraph.
 2016-03-21 15:12:10 -05:00
Lance Edgar
951615ebcf Tweak some logging when basic changes are recorded 
Hoping this makes the logs prettier to look at etc.
 2016-03-21 15:11:05 -05:00
Lance Edgar
8f2f96fbd1 Tweak some logging when an import command begins 2016-03-21 15:09:36 -05:00
Lance Edgar
f63f6f5e2e Add 'humanize' to dependency list 2016-03-19 18:59:04 -05:00
Lance Edgar
afd56d074e Tweak importer logging and warning email template, to add more info 2016-03-19 18:20:14 -05:00
Lance Edgar
5970f06684 Tweak some column header labels on the import warning email diff tables 2016-03-19 12:12:43 -05:00
Lance Edgar
1ac97fb3b8 Update changelog. 2016-03-11 17:22:34 -06:00
Lance Edgar
1b84b90f7e Tweak default import warning email template, ever so slightly. 2016-03-11 17:21:26 -06:00
Lance Edgar
5d3b002ebf Fix cmp(GPC) behavior when other is None etc. 2016-03-11 15:05:02 -06:00
Lance Edgar
e8774280d7 Update changelog. 2016-02-27 18:53:45 -06:00