Commit graph

3860 commits

Author SHA1 Message Date
Lance Edgar 739629eab9 Add model_mapper and model_table attributes to base importer class 2016-04-21 13:41:37 -05:00
Lance Edgar 2cfa543e05 Add Consumer.setup() method for datasync 2016-04-21 13:33:22 -05:00
Lance Edgar 01357e7164 Stop assuming handler will return changes from import 2016-04-21 13:33:01 -05:00
Lance Edgar 3564178d8d Add config.parse_bool() function
For those generic needs...
2016-04-21 13:32:17 -05:00
Lance Edgar 9ff8f9ca11 Skip data sync for "empty" host record, in importer-based consumers
I.e. if the importer normalizes the host record to `None`, there is no
need to sync to the local system.
2016-04-18 09:52:59 -05:00
Lance Edgar 9d72f723e8 Add Watcher.setup() method for datasync 2016-04-18 09:49:15 -05:00
Lance Edgar 9c487a7a33 Add add_mail_alias() fabric function 2016-04-14 17:19:34 -05:00
Lance Edgar 5b0dfd2ee8 Update changelog 2016-04-12 14:27:24 -05:00
Lance Edgar 1ef8f1ec7c Fix bug where usedb flag wasn't being set from make_config()
Whatever was in the config file would override what was passed in.
2016-04-07 00:11:48 -05:00
Lance Edgar c4be67d6bf Update changelog 2016-04-06 11:45:44 -05:00
Lance Edgar c0a302b112 Fix bug in ProductCode importer when new records are created
Seems like this still could be better somehow...
2016-04-06 11:41:59 -05:00
Lance Edgar b6b41fcb9d Update changelog 2016-04-05 22:16:24 -05:00
Lance Edgar 4c602dc87e Fix config bug for recording changes in rattail db
Was turning ON the flag if the setting name was present at all.  Now we
interpret the setting value as a boolean instead.
2016-04-05 21:04:18 -05:00
Lance Edgar 8c662831bf Update changelog 2016-04-05 13:12:56 -05:00
Lance Edgar fa745e1a29 Fix rattail importer bugs, when updating local instance
Must track the instance returned by that method now.
2016-04-05 11:12:17 -05:00
Lance Edgar 374756dfa2 Add Importer.get_single_instance() for easier customization
That way `get_instance()` can keep checking the cache, then fallback to
this new method.
2016-03-24 21:37:08 -05:00
Lance Edgar 84ef87d183 Add deletion support to importer-based datasync 2016-03-23 23:59:10 -05:00
Lance Edgar 50c3c3c27f Add handler convenience when defining importers for datasync consumer 2016-03-23 23:59:10 -05:00
Lance Edgar b2581bcf00 Skip change if host instance not found, in importer-based datasync 2016-03-23 23:59:10 -05:00
Lance Edgar a8386400bb Add mechanism to record changes only for sessions on certain engines
Finally!
2016-03-23 23:59:10 -05:00
Lance Edgar 80f7caf3a5 Remove some unwanted logging noise 2016-03-23 23:59:07 -05:00
Lance Edgar 41d4c20348 Tweak unicode rendering of User objects 2016-03-23 23:52:09 -05:00
Lance Edgar f184f7f30f Add host session to main transaction, when importing from SQLAlchemy
Not really the same transaction, but you get the idea.
2016-03-23 23:50:58 -05:00
Lance Edgar 80ceb09b60 Fix bug in User model importer 2016-03-23 23:49:45 -05:00
Lance Edgar db4708962a Tweak logging when recording a data change 2016-03-22 17:54:02 -05:00
Lance Edgar 509014826f Make a copy of the RecordRenderer class for new importer framework
I'm still not so sure about this whole 'record renderer' concept, but
for now at least wanted to stop relying on the old 'importing' package.
Still have one place left, the 'import-csv' command...
2016-03-21 15:21:12 -05:00
Lance Edgar f7fa9a812b Add new importer-based datasync consumer class
Yay, I'm really hoping this simplifies things going forward.  Ideally
one should only have to define the real data mapping logic once, in the
importer.  The datasync consumer should then lean on that "entirely".
2016-03-21 15:15:50 -05:00
Lance Edgar d734f658e2 Improve the core importer class to better allow non-SQLAlchemy targets
I.e. stop forcing the 'local' data update process to use the Rattail
session, etc.  This commit also improves the default progress message.
2016-03-21 15:14:39 -05:00
Lance Edgar 281f33990f Tweak import warnings email template
Improve some styles, and embed the actual host and local title strings
in the summary paragraph.
2016-03-21 15:12:10 -05:00
Lance Edgar 951615ebcf Tweak some logging when basic changes are recorded
Hoping this makes the logs prettier to look at etc.
2016-03-21 15:11:05 -05:00
Lance Edgar 8f2f96fbd1 Tweak some logging when an import command begins 2016-03-21 15:09:36 -05:00
Lance Edgar f63f6f5e2e Add 'humanize' to dependency list 2016-03-19 18:59:04 -05:00
Lance Edgar afd56d074e Tweak importer logging and warning email template, to add more info 2016-03-19 18:20:14 -05:00
Lance Edgar 5970f06684 Tweak some column header labels on the import warning email diff tables 2016-03-19 12:12:43 -05:00
Lance Edgar 1ac97fb3b8 Update changelog. 2016-03-11 17:22:34 -06:00
Lance Edgar 1b84b90f7e Tweak default import warning email template, ever so slightly. 2016-03-11 17:21:26 -06:00
Lance Edgar 5d3b002ebf Fix cmp(GPC) behavior when other is None etc. 2016-03-11 15:05:02 -06:00
Lance Edgar e8774280d7 Update changelog. 2016-02-27 18:53:45 -06:00
Lance Edgar 5b163c024f Add initial color-coded diffs to data import warning emails. 2016-02-27 18:51:57 -06:00
Lance Edgar b392d9020b Fix bug with importing of customer first/last name. 2016-02-27 18:51:28 -06:00
Lance Edgar a92511b015 Tweak unicode(Employee) output.
Still need to figure out a "best practices" approach here...
2016-02-27 18:50:36 -06:00
Lance Edgar c010c4c4fe Update changelog. 2016-02-27 14:02:49 -06:00
Lance Edgar cf0308fc3e Add date_argument back to rattail.commands root. 2016-02-27 14:01:51 -06:00
Lance Edgar 26d9e26ac8 Tweak changelog. 2016-02-27 13:08:43 -06:00
Lance Edgar b5d7ba1fe7 Update changelog. 2016-02-27 13:05:54 -06:00
Lance Edgar 6d608f0eaa Tweak logging wording when datasync threads die from error. 2016-02-27 11:43:21 -06:00
Lance Edgar 352d168687 Fix some tests. 2016-02-27 11:05:34 -06:00
Lance Edgar 71dabe761e Add Dump command back to main module..for now. 2016-02-16 11:54:05 -06:00
Lance Edgar 1d80477c42 Add ImportSubcommand back to rattail.commands root. 2016-02-15 12:55:58 -06:00
Lance Edgar db66d25b34 Make 'commands' subpackage, add 'rattail-dev' command.
And add subcommand for 'rattail-dev new-batch'.  Hopefully this is all a
good idea, pretty rough draft at this point.
2016-02-15 00:30:04 -06:00