Commit graph

3860 commits

Author SHA1 Message Date
Lance Edgar f3013b9aca Let make_utc() use current time as default 2016-07-23 15:12:07 -07:00
Lance Edgar 0920a9a760 Move cache_model() method to core Importer class
This can be useful even when not targeting a SQLAlchemy system.
2016-07-14 10:51:59 -05:00
Lance Edgar 5150320bb0 Tweak logging verbiage within datasync wait command 2016-07-14 10:51:42 -05:00
Lance Edgar 2499fb39dc Update changelog 2016-07-08 01:05:59 -05:00
Lance Edgar 982ab90ce3 Tweak CSS to preserve whitespace in import diff email field values 2016-06-24 12:06:38 -05:00
Lance Edgar 8ebb667976 Add Importer.fields_active() convenience method 2016-06-22 19:14:20 -05:00
Lance Edgar e5425274a4 Update changelog 2016-06-17 13:08:50 -05:00
Lance Edgar 88a7cbb377 Force session flush after processing changes in datasync consumer thread
I.e. do so within the try/catch block, in case the flush triggers SQL
integrity errors etc.
2016-06-17 13:06:53 -05:00
Lance Edgar 48ae998b99 Add some convenience attributes to GPC class
More to come I'm sure...
2016-06-17 11:13:31 -05:00
Lance Edgar f8ced153f4 Tweak logging message when datasync wait times out 2016-06-16 13:53:10 -05:00
Lance Edgar 73f78040af Add special 'authenticated' role, for easier permission management 2016-06-15 12:49:49 -05:00
Lance Edgar b75420441c Fix timezone bug in shift get_date() method 2016-06-14 22:16:45 -05:00
Lance Edgar c5648cc6ff Update changelog 2016-06-10 17:07:27 -05:00
Lance Edgar 49e90caf57 Add default logic for obtaining importers from handler, in new datasync consumer 2016-06-10 14:34:06 -05:00
Lance Edgar 600e38c282 Add support for more fields to Employee data importer 2016-06-08 21:09:58 -05:00
Lance Edgar 399c856716 Add explicit path to check-rattail-daemon within generic init script
Probably bad form, but works for now.
2016-06-06 17:11:39 -05:00
Lance Edgar a1a892a624 Tweak daemon init script to suppress some unwanted status output 2016-06-05 21:14:58 -05:00
Lance Edgar 13cb9e6a7a Add generic daemon init script
Need to get rid of the datasync/filemon/bouncer scripts next...
2016-06-04 23:11:28 -05:00
Lance Edgar 2ca2a2181e Tweak check-rattail-daemon script, add some docs to header 2016-06-04 22:03:09 -05:00
Lance Edgar 7980bcdd2f Add initial/basic support for Shinken monitoring software
Note that this targets Shinken 1.4 which is already woefully behind
compared to their latest 2.4.3 release, but that's what is offered via
APT by Ubuntu 14.04 and for now that's what we're testing with..
2016-06-04 20:00:57 -05:00
Lance Edgar 8ecec5a9ad Fix broken test 2016-06-01 22:22:18 -05:00
Lance Edgar 9c0f78af3b Update changelog 2016-06-01 22:18:36 -05:00
Lance Edgar 959ed0cdbe Add simple attribute so handlers can override diff count in warning emails 2016-06-01 22:17:21 -05:00
Lance Edgar 31638a62bf Never update local object's key field(s) when importing
Sneaky bug...
2016-06-01 22:16:24 -05:00
Lance Edgar 05f770cbd8 Update changelog 2016-05-27 14:19:36 -05:00
Lance Edgar 60d87ae090 Add logic for skipping deletion if no key, in import-based datasync consumer 2016-05-27 13:08:48 -05:00
Lance Edgar 7cd006b501 Update changelog 2016-05-26 15:25:56 -05:00
Lance Edgar 0abf66815f Default to empty list for cache query options in SQLAlchemy importers 2016-05-26 15:10:46 -05:00
Lance Edgar 2c2c8f01ed Add support for preferred field in phone/email importers 2016-05-25 18:46:17 -05:00
Lance Edgar 9a272b2200 Add datasync consumer base class for new-style importers 2016-05-25 18:45:55 -05:00
Lance Edgar c3461507a7 Fix delete behavior for ToSQLAlchemy importer, fix tests
No need to expunge the object when deleting, and that was making tests
break in a way that suggested production breakage also..?
2016-05-23 14:27:35 -05:00
Lance Edgar f6cf0e5971 Add comma formatting to counts within import warning diff emails 2016-05-23 14:21:07 -05:00
Lance Edgar 00a8e2657c Remove redundant "flush" handling from ToSQLAlchemy importer
Also tweak logging when a warning email is sent out; just to be
consistent with other logged message formats.
2016-05-18 12:15:51 -05:00
Lance Edgar 532a8a93a0 Update changelog 2016-05-17 16:26:31 -05:00
Lance Edgar ad6259f538 Remove deprecated Rattail -> Rattail importers 2016-05-17 15:31:20 -05:00
Lance Edgar 22e10accf5 Add "batch" support to importer framework
Doesn't really split things up per se, just controls how often a "flush
changes" should occur.
2016-05-17 15:02:08 -05:00
Lance Edgar 2a4a633337 Add tests for RattailConfig.configure_logging()
Slowly but surely..we'll get there..
2016-05-17 00:39:04 -05:00
Lance Edgar 7a2ef35518 Add BulkImporter and BulkImportHandler base classes 2016-05-16 21:09:19 -05:00
Lance Edgar 10040a8c3b More tweaks to new importer framework
* Add `ImportSubcommand.handler_spec` for simpler subclass config
* Pass `args` all the way from command -> handler -> importer
* Add `FromRattailHandler` for convenience
2016-05-16 19:41:21 -05:00
Lance Edgar 437ecfe6dd More tweaks for new importer framework
* Fix bug where some args weren't passed from command to handler
* Add new `ToRattailHandler` for convenience
* Add `ImportHandler.commit_partial_host` flag and logic
* Add `Importer.empty_local_data` flag and logic
* Fix bug where `Importer.delete` flag was ON by default
* tests for hopefully everything relevant..
2016-05-16 15:32:15 -05:00
Lance Edgar d2d8513e90 Fix dependency bug when testing coverage with tox 2016-05-15 10:25:07 -05:00
Lance Edgar 9917ed60ef Add a few tests for RattailConfig 2016-05-14 18:30:41 -05:00
Lance Edgar a056997c04 Update changelog 2016-05-14 11:07:13 -05:00
Lance Edgar 6ffcde5671 Add support for 'AdminUser' model in rattail importers
I.e. the User model plus the 'admin' flag pseudo-field.
2016-05-14 10:25:53 -05:00
Lance Edgar 1568a4bf9a Remove old/unused import-rattail subcommands 2016-05-14 10:19:30 -05:00
Lance Edgar 12d4fc714b Give teeth to ImportHandler.process_changes() in new framework
I.e. make it send the diff emails by default.
2016-05-14 01:02:47 -05:00
Lance Edgar 1704d9e025 Add new bulk PostgreSQL and Rattail->Rattail importers
Plus tests, sort of..plenty of stubs in here still.
2016-05-14 00:26:19 -05:00
Lance Edgar 328c8377c5 Add new Rattail -> Rattail main importer, with new/final framework
Plus tests, yay.  Also includes a couple of other tweaks which came up
in other testing.
2016-05-13 12:25:20 -05:00
Lance Edgar 8016ffbd26 Add initial handlers and subcommand for new/final importing framework
plus tests
2016-05-12 12:08:37 -05:00
Lance Edgar b9a4def2ca Clean up some imports within tests 2016-05-11 17:31:57 -05:00