Commit Graph

  • 754b253043 config: no-field for replication anymore Christian Schwarz 2018-09-04 14:44:45 -07:00
  • be57d6ce8e replication/diff: replace invalid comparison of CreateTXG with Creation Christian Schwarz 2018-09-04 13:32:19 -07:00
  • 4336af295f fixup 22ca80eb7e: scraping regex was broken and potentially mixed with stdout Christian Schwarz 2018-09-04 13:30:52 -07:00
  • 0c4a3f8dc4 pruning/history: properly communicate via rpc if snapshot does not exist Christian Schwarz 2018-09-04 13:29:51 -07:00
  • 8799108b55 fixup b95e983d0d: prunerFactory: fix duplicate logger fields Christian Schwarz 2018-09-03 13:19:56 -07:00
  • 03f9f81cb5 fixup 3d8e552c6a: validate streamrpc config in factory constructors Christian Schwarz 2018-09-03 13:17:53 -07:00
  • 2da0e51fda Update Gopkg.lock to latest versions of streamrpc and yaml-config Christian Schwarz 2018-09-02 15:49:17 -07:00
  • f0860767f5 zfs: include stderr of command in ZFSError.Error() Christian Schwarz 2018-09-02 15:32:08 -07:00
  • ad28fd1ecb replication: diff does not need special case for receiver/sender == nil Christian Schwarz 2018-09-02 15:31:10 -07:00
  • 3d8e552c6a streamrpc 0.3 + config from daemon/config Christian Schwarz 2018-08-31 21:51:44 +02:00
  • d55a271ac7 WIP adopt updated yaml-config with 'fromdefaults' struct tag Christian Schwarz 2018-08-31 21:50:59 +02:00
  • b95e983d0d bump go-streamrpc to 0.2, cleanup logging Christian Schwarz 2018-08-31 16:26:11 +02:00
  • f387e23214 fix: at least two snapshots were needed to start replication Anton Schirg 2018-08-30 17:50:43 +02:00
  • 32391adf4f build pruner in factory and check prune rules Anton Schirg 2018-08-30 17:40:45 +02:00
  • c0a3e1f121 wrap error in buildJob with job name Anton Schirg 2018-08-30 17:40:02 +02:00
  • 5442d8e7d5 status: calculate max fs name length Anton Schirg 2018-08-30 15:20:44 +02:00
  • 48feaff054 fix some status display alignment Anton Schirg 2018-08-30 14:07:28 +02:00
  • acd2a68cfb fix build: bump yaml-config Christian Schwarz 2018-08-30 13:40:28 +02:00
  • 1690339440 colorized stdout logger if stdout is tty Christian Schwarz 2018-08-30 13:30:18 +02:00
  • b5957aca37 do dry runs in planning stage to estimate size of all sends Anton Schirg 2018-08-30 12:52:08 +02:00
  • 47d8a5a7cd status: only show active not all versions of active filesystem Anton Schirg 2018-08-30 12:48:27 +02:00
  • 583773025f nicer progress bar Anton Schirg 2018-08-30 12:47:57 +02:00
  • 98f3f3dfd8 show expected size of current send Anton Schirg 2018-08-29 23:29:45 +02:00
  • 6ca11a7391 byte counter for status Anton Schirg 2018-08-29 22:06:24 +02:00
  • 42056f7a32 status: do not show problem field when none exists Anton Schirg 2018-08-29 19:25:34 +02:00
  • b2f01e454f bug in ZFSListFilesystemVersions? Anton Schirg 2018-08-29 19:19:32 +02:00
  • 6cedd0a2e8 add status command Anton Schirg 2018-08-29 19:18:54 +02:00
  • e495824834 move wakeup to client package and extract http client Anton Schirg 2018-08-29 19:17:45 +02:00
  • 7dd49b835a finish pruning implementation in push job Christian Schwarz 2018-08-30 11:52:05 +02:00
  • 22ca80eb7e remote snapshot destruction & replication status zfs property Christian Schwarz 2018-08-30 11:51:47 +02:00
  • 12dd240b5f fixup pruner Christian Schwarz 2018-08-30 11:49:06 +02:00
  • d684302864 pruning: fix tests + implement 'not_replicated' and 'keep_regex' keep rule Christian Schwarz 2018-08-30 11:44:43 +02:00
  • a2aa8e7bd7 finish pruner implementation Christian Schwarz 2018-08-29 19:00:45 +02:00
  • 0de17fd051 move cmd/pruning to pruning, as it's independent of the command implementation Christian Schwarz 2018-08-27 16:11:35 +02:00
  • fb0a8d8b40 gofmt cmd/ Christian Schwarz 2018-08-29 14:54:29 +02:00
  • c69ebd3806 WIP rewrite the daemon Christian Schwarz 2018-08-27 22:21:45 +02:00
  • df6e1bc64d privatize pprofServer Christian Schwarz 2018-08-27 19:13:35 +02:00
  • 89dc267780 start implementing new daemon in package daemon Christian Schwarz 2018-08-27 19:10:55 +02:00
  • c7237cb09d test keep last n pruning Anton Schirg 2018-08-27 16:24:19 +02:00
  • 4073c5dfb0 change pruning testing function to use set compare on names Anton Schirg 2018-08-27 16:17:39 +02:00
  • c2b04d10c5 wip floocode backup Anton Schirg 2018-08-27 15:22:32 +02:00
  • b0d17803f0 job source with new config Anton Schirg 2018-08-27 15:19:56 +02:00
  • 16e1396261 connecters with new config Anton Schirg 2018-08-27 15:19:17 +02:00
  • b955d308d9 add to config Anton Schirg 2018-08-27 15:18:08 +02:00
  • ecd9db4ac6 start pruning reimplementation in cmd/pruning subpackage Christian Schwarz 2018-08-27 15:09:24 +02:00
  • b4ea5f56b2 ssh config Anton Schirg 2018-08-26 23:46:59 +02:00
  • 5e51595d7f local job config Anton Schirg 2018-08-26 23:29:57 +02:00
  • 48a08e4f4d config for pull and source Anton Schirg 2018-08-26 23:11:50 +02:00
  • e2bf557d17 use optional and default feature of yaml-config Anton Schirg 2018-08-26 21:37:29 +02:00
  • fbb8a25320 add prometheus monitoring to config Anton Schirg 2018-08-26 20:25:06 +02:00
  • add1b69809 move retentiongrid to own package Anton Schirg 2018-08-26 19:20:08 +02:00
  • cd9a428841 rename variable Anton Schirg 2018-08-26 16:46:09 +02:00
  • 4ec5e23457 set channel buffer to prevent leaking goroutine Anton Schirg 2018-08-26 16:45:49 +02:00
  • 13dc63bd23 build logger from new config Anton Schirg 2018-08-26 16:44:34 +02:00
  • 38bb78b642 WIP new config format Anton Schirg 2018-08-26 15:17:15 +02:00
  • 6425c26b1b start refactoring: move daemon into subpackage Christian Schwarz 2018-08-26 21:58:58 +02:00
  • 428339e1ad move version info to separate package Christian Schwarz 2018-08-26 21:57:19 +02:00
  • ee5445777d logging format 'human': continue printing prefixed fields if some are missing Christian Schwarz 2018-08-26 19:03:50 +02:00
  • a0f72b585b remove JobStatus, Task abstraction and 'control status' subcommand Christian Schwarz 2018-08-26 16:49:40 +02:00
  • 7ff72fb6d9 replication: document most important aspects of Endpoint interface Christian Schwarz 2018-08-26 15:12:43 +02:00
  • f6be5b776b cmd: clean up usage of contextKeyLog through getter and setter functions Christian Schwarz 2018-08-26 14:58:57 +02:00
  • 666ead2646 make go vet happy Christian Schwarz 2018-08-26 14:51:20 +02:00
  • cf01086df5 build: pin protoc version and update protobuf + regenerate Christian Schwarz 2018-08-26 14:35:18 +02:00
  • ea0e3a29e4 fixup 88de8ba8bb: gofmt Christian Schwarz 2018-08-25 22:30:44 +02:00
  • 71203ab325 move various timeouts to package-level variables Christian Schwarz 2018-08-25 22:30:16 +02:00
  • 88de8ba8bb initial repl policy: get rid of unimplemented options Christian Schwarz 2018-08-25 22:23:47 +02:00
  • 861e5f8313 special logging fields: from now on only 'job', 'task', 'subsystem' Christian Schwarz 2018-08-25 22:15:37 +02:00
  • e30ae972f4 gofmt Christian Schwarz 2018-08-25 21:30:25 +02:00
  • e082816de5 fixup d677cde6d0: unused import Christian Schwarz 2018-08-25 15:16:38 +02:00
  • b56e236874 add go-streamrpc to Gopkg.toml Christian Schwarz 2018-08-25 15:14:27 +02:00
  • f46d1bc338 fixup 70aad0940f: fix broken config_test.go Christian Schwarz 2018-08-25 13:02:38 +02:00
  • 51cfcfe79b job source: do not stop listener on accept() errors Christian Schwarz 2018-08-25 13:00:51 +02:00
  • d677cde6d0 implement tcp and tcp+tls transports Christian Schwarz 2018-08-25 12:58:17 +02:00
  • 873c64ecc3 update README to reflect restructuring Christian Schwarz 2018-08-22 10:15:27 +02:00
  • 54c9dcb7c1 move replication policy constants to package replication Christian Schwarz 2018-08-22 10:11:14 +02:00
  • 9b537ec704 simplify naming in endpoint package Christian Schwarz 2018-08-22 00:52:46 +02:00
  • 70aad0940f cmd: move replication endpoints into subpackage Christian Schwarz 2018-08-22 00:43:58 +02:00
  • 7b3a84e2a3 move replication package to project root (independent of cmd package) Christian Schwarz 2018-08-22 00:19:03 +02:00
  • 301c7b2dd5 restructure and rename, making mainfsm the replication package itself Christian Schwarz 2018-08-22 00:10:09 +02:00
  • 2f205d205b remove EndpointPair abstraction Christian Schwarz 2018-08-21 22:15:00 +02:00
  • 38532abf45 enforce encapsulation by breaking up replication package into packages Christian Schwarz 2018-08-16 21:05:21 +02:00
  • c7d28fee8f gofmt Christian Schwarz 2018-08-16 14:02:33 +02:00
  • bf1e626b9a proper queue abstraction Christian Schwarz 2018-08-16 14:02:16 +02:00
  • 93929b61e4 propert locking on FSReplication Christian Schwarz 2018-08-16 12:01:51 +02:00
  • 5479463783 always use ReplicationState, and have a map from that to the rsfs Christian Schwarz 2018-08-16 11:02:34 +02:00
  • 094eced2c7 WIP: states with updater func instead of direct locking Christian Schwarz 2018-08-16 01:26:09 +02:00
  • 991f13a3da Reporting Christian Schwarz 2018-08-15 20:29:34 +02:00
  • 7303d91abf WIP state-machine based replication Christian Schwarz 2018-08-11 12:19:10 +02:00
  • c1f3076eb3 WIP2 logging done somewhat Christian Schwarz 2018-08-10 17:06:00 +02:00
  • 74445a0017 fixup Christian Schwarz 2018-08-08 13:12:50 +02:00
  • a0b320bfeb streamrpc now requires net.Conn => use it instead of rwc everywhere Christian Schwarz 2018-08-08 13:09:51 +02:00
  • 1826535e6f WIP Christian Schwarz 2018-07-15 17:36:53 +02:00
  • 1a8d2c5ebe replication: context support and propert closing of stale readers Christian Schwarz 2018-07-08 23:31:46 +02:00
  • 8cca0a8547 Initial working version Christian Schwarz 2018-06-20 20:20:37 +02:00
  • 302d77cf4a zfs: allow spaces in zfs names. Space is a allowed character in zfs names accoring to https://github.com/zfsonlinux/zfs/issues/439. Moritz Fago 2018-06-19 19:51:40 +02:00
  • c7f0f779b1 doc: README.md: push mentioning of Go down to developer docs. Christian Schwarz 2018-05-22 17:39:06 +02:00
  • e6426db8da rpc: bump go-netssh package to address goroutine leak on timeouts Christian Schwarz 2018-05-22 17:30:29 +02:00
  • fa6426f803 WIP: zfs: hacky resume token parsing Christian Schwarz 2018-05-02 21:26:56 +02:00
  • 0918ef6815 WIP: diffing and replication algorithm Christian Schwarz 2018-05-02 21:26:11 +02:00
  • 181875a89b build: add dependency on prometheus client_golang to Gopkg.toml Christian Schwarz 2018-04-14 11:41:26 +02:00