Commit Graph

563 Commits

Author SHA1 Message Date
Christian Schwarz c69ebd3806 WIP rewrite the daemon
cmd subdir does not build on purpose, it's only left in tree to grab old
code and move it to github.com/zrepl/zrepl/daemon
2018-08-27 22:22:44 +02:00
Christian Schwarz df6e1bc64d privatize pprofServer 2018-08-27 19:13:35 +02:00
Christian Schwarz 89dc267780 start implementing new daemon in package daemon 2018-08-27 19:10:55 +02:00
Anton Schirg c7237cb09d test keep last n pruning 2018-08-27 16:24:19 +02:00
Anton Schirg 4073c5dfb0 change pruning testing function to use set compare on names 2018-08-27 16:17:39 +02:00
Anton Schirg c2b04d10c5 wip floocode backup 2018-08-27 15:22:32 +02:00
Anton Schirg b0d17803f0 job source with new config 2018-08-27 15:19:56 +02:00
Anton Schirg 16e1396261 connecters with new config 2018-08-27 15:19:17 +02:00
Anton Schirg b955d308d9 add to config 2018-08-27 15:18:08 +02:00
Christian Schwarz ecd9db4ac6 start pruning reimplementation in cmd/pruning subpackage 2018-08-27 15:12:00 +02:00
Anton Schirg b4ea5f56b2 ssh config 2018-08-26 23:46:59 +02:00
Anton Schirg 5e51595d7f local job config 2018-08-26 23:29:57 +02:00
Anton Schirg 48a08e4f4d config for pull and source 2018-08-26 23:13:16 +02:00
Anton Schirg e2bf557d17 use optional and default feature of yaml-config 2018-08-26 22:06:47 +02:00
Anton Schirg fbb8a25320 add prometheus monitoring to config 2018-08-26 22:06:47 +02:00
Anton Schirg add1b69809 move retentiongrid to own package 2018-08-26 22:06:47 +02:00
Anton Schirg cd9a428841 rename variable 2018-08-26 22:06:47 +02:00
Anton Schirg 4ec5e23457 set channel buffer to prevent leaking goroutine 2018-08-26 22:06:47 +02:00
Anton Schirg 13dc63bd23 build logger from new config 2018-08-26 22:06:47 +02:00
Anton Schirg 38bb78b642 WIP new config format 2018-08-26 22:03:57 +02:00
Christian Schwarz 6425c26b1b start refactoring: move daemon into subpackage 2018-08-26 21:58:58 +02:00
Christian Schwarz 428339e1ad move version info to separate package 2018-08-26 21:58:20 +02:00
Christian Schwarz ee5445777d logging format 'human': continue printing prefixed fields if some are missing 2018-08-26 19:13:09 +02:00
Christian Schwarz a0f72b585b remove JobStatus, Task abstraction and 'control status' subcommand
Control status will be replaced by job-specific output at some point.

Task was not useful anymore with state machine, may reintroduce
something similar at a later point, but consider alternatives:

- opentracing.io
- embedding everything in ctx
	- activity stack would work easily
	- log entries via proxy logger.Logger object
- progress reporting should be in status reports of individial jobs
2018-08-26 19:08:30 +02:00
Christian Schwarz 7ff72fb6d9 replication: document most important aspects of Endpoint interface 2018-08-26 15:12:43 +02:00
Christian Schwarz f6be5b776b cmd: clean up usage of contextKeyLog through getter and setter functions 2018-08-26 14:58:57 +02:00
Christian Schwarz 666ead2646 make go vet happy 2018-08-26 14:51:20 +02:00
Christian Schwarz cf01086df5 build: pin protoc version and update protobuf + regenerate 2018-08-26 14:35:18 +02:00
Christian Schwarz ea0e3a29e4 fixup 88de8ba8bb: gofmt 2018-08-25 22:30:44 +02:00
Christian Schwarz 71203ab325 move various timeouts to package-level variables 2018-08-25 22:30:16 +02:00
Christian Schwarz 88de8ba8bb initial repl policy: get rid of unimplemented options 2018-08-25 22:23:47 +02:00
Christian Schwarz 861e5f8313 special logging fields: from now on only 'job', 'task', 'subsystem' 2018-08-25 22:15:37 +02:00
Christian Schwarz e30ae972f4 gofmt 2018-08-25 21:30:25 +02:00
Christian Schwarz e082816de5 fixup d677cde6d0: unused import 2018-08-25 15:16:38 +02:00
Christian Schwarz b56e236874 add go-streamrpc to Gopkg.toml 2018-08-25 15:14:27 +02:00
Christian Schwarz f46d1bc338 fixup 70aad0940f: fix broken config_test.go 2018-08-25 13:02:38 +02:00
Christian Schwarz 51cfcfe79b job source: do not stop listener on accept() errors
refs #77
2018-08-25 13:00:51 +02:00
Christian Schwarz d677cde6d0 implement tcp and tcp+tls transports 2018-08-25 12:58:17 +02:00
Christian Schwarz 873c64ecc3 update README to reflect restructuring 2018-08-22 10:15:27 +02:00
Christian Schwarz 54c9dcb7c1 move replication policy constants to package replication 2018-08-22 10:11:14 +02:00
Christian Schwarz 9b537ec704 simplify naming in endpoint package 2018-08-22 10:05:21 +02:00
Christian Schwarz 70aad0940f cmd: move replication endpoints into subpackage 2018-08-22 00:43:58 +02:00
Christian Schwarz 7b3a84e2a3 move replication package to project root (independent of cmd package) 2018-08-22 00:19:03 +02:00
Christian Schwarz 301c7b2dd5 restructure and rename, making mainfsm the replication package itself 2018-08-22 00:14:12 +02:00
Christian Schwarz 2f205d205b remove EndpointPair abstraction 2018-08-21 22:15:00 +02:00
Christian Schwarz 38532abf45 enforce encapsulation by breaking up replication package into packages
not perfect yet, public shouldn't be required to use 'common' package to
use replication package
2018-08-16 21:05:21 +02:00
Christian Schwarz c7d28fee8f gofmt 2018-08-16 14:02:33 +02:00
Christian Schwarz bf1e626b9a proper queue abstraction 2018-08-16 14:02:16 +02:00
Christian Schwarz 93929b61e4 propert locking on FSReplication 2018-08-16 12:01:51 +02:00
Christian Schwarz 5479463783 always use ReplicationState, and have a map from that to the rsfs 2018-08-16 11:02:34 +02:00