Compare commits

...

246 commits

Author SHA1 Message Date
6a3ebe48e0 server > Introduce monitoring of inc creation time (#80)
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Reviewed-on: #80
2025-01-17 16:41:48 +01:00
636a5b6143
server: Delete inc timing files after 30days 2025-01-17 15:14:21 +01:00
ba5fab4852
server: Update CHANGELOG.md 2025-01-14 11:59:23 +01:00
0f7570fb87
server: bkctld-check-setup : Add a check to ensure inc creation time is bellow a given warning/critical threshold
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Time threshold being configured as :
INCTIME_WARNING > 12 hours by default
INCTIME_CRITICAL > 18 hours by default
2025-01-14 11:36:48 +01:00
a419e0262d
server: bkctld-check-setup : Warn when inc and rm are running at the same time
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2025-01-14 10:39:23 +01:00
8147ba84ee
server: bkctld-check-setup - Check how many inc operations are running
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Ok if there's none or one
Critical if theres more than one
2025-01-14 10:32:28 +01:00
457a4ddcda
server: Measure and keep inc creation time
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
This add a new directory, called DATADIR, that is located by default
in /var/lib/bkctld
This directory will contain files time-inc_????-??-??-?? with a track of
elasped time for creating each inc (+ global time)
2025-01-14 10:03:06 +01:00
ab9327b8b2
server: bkctld-rm: Add Begining/end log message and invert logging priorities
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Progress messages are now notice
Start/stop messages are info
2025-01-10 12:41:49 +01:00
981b8978e3
server: bkctld-inc: Add Begining/end log message (with the inc name) and invert logging priorities
Progress messages are now notice
Start/stop messages are info
2025-01-10 12:41:12 +01:00
9344bef64c
server: Update munin plugin bkctld_rsyncs
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
it wasn't working now that we switched to systemd-nspawn
2025-01-10 12:09:47 +01:00
084d4a5211
server: update changelog 2025-01-10 12:07:41 +01:00
0ce0d4213d
server: update changelog 2025-01-10 11:56:20 +01:00
a42c196f75 Disable padding for the last column (#54)
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Reviewed-on: #54
2025-01-10 11:08:13 +01:00
49b9b763fb
Merge branch 'master' into bkctld_status_disable_last_column_padding
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2025-01-10 11:03:16 +01:00
82820115c5 Client - Release 25.01
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2025-01-07 17:32:01 +01:00
ac0c137c50 Update CHANGELOG 2025-01-07 17:29:58 +01:00
ead8c7b48a Fix compatibility with OpenBSD (#79)
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
- `readlink` : option "-m" does not exist on OpenBSD, option "-f" exists on both Debian and OpenBSD
- `SERVER_IP` : no reason not to first use curl on OpenBSD too
- `date` : option "--iso-8601=seconds" does not exist on OpenBSD (and "%:z" neither) ; "+%FT%T%z" works on both Debian and OpenBSD but we loose the ":" in "+01:00" for the time zone

Co-authored-by: Jeremy Lecour <jlecour@evolix.fr>
Reviewed-on: #79
Reviewed-by: Mathieu Trossevin <mtrossevin@noreply.gitea.evolix.org>
Co-authored-by: Jérémy Dubois <jdubois@evolix.fr>
Co-committed-by: Jérémy Dubois <jdubois@evolix.fr>
2025-01-07 14:38:44 +01:00
Eric Morino
1c09d6f8bb Add function for backup Linstor Database
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2025-01-03 16:16:13 +01:00
8c1a220ac3 Introducing munin-plugins for bkctld (#64)
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Introducing munin-plugins for bkctld :

* incs > Total number of incs (+ expexted total)
* jails > Number of jails & active jails
* rsync > Number of curently running rsyncs
* ops > Track time when bkctld is doing incs & rm operations

Co-authored-by: Jérémy Lecour <jlecour@noreply.gitea.evolix.org>
Reviewed-on: #64
Co-authored-by: Ludovic Poujol <lpoujol@evolix.fr>
Co-committed-by: Ludovic Poujol <lpoujol@evolix.fr>
2025-01-03 11:50:42 +01:00
179d383fb5
fix(dump_elasticsearch): Add an \n before HTTP status code
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Elasticsearch's API do not add end of lines at the end of it's
responses. This break the final `grep` making the script believe there
was an error.
2024-12-19 15:58:09 +01:00
bc0cc3d6a1
client: release 24.12
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2024-12-18 15:47:31 +01:00
7ea63f4665
client: the template defaults to full Evolix backup
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-12-18 15:45:47 +01:00
Gregory Colpart
58512e6897 Revert "add exclude for /var/lib/docker/volumes" : we want it after internal discussions
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
This reverts commit 3c0090954b.
2024-12-18 15:41:46 +01:00
Gregory Colpart
3c0090954b add exclude for /var/lib/docker/volumes
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-12-18 13:56:19 +01:00
Gregory Colpart
38a1b14c9a add fix to changelog
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-12-18 13:01:32 +01:00
Gregory Colpart
d93535578e ajouter 'lxc/*/rootfs/dev' en exclude
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-12-18 12:59:58 +01:00
1bd60a3595
update CHANGELOG
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2024-11-29 10:57:50 +01:00
96a342b67f
client Release 24.11
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-11-29 10:55:57 +01:00
825b392c4f
Fix redis backup 2024-11-29 10:54:40 +01:00
07bb14445e
dump_postgresql_per_base: look for correct variable to build connect options: look for correct variable to build connect options
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-11-06 16:36:03 +01:00
a791d752f0
dump_postgresql_per_base: return if postgresql directory is missing 2024-11-06 16:30:58 +01:00
a9d90fc937
dump_redis: clean backup directory only if the Redis instance is valid 2024-11-06 16:29:50 +01:00
ba17140cfc
dump_redis: do not delete entire backup directory
If no option is given, the function must not delete the parent backup directory.
The fix is to declare the variable as an empty array, instead of a blank string.
2024-11-06 16:29:12 +01:00
ec9e056ff7
server: release 24.10
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2024-10-10 15:08:09 +02:00
d606fac7b4
server: Update changelog
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-09-27 09:49:33 +02:00
eb88df4a21 Remove internal link
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-09-23 10:00:59 +02:00
Brice Waegeneire
218570ed6e bkcltd: rm hide over allocation message
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
See https://github.com/RsyncProject/rsync/issues/552#issuecomment-1840914895
2024-09-17 16:38:48 +02:00
0c674f2440
server: (wip) Update changelog
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-09-09 12:01:10 +02:00
55974e1a26
server: Update check-canary to raise a warning (instead of critical) when yesterday's date is found
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-09-09 09:52:24 +02:00
a52b09f8db
server: Add commented config directive in sshd config template for old clients
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Warning, this would still need to be manually applied to old jail configs
2024-09-03 12:00:36 +02:00
11960efbbf
server: convert-v2 > Add missing move to the /root directory & mount point cleanings
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
We need to keep that, as it contains the allowed ssh keys
And the proc/ & dev/ folder as mount points aren't need anymore
2024-09-03 10:56:30 +02:00
Eric Morino
7e1cb11a9e fix typo when call option_dump_slave in dump_options
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-08-30 10:49:27 +02:00
Eric Morino
6f864ccbb1 fix bash compare for --dump-slave 2024-08-30 10:45:51 +02:00
Eric Morino
2cec5a274f re-arranging options_dump_slave
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-08-30 10:04:16 +02:00
Eric Morino
c25c498820 Add variable connect_options for dump per base
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-08-29 10:59:43 +02:00
d44be2f567 Use systemd-nspawn instead of chroot (#74)
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Reviewed-on: #74
2024-08-28 17:16:39 +02:00
7f5fe8effa server: bump version number
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-08-28 17:15:48 +02:00
e5adfc9a58 server: fix broken permissions on files 2024-08-28 17:15:48 +02:00
64337a67b3 server: Add update current debian versions for vagrantfile 2024-08-28 17:15:48 +02:00
77f8f90d20 server: Add dependencies in Vagrantfile 2024-08-28 17:15:48 +02:00
c31114adbf server: More linting with shellcheck 2024-08-28 17:15:48 +02:00
e16feaeb17 server: New test, ensuring the jail has a version file 2024-08-28 17:15:48 +02:00
d606432fb6 server: lint: more quotes 2024-08-28 17:15:48 +02:00
a733b21645 server: lint: more quottings 2024-08-28 17:15:48 +02:00
91b5f37bc3 server: lint: More quotes 2024-08-28 17:15:48 +02:00
69a24c2108 server: lint: more variable quotes 2024-08-28 17:15:48 +02:00
f64cc93c21 server: replace printf with echo -n 2024-08-28 17:15:48 +02:00
3af7691599 server: Lint, change confiditionals "! -n" with "-z" 2024-08-28 17:15:48 +02:00
f469a265ae server: remove odd backticks 2024-08-28 17:15:48 +02:00
b956bc89a5 server: Update test suite
-> Use systemctl show to fetch the jail pid
-> Use journalctl to grep in jail log
-> Adapt paths to fit the new directory structures
2024-08-28 17:15:48 +02:00
5ab6f310f7 server: Update check-canary to be in the right jail path
ie: /data instead of /var/backup
2024-08-28 17:15:48 +02:00
40bacca027 server: Remove typo in bkctld-reload 2024-08-28 17:15:48 +02:00
05690dcc2f server: bkctld-remove > Cleanup nspawn setup/config 2024-08-28 17:15:48 +02:00
e2531d67b3 server: bkctld-archive > Cleanup nspawn setup/config 2024-08-28 17:15:48 +02:00
75f9107ed0 server: Adapt bkctld-rename to the new nspawn setup 2024-08-28 17:15:48 +02:00
552d7e1c94 server: Move the nspawn config generation in a separate function 2024-08-28 17:15:48 +02:00
9bd104d430 server: bkctld-sync > Only sync /etc and /root from the jail 2024-08-28 17:15:48 +02:00
4de0e6ae7d server: bkctld-sync > Ensure that bkctld versions are identical and jail version too 2024-08-28 17:15:48 +02:00
7ceda42495 server: New command jail-version
Return the version of a given jail
2024-08-28 17:15:48 +02:00
1e4bf89082 server: Adapt command sync to the new folder structure 2024-08-28 17:15:48 +02:00
805f10ea83 server: Add missing call in bkctld for the convert-v2 command 2024-08-28 17:15:48 +02:00
20568f5a95 server: New command convert-v2
Convert a given jail to the new format
2024-08-28 17:15:48 +02:00
87c8372304 server: Validate the jail version before trying to change settings/update it 2024-08-28 17:15:48 +02:00
e0b5e76950 server: Extend the notion of Jail version
Add an internal function returning the jail version
2024-08-28 17:15:48 +02:00
e8ff20f140 server: Change start script to directly exec sshd
So we don't keep a sh process around.
Updated get_jail_sshd_pid accordingly with some comment
2024-08-28 17:15:48 +02:00
bde6e8da24 Show systemd property value directly 2024-08-28 17:15:48 +02:00
4fdba6cba4 Fix frenglish 2024-08-28 17:15:48 +02:00
b31834103a fix quotes
When strings must be quoted in messages, it's common to use an escaped backtick at the beginning, then a single-quote at the end.
2024-08-28 17:15:48 +02:00
c7ac0a78a6 typo 2024-08-28 17:15:48 +02:00
a7c542f3f3 server: new command log, to quickly show last logs from journalctl 2024-08-28 17:15:48 +02:00
8bfdf91941 server: Move from chroot to systemd-nspawn
Big change :
-> systemd-nspawn usage instead of chroot
-> Folder directory structure changes

Before : /backup/jails/JAIL_NAME/ <- RootFS of chroot jail
Now :
-  /backup/jails/JAIL_NAME/rootfs <- Jail rootfs (ro)
-  /backup/jails/JAIL_NAME/var <- Jail /var (rw)
-  /backup/jails/JAIL_NAME/data <- Jail /data (rw)

New dependencies :
- systemd-nspawn (package systemd-container on Debian)
- check_ssh (package monitoring-plugins-basic on Debian

Still a Work In Progress.
As of now, it won't work on existing servers as the jail folders needs
to be converted to the new folder structure
2024-08-28 17:15:48 +02:00
e13e2aa270 server: Remove deprecated sshd config options 2024-08-28 17:15:48 +02:00
Eric Morino
8b938fba25 Add options --host and --port for differents way to dump postgresql
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-08-28 15:40:32 +02:00
Eric Morino
d49335777b Add option option_dump_slave for dump_mysql_global 2024-08-28 15:13:05 +02:00
5557f42870
Client - Release 24.07
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2024-07-16 15:10:36 +02:00
93567b913f
dump/mysql.sh : give write permissions to mysql on tabs directories
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-07-16 15:08:12 +02:00
cb5bef3b54
Allow everybody to "x" on LOCAL_BACKUP_DIR
Set the directory permissions to 711 to allow anyone to walk through the backup directory, but not list the content
2024-07-16 15:08:12 +02:00
886e47ebf7
dump/postgresql: Fix dump_cmd usage
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
`var="(<cmd>)"; ${var}` doesn't work in shell.
Use "eval" to make it work.
2024-07-09 11:20:00 +02:00
ba087a2a35
dump/postgrepsql: Remove useless variables copied from dump/mysql
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
These caused errors, weren't used at all in the script outside of
changing the default value of another variable, and couldn't be set
anyway.

(We might want to re-add option_port later as it would be useful. But
right now it isn't usable at all.)
2024-07-09 10:56:47 +02:00
Alexis Ben Miloud--Josselin
e9d802105a dump/postgrepsql: Add missing variables
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
These variables were used but undefined. The lines come from
client/lib/dump/mysql.sh.
2024-07-08 10:16:49 +02:00
53ae37fcea
Use correct variable when detecting local sshrc template
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-06-03 11:27:39 +02:00
201b22c145
Client - Release 24.05.1
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2024-05-14 08:19:37 +02:00
0e98c6d4cd
client: fix shell syntax error 2024-05-14 08:18:02 +02:00
f3cfda48f7
Client - Release 24.05
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2024-05-02 10:22:39 +02:00
dc003ecbca
Add previous release dates in CHANGELOG 2024-05-02 10:20:53 +02:00
0d32cb2cde
evobackupctl: update LIBDIR when copying the template 2024-05-02 10:18:25 +02:00
96aa0cf7a2
mention the Ansible role in the client README 2024-05-02 10:17:46 +02:00
be6ebdf415
evobackupctl: simplify the program path retrieval 2024-05-02 10:17:22 +02:00
ebad3bb8d9
README formatting (syntax highlighting)
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
gitea/evobackup/pipeline/tag This commit looks good
2024-04-30 10:02:35 +02:00
3bcc39088b
README formatting
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-04-30 09:59:37 +02:00
ef8c04fe4e
client: release 24.04.1
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-04-30 09:57:53 +02:00
981420ed23
Add a general README and a client README 2024-04-30 09:56:28 +02:00
8a6db11ca7
zzz_evobackup: improve the documentation 2024-04-30 09:56:27 +02:00
939ced46c2
evobackupctl: fix args check 2024-04-30 09:56:25 +02:00
288d61d6b9
client: release 24.04
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-04-29 17:59:57 +02:00
1c44943143
Merge branch 'client-functions' 2024-04-29 17:58:51 +02:00
2cf8264127
evobackupctl: change option name
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2024-04-29 17:52:35 +02:00
d9674acff0
evobackupctl: add "--init-jail-commands" 2024-04-29 16:29:44 +02:00
73bd007f6e
evobackupctl: use $ARGS 2024-04-29 16:27:22 +02:00
00e5384cd1
Use placeholder values for script template 2024-04-29 14:49:41 +02:00
ee111b8c5c
client: update VERSION 2024-04-29 10:59:30 +02:00
0f1d9148fd
evobackupctl: If no argument is provided, print help and exit 2024-04-29 10:59:09 +02:00
fd856b7423
evobackupctl: update verison command output 2024-04-29 10:48:46 +02:00
9c8dca7b70
update CHANGELOG 2024-04-08 13:15:22 +02:00
699ed5a781
use $TMPDIR if available 2024-03-22 11:32:18 +01:00
859bb800d4 Merge pull request 'fix-tempfiles' (#72) from fix-tempfiles into master
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
Reviewed-on: #72
2024-03-22 11:27:34 +01:00
Brice Waegeneire
21533c6fb9 client: Write temporary files in /tmp
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
By default "mktemp" creates a temporary file in the current working directory,
which in the context of Debian's cron is /. To avoid littering /, we add the
option "--tmpdir" that use $TMPDIR or /tmp instead.
2024-03-22 10:05:10 +01:00
Brice Waegeneire
9510546d48 client: Correctly clean up temporary files
The function "build_rsync_main_cmd" is called in a subshell, so it can't
effectively modify it's parent variable "temp_files". To correctly cleanup
those temporary files, we do it when this specific function exits.
2024-03-22 09:56:03 +01:00
f1d4e6ed9d
fix(includes): Avoid breaking is_btrfs if path doesn't exists
Some checks failed
gitea/evobackup/pipeline/head There was a failure building this commit
This should return with a err code of 1, not result in the entire
command breaking
2024-02-06 15:03:21 +01:00
da1d4356dd
don't exit the whole program if a sync task can't be done 2024-01-26 16:04:00 +01:00
86ee6406a5
manually source dump libraries 2024-01-15 07:35:27 +01:00
230ad8ae79
update comments for the new function name 2024-01-11 08:03:09 +01:00
282bb6f1bc
dynamically include dump files 2024-01-10 15:06:17 +01:00
45d0205cc1
add pigz compression method 2024-01-09 18:02:22 +01:00
f71dd862bb
Add options to dump_mysql_tabs 2024-01-09 13:30:55 +01:00
8d9c60b543
Add command logging 2024-01-09 11:24:03 +01:00
2b4333bded
path_to_str: simplify code 2024-01-09 11:22:18 +01:00
f3e25a7beb
Use env-based shebang for shell scripts 2024-01-09 10:11:31 +01:00
7a9663781d
add automatic trace mode if TRACE=1 2024-01-09 08:47:18 +01:00
a5ff9199b3
long option name 2024-01-09 08:46:58 +01:00
257679364d
rewrite (again) mysql functions 2024-01-09 08:45:24 +01:00
01fb231437
Vagrant definition for manual tests 2024-01-08 23:01:43 +01:00
0f0b328f27
include main.sh in evobackupctl 2024-01-02 12:11:55 +01:00
28a0f7a17a
CHANGELOG update (no semver) 2023-12-29 18:26:07 +01:00
ebc20cf4e8
cleanup + changelog 2023-12-29 18:24:27 +01:00
98bfc5d840
Introducing evobackupctl 2023-12-29 18:15:39 +01:00
ceb12254be
add simple bin script to show version… 2023-12-29 15:17:39 +01:00
4b71218ae1
simplify cron script 2023-12-29 15:17:08 +01:00
8c7a963266
more comments 2023-12-29 14:06:28 +01:00
a0f5c31175
whitespaces and comments 2023-12-29 14:05:01 +01:00
b7ce6e1cff
Rewrite mysql dump functions and reorganize code 2023-12-29 13:50:51 +01:00
5840e8efee
whitespaces 2023-12-29 13:49:08 +01:00
430e4f52ac
Remove empty error directories at exit 2023-12-29 13:48:02 +01:00
491c839014
Add note for includes/excludes brace expansion
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-12-28 15:29:39 +01:00
3268ff0858
Add note for includes/excludes brace expansion 2023-12-28 15:23:52 +01:00
William Hirigoyen
4298da250b Add WARNING and CRITICAL values to default conf
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-12-19 10:26:30 +01:00
William Hirigoyen
d359883700 server: fix install.md paths
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-12-19 09:45:25 +01:00
d4ad3b735f
split mkdir and chmod 2023-11-23 09:03:25 +01:00
32d41a4564
dump_redis: fix error_dir 2023-11-23 09:03:05 +01:00
4cd1554780 Correction url dans README.md
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-10-27 11:30:53 +02:00
68daa1ebf2
deploy-evobackup-beta : fix various issues
* bad permissions
* hard-coded path for cron job
* Ansible syntax for booleans
2023-07-06 10:26:01 +02:00
c3f238b3c6
VERSION="23.07-pre" 2023-07-06 10:25:15 +02:00
f0f177bae9
wording 2023-07-06 09:47:39 +02:00
03961156a8
split dump_mysql_grants and dump_mysql_variables 2023-07-06 09:42:38 +02:00
c8f0781e75
whitespace 2023-07-06 09:12:33 +02:00
54a52d7b8f
Exclude amavis virusmails directory from backup
Cf. #981f5118cec40f560c1a743be8d9ef0509305c94
2023-07-06 09:10:30 +02:00
b4ab681061
#71538 : fix Redis dump list in case directory is a symlink
Cf. #fd9bb57f8bd0d2537d82e7e3cf4362e3da0538ea
2023-07-06 09:08:23 +02:00
d71fd5343f
Compress Redis dump 2023-07-06 09:06:21 +02:00
William Hirigoyen
981f5118ce Ajout exclusion /var/lib/amavis/virusmails
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-06-15 11:18:49 +02:00
5dac827bb5 invert dry-run logic
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-05-03 22:08:17 +02:00
William Hirigoyen
4807dfbc99 Fix missing dump.rdb in Redis dump compression, which caused compression fail.
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-04-19 17:46:34 +02:00
William Hirigoyen
fd9bb57f8b #71538 : fix Redis dump list in case directory is a symlink
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-04-17 17:13:23 +02:00
Alexis Ben Miloud--Josselin
d62455cd1a Compress Redis dump
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-04-04 15:05:30 +02:00
7379427051 fix PG dump per base : dump everything and not only the schema 2023-03-31 17:27:20 +02:00
Bruno Tatu
72f5900cf3 On backup les données dans les bases
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-03-30 16:37:36 +02:00
a5b553ab99 dump: global/per-base schema along with data 2023-03-23 08:47:37 +01:00
81177d63f5 remov dump_mysql_meta 2023-03-23 07:52:00 +01:00
0a485b3054 dump.sh reorganize backup directories, again 2023-03-23 07:48:41 +01:00
6f755b94ba dump.sh reorganize backup directories 2023-03-22 22:06:24 +01:00
158f135c4c Merge branch 'split-lib' into client-functions 2023-03-22 14:46:33 +01:00
5ac990473e remove monolithic script
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-03-22 14:19:29 +01:00
a6573c6db3 changelog
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-03-22 14:17:42 +01:00
ea054f314c Add some comments 2023-03-22 14:17:10 +01:00
70e541dd6d zzz_evobackup.sh: LIBDIR="/usr/local/lib/evobackup"
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-03-22 14:11:03 +01:00
5aeba28d5c utilities.sh: fix line count 2023-03-22 14:10:27 +01:00
4475ee9af8 dump.sh: improve options handling
* default values,
* reset variable each time
* option masterdata seulement si présente
2023-03-22 14:10:11 +01:00
feafe01692 Delete error directories recursively
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-03-08 09:22:28 +01:00
1fa1eb7793 Delete README containing dead links 2023-02-27 14:56:45 +01:00
50f81f2716 Add options for dump functions
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-02-08 22:53:28 +01:00
2e9eb4a946 variable for script path 2023-02-08 22:51:38 +01:00
149b5d0e8d comments
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-01-28 21:14:22 +01:00
d532ac83da client: declare variable earlier
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-01-28 16:20:51 +01:00
767d509390 deploy evobackup beta with configured MAIL and LIBDIR 2023-01-28 16:20:36 +01:00
70fbab9bb0 Test presence of old config file before trying to delete it
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-01-28 16:07:39 +01:00
c5d82eda68 deployment playbook
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-01-16 14:26:15 +01:00
0491598c1f hook functions 2023-01-16 14:26:04 +01:00
2bf4d0dd0f mtree includes must be directories 2023-01-16 14:25:31 +01:00
ed7f9e79ae default value 2023-01-16 13:16:19 +01:00
7784ba5548 load libraries just before calling main
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-01-16 09:58:17 +01:00
2ea9614e3c WIP: separate lib and custom code
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-01-15 22:56:03 +01:00
f9aa722ac9 log errors as they happen 2023-01-14 18:51:37 +01:00
86f0046797 send rsync full log file if it exists 2023-01-13 18:17:54 +01:00
518fa9d1e7 Store errors in dedicated and persistent directories 2023-01-13 17:17:56 +01:00
27568820bf revert "declare -a" on array variables 2023-01-13 17:15:33 +01:00
22814bc5d7 Ldap dump file name 2023-01-13 17:13:06 +01:00
9665a4ef00 commands arguments (long options and whitespaces 2023-01-13 16:58:24 +01:00
46c012f5fc skip mtree if disabled or missing 2023-01-13 13:30:57 +01:00
e9cf39ad40 remove PING_BEFORE_SSH 2023-01-13 11:26:41 +01:00
22ba5ed823 declare bash arrays 2023-01-13 11:26:19 +01:00
7f4cb78826 shellcheck 2023-01-13 11:17:20 +01:00
7199ffc64f Add PING_BEFORE_SSH (enabled by default) 2023-01-09 11:45:39 +01:00
4ff1bc5976 better comments 2023-01-06 16:59:12 +01:00
aeebb815c8 Use bash array for temp_files 2023-01-06 14:45:02 +01:00
c2d08ed80e create and sync mtree files 2023-01-06 14:34:51 +01:00
c3c98b64f2 Use bash array for list of paths to include 2023-01-06 14:33:20 +01:00
053c339e8f better comments 2023-01-05 13:45:17 +01:00
d75d75cd4c Use an array to build the rsync commands, instead of eval 2023-01-04 23:32:12 +01:00
58f41963a7 store temp_files in TMPDIR instead of current directory 2023-01-04 14:51:10 +01:00
f6c8d966d7 shellcheck 2023-01-04 14:20:12 +01:00
82df2b38e9 move variables around to simplify common usage 2023-01-04 14:19:48 +01:00
f5660b1e46 doc 2023-01-04 12:34:17 +01:00
8d4105cf31 sync only the Rsync stats alongside the canary file 2023-01-04 11:34:42 +01:00
a957498b6f push rsync log file with the canary file 2023-01-04 09:40:26 +01:00
17c2868fee shellcheck fixes 2023-01-04 09:20:41 +01:00
c3f65a1722 extract variables 2023-01-04 09:19:47 +01:00
9ee784509d add whitespace to align log outputs with start/stop 2023-01-04 09:16:00 +01:00
b6d50cc921 remove trailing slash in dump_dir 2023-01-04 09:15:26 +01:00
0235906546 fix dump_file 2023-01-04 09:13:46 +01:00
b1c5b693ee Output error file if size is not null 2023-01-04 09:13:22 +01:00
65ba8695ad Add documentation comments 2023-01-04 07:45:47 +01:00
c6a89cbc32 Reorder functions 2023-01-04 07:35:26 +01:00
c368c9b11a typo 2023-01-03 23:50:34 +01:00
910a7398fb error codes 2023-01-03 23:50:23 +01:00
e3c7da32a9 Add logs and error control 2023-01-03 23:30:50 +01:00
4496ea883a explicit canary file 2023-01-03 09:59:13 +01:00
cb5c842979 Extract functions for each local task
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2023-01-01 23:04:44 +01:00
05a62e17b5 client: Release 22.12
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-27 13:37:48 +01:00
8babc64e0d client: log line with more details
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-27 13:36:24 +01:00
aa7366ce2e client: separate Rsync for the canary file if the main Rsync has finished without errors
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-27 11:56:07 +01:00
ef744f77cf client: No more fallback if dump-server-state is missing
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-27 11:11:02 +01:00
80426c9ba9 whitespaces 2022-12-27 11:09:37 +01:00
b34ee2c3dc client: use long options for readability 2022-12-27 11:09:11 +01:00
94b470770f client: use sub shells instead of moving around
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-27 10:46:53 +01:00
ed0645c9d2 remodel how we build the rsync command (#63)
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
* use a log file for rsync
* build the command argument by argument, without backslashes
* move excludes into a file

Co-authored-by: Jeremy Lecour <jlecour@evolix.fr>
Reviewed-on: #63
2022-12-27 10:43:39 +01:00
140a498e28 client: Only one loop for all redis instances
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-27 10:38:55 +01:00
David Prevot
bdd3ef7350 CI: Push *.buildinfo too
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-22 11:39:42 +01:00
Alexis Ben Miloud--Josselin
6e0ab85c6b client: ignore errors when listing instances
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-13 09:53:10 +01:00
David Prevot
ff681275e3 CI: Don’t use Drone CI anymore
All checks were successful
gitea/evobackup/pipeline/head This commit looks good
2022-12-12 17:27:36 +01:00
David Prevot
1a892ba002 CI: Actually limit upload to .deb and .changes
All checks were successful
continuous-integration/drone/push Build is passing
gitea/evobackup/pipeline/head This commit looks good
2022-12-12 17:13:28 +01:00
Alexis Ben Miloud--Josselin
e3a969f3e2 client: replace rm ** by find -delete
All checks were successful
continuous-integration/drone/push Build is passing
gitea/evobackup/pipeline/head This commit looks good
** has no particular meaning in bash unless shopt globstar is
set (it isn't by default).
2022-12-12 16:06:58 +01:00
David Prevot
ca4fe4ffb5 CI: Limit upload to .deb and .changes
All checks were successful
continuous-integration/drone/push Build is passing
gitea/evobackup/pipeline/head This commit looks good
2022-12-12 11:42:19 +01:00
David Prevot
2338c92fe3 CI: Upload to pub2
All checks were successful
continuous-integration/drone/push Build is passing
gitea/evobackup/pipeline/head This commit looks good
2022-12-12 10:56:13 +01:00
David Prevot
d2a76dce9c CI: use build-area instead of outside of scope subdirectory 2022-12-12 10:26:06 +01:00
David Prevot
4476802182 Use sbuild during CI
All checks were successful
continuous-integration/drone/push Build is passing
gitea/evobackup/pipeline/head This commit looks good
2022-12-09 13:42:44 +01:00
1e35aaa4db
Corrige messages d'erreurs intempestif
All checks were successful
continuous-integration/drone/push Build is passing
gitea/evobackup/pipeline/head This commit looks good
2022-12-08 14:09:37 +01:00
Alexis Ben Miloud--Josselin
9bfec89f18 Disable padding for the last column
Padding the last column on the right often produces messed up
output because lines are too long.
2021-12-06 10:29:55 +01:00
60 changed files with 5386 additions and 1104 deletions

View file

@ -1,24 +1,15 @@
pipeline {
agent { label 'docker' }
agent { label 'sbuild' }
stages {
stage('Build Debian package') {
agent {
docker {
image 'evolix/gbp:bullseye'
args '-u root --privileged'
}
}
when {
branch 'debian'
}
steps {
script {
sh 'mk-build-deps --install --remove debian/control'
sh 'rm -rf {source,*.gz,*.bz2,*.xz,*.deb,*.dsc,*.changes,*.buildinfo,lintian.txt,.git}'
sh "gbp clone --debian-branch=$GIT_BRANCH $GIT_URL source"
sh 'cd source && git checkout $GIT_BRANCH && gbp buildpackage -us -uc'
sh 'gbp buildpackage'
}
archiveArtifacts allowEmptyArchive: true, artifacts: '*.gz,*.bz2,*.xz,*.deb,*.dsc,*.changes,*.buildinfo,lintian.txt'
archiveArtifacts allowEmptyArchive: true, artifacts: 'build-area/*.gz,build-area/*.bz2,build-area/*.xz,build-area/*.deb,build-area/*.dsc,build-area/*.changes,build-area/*.buildinfo,build-area/*.build,build-area/lintian.txt'
}
}
@ -28,10 +19,7 @@ pipeline {
}
steps {
script {
sh 'echo Dummy line to remove once something actually happens.'
/* No crendentials yet.
sh 'rsync -avP bkctld* droneci@pub.evolix.net:/home/droneci/bkctld/'
*/
sh 'rsync -avP build-area/bkctld*.deb build-area/bkctld*.changes build-area/bkctld*.buildinfo pub.evolix.org:/srv/upload/'
}
}
}

View file

@ -1,35 +0,0 @@
kind: pipeline
name: default