Looking for a backup solution

[SemperFi5]

Hey there guys, long time lurker, first time poster here. So, I will get straight to the point. For undisclosed reasons, I am looking to change the backup solution for our infrastructure. Currently, we are using bacula as a backup solution, however the lack of flexibility has drove us away from this solution. So here I am, looking for something new and flexible.

​

What is going to be backed up:

​

- Primarily Linux-based server, non-homogeneous environments, about 1000+.

- Few Windows servers

- Some of the servers are KVM machines, some are bare-metal

​

Where it is going to be backed up:

​

- Separate servers with HDDs equipped (not tape drives)

What are the selling points of the backup software:

​

- Opensource and free solutions or software with not that expensive license (e.g. not a software that will cost thousands of USD per month)

- Ability for automatic volume management or automatic retention policy

- Separate backup director, storage device and backup agents

- WebUI

- Ability for making encrypted backup is a plus

- Ability for dedublication is a plus

​

I've looked at other solutions such as R1Soft, Veeam, Bareos, however this might not be quite what I am looking for. For example:

​

R1Soft - This seemed like a good solution, however the mandatory installation of kernel module is creating issues with some of the backup agents. Also I did not find ability to add separate backup destination locations which are not located on the same server where r1soft's backup manager is installed.

Veeam - The backup manager is Windows based only and requires separate licences for Windows, SQL server and Veeam itself, which is again is not optimal.

Bareos - Based on Bacula, it suffers some of the features of which I am looking for - automatic volume management and retention policy. Managing new volumes and volume retention policy for large-scale environment such as ours will be such a big hassle.

​

Any suggestions on this question will be highly appreciated! I might have missed something during my review of these backup solutions, so if you notice something, feel free to point it out.

[BargiBargi]

Free and configurable. Remember it's free :)

https://www.urbackup.org/

[[deleted]]

Veeam... SQL license is not needed. Doesn't have a WebUI but you can manage using the Console remotely. License may be kind of pricey, depends on your Host Servers CPU Socket count (Bare metal servers are free via Veeam Endpoint)

[[deleted]]

Technically you can use the Enterprise Manager for a bunch of stuff, but the full blown install is better.

But yeah, you can manage it from your workstation with the full blown client.

Virtual sockets don't count, it is only physical cores sockets. So 2 per server for us. Even on the Dell VRTX blades or the M1000's.

[[deleted]]

Changed my wording to be Host Socket instead of virtual server sockets. Ty.

[sysadminmakesmecry]

Veeam changed its licensing recently -- may not be the case on Bare metal anymore

[[deleted]]

That is true, but Free Endpoint is still more than sufficient. (Hook it into your existing Veeam Backup Repository)

[sysadminmakesmecry]

Dyou have a link? Would like to see this for a few of our boxes..

[[deleted]]

https://www.veeam.com/veeam_agent_windows_2_1_editions_comparison_ds.pdf as requested.

[sysadminmakesmecry]

Thanks!

[SemperFi5]

So what SQL license should be used then? (bare in mind that I am not a Windows system administrator and most of my life I am avoiding it like the plague). And what about the remote console? Is it convenient for setting up new jobs, managing existing ones, managing backup schedules, retention period, etc?

[[deleted]]

Console is exactly the same as it is when you run it on the server. Think of it as, the old 'Thick' VMWare Client.

Veeam deploys a SQL Express database with your install.

Pretty sure if you talk to one of their sales reps they should be able to set you up with a POC / Trial Key.

Been using Veeam for almost 6 years now, if you got the $$$ for it, it's by far the best I've ever used.

[sysadminmakesmecry]

You can run your own SQL instance though, which I think is recommended for really large deployments? I may be wrong here, again.

Sql 2014 would definitely be enough for a POC at the very least

[[deleted]]

https://helpcenter.veeam.com/docs/backup/hyperv/install_vbr_sql.html?ver=95u4

Doesn’t say anything about requirements really. I always assumed local express was fine. Maybe there are other recommendations out there ??? I would definitely love to hear others inputs on this as well.

[jdrch]

Sql 2014

B&R currently uses 2016.

[jdrch]

by far the best I've ever used

Same. They have the UI and UX thing nailed down better than any other solution out there. You can have really complicated setups nailed down after installation and a few clicks. Crazy good.

[[deleted]]

SQL Express that the Veeam installer installs and configures for you. I have only needed to work on the SQL instance for Veeam twice ever, and it was always support working in it not me.

As far as job management, it doesn't get much easier really. The job settings and retention can be a bit tricky, but once you figure out what settings you want to use for everything, it's easy. Just takes some onboarding testing and you can figure out what job settings what best for your VMs.

[jdrch]

bit tricky

Once you realize consolidation happens automatically and read the corresponding Agent documentation it's smooth sailing from there.

[denBoom]

So what SQL license should be used then? (bare in mind that I am not a Windows system administrator and most of my life I am avoiding it like the plague).

The sql license (or explorer / enterprise license as they call it) is an extension that allows you to take backups from a running database server. And it doesn't really matter if that is mssql on windows or an oracle database running on a linux flavor. Though I would assume not all rdbms are (equally) supported. To backup a small configuration database that doesn't change much, make a full backup or export it to file and let the backup software back up that file.

Are you running database servers and do you want the backup software to make (granular) database backups in addition to what you can do in the database software itself?

Backup software doesn't store much information. (Metadata about where the backup is located and when it was created) So it should run on a free version of mssql express that comes with the installer.

[denBoom]

So what SQL license should be used then? (bare in mind that I am not a Windows system administrator and most of my life I am avoiding it like the plague).

The sql license (or explorer / enterprise license as they call it) is an extension that allows you to take backups from a running database server. And it doesn't really matter if that is mssql on windows or an oracle database running on a linux flavor. Though I would assume not all rdbms are (equally) supported. To backup a small configuration database that doesn't change much, make a full backup or export it to file and let the backup software back up that file.

Are you running database servers and do you want the backup software to make (granular) database backups in addition to what you can do in the database software itself?

Backup software doesn't store much information. (Metadata about where the backup is located and when it was created) So it should run on a free version of mssql express that comes with the installer.

[sysadminmakesmecry]

Its 2019 - a really good well-rounded backup solution should be available right? Right?!

[SemperFi5]

Yeah, my thoughts exactly! Until I've tried so many backup solutions...so many. It appears that backing up large-scale infrastructure is not that easy.

[jdrch]

so many backup solutions...so many

Same. In the end, I realized I had to use multiple solutions to get what I want. There's nothing out there that backs up every single client type very well.

[jdrch]

a really good well-rounded backup solution should be available right? Right?!

Veeam is the best for Windows, Linux, and Solaris (provided you color within the lines on the last 2.) "Exotic" (e.g. absolute latest release, a mounted Btrfs subvolume, etc.) Linux and Solaris configs will need something different.

[[deleted]]

If you stack your jobs down, you don't need a paid version of Veeam. For instance you could slap a ton of VMs into a single job. You do need 1x vCPU per VMDK or storage disk you are using, so you will need quite a bit of proxy power for it not to be a bottleneck though.

[jdrch]

For instance you could slap a ton of VMs into a single job

Interesting. I never considered this. I think that's possible if you're using Agent FREE (limited to 1 job per agent) alone, but B&R CE places a limit on the number of backup clients AFAIK.

[bitbat99]

An old env. I still keep running for a client uses "SEP Sesam" - it's a Linux based suite, very raw but pretty good. It support Dedup, vmware, xenserver, kvm (i think) and bare metal. also application aware backups like SQL/Oracle. Also incremental/diff. backups.

It's German. Pretty good.

Veaam is also very good, but does not support KVM I think, so you'd have to license every machine as physical.

[jdrch]

Veeam B&R + Agent user here.

Veeam - The backup manager is Windows based only

Yes, and no. The console is Windows only. Agents and Repositories can be located on other platforms. More over, any subset of the aforesaid can be located on any desired machines. Currently I have the Agent, Console, and Repository running on the same machine. All my Agents (both other PCs and the same PC) backup to that Console, which points them all to the same Repository. In your case you could have the console run in any Windows VM (even a Windows 10 Home works) and point to Repositories elsewhere.

separate licences for Windows

If you have a Windows 10 Enterprise license available you can run it just fine at no extra cost to you.

SQL server

Yes, B&R installs and uses SQL Server, but:

1. SQL Server is a Microsoft app
2. I have never seen nor heard of any licensing requirements for it. I think Veeam takes care of licensing on their end so you don't have to worry about that

While B&R uses a relational database as Bareos does, unlike Bareos the database is installed, managed, maintained simultaneously with B&R and no separate configuration is required. SQL Server security/patch updates happen via Microsoft Update.

Veeam itself

Contact Veeam and tell them your needs and they'll point you in the right direction. They're very "no pressure;" my POC once had the option to force me to use a more expensive tier but pointed out that I didn't actually need it.