# Bare metal Linux, Ubuntu, and Docker: Which isetup is best? **URL:** \ **Category:** Node Operators\ **Tags:** docker, linux, hardware\ **Created:** [June 30, 2024, 8:48am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877 "2024-06-30T08:48:39Z")\ **Posts on this page:** 19\ **Page:** 1
**Author:** ![lookitsbenfb](https://storj.bcdn.literatehosting.com/letter_avatar/lookitsbenfb/32/5_5575768a8748004e209b776fc1b2916d.png) [@lookitsbenfb](https://forum.storj.io/u/lookitsbenfb)\ **Post date:** [June 30, 2024, 8:48am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/1 "2024-06-30T08:48:39Z")
In [another post](https://forum.storj.io/t/what-you-wished-youd-known-when-you-started-a-summary/26863), I’m in the process of compiling best practice based on users’ feedback, and there are a few issues which I’m trying to ascertain whether they are simply based on personal preference, or if they are actually grounded in fact. One of which is the base setup: I don’t even know the correct way to phrase this, but I’m trying to understand which is best, I think these are the options, but please correct me if I’m wrong: 1. Bare metal Linux installation, no Docker 2. Bare metal Linux WITH Docker 3. Ubuntu (or similar) with Docker So, I’d love to open up the debate here: Firstly, it would be really helpful to me (and hopefully others, I’ll include it in the best practice summary) to understand the first principals: how each of these interacts with Storj. Then, subsequent to that: what are the pros and cons of each, and how should a new user determine which setup is best?! Thanks! ---
**Author:** ![Mitsos](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/mitsos/32/1125_2.png) [@Mitsos](https://forum.storj.io/u/Mitsos)\ **Post date:** [June 30, 2024, 9:06am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/2 "2024-06-30T09:06:58Z")
I’ll start the debate with the baremetal pros and cons: ## Pros - Easy to setup and forget. There isn’t any fiddling you need to do with it to get it to run properly. - Easy to scale up. You copy the systemd service file, change the user/group/path and you have another node (after you generate a different identity of course) - Easy to properly keep up-to-date. You don’t have to worry about a version downgrade nuking your node while you are at work and can’t deal with it. You update when you want, it stays on that version for as long as you want (=as long as it’s not below the minimum version). - No overhead whatsoever. You run the node as fast as your host system can. - Configuration changes are just a config file edit and a service restart. ## Cons - Requires a bit of knowledge. As long as you can use adduser, edit a file, cp, mv, you can get it running. ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 30, 2024, 9:11am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/3 "2024-06-30T09:11:37Z")
> [@lookitsbenfb](#): > > Bare metal Linux WITH Docker You can install and run docker for other services like grafana but because you want to be the fastest node for winning the long tail race you better don’t run the storagenode in docker. Even with networking host setting it still is a latency penalty. A small one that shouldn’t matter to much but why not avoid it? ---
**Author:** ![ACarneiro](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/acarneiro/32/1129_2.png) [@ACarneiro](https://forum.storj.io/u/ACarneiro)\ **Post date:** [June 30, 2024, 9:48am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/4 "2024-06-30T09:48:43Z")
Is that latency penalty relevant, though? My nodes are running on docker and I’m still seeing success rates consistently in excess of 98%. I would suspect there are other considerations that are far more relevant for race wins than the docker latency, surely? ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 30, 2024, 9:51am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/5 "2024-06-30T09:51:53Z")
Try it out. Setup a node outside docker and test if it might get you to 99% success rate. ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [June 30, 2024, 2:14pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/6 "2024-06-30T14:14:46Z")
I don’t care about tiny differences in success rate. The reason for migrating my nodes to bare metal is storj’s update policy for docker. Waiting weeks for a much-needed bug fix to be deployed is unacceptable. ---
**Author:** ![ACarneiro](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/acarneiro/32/1129_2.png) [@ACarneiro](https://forum.storj.io/u/ACarneiro)\ **Post date:** [June 30, 2024, 2:20pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/7 "2024-06-30T14:20:04Z")
The other thing I like about the docker option is the “portability” of the nodes. I can move a self-contained HDD with all the node data from one machine to another and all I need to do is a docker command on the recipient end. 🤷🏻‍♂️ ---
**Author:** ![Ambifacient](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/ambifacient/32/7815_2.png) [@Ambifacient](https://forum.storj.io/u/Ambifacient)\ **Post date:** [June 30, 2024, 2:24pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/8 "2024-06-30T14:24:00Z")
You will need to manually update the node using bare metal, and you can do the same with docker so I am confused with this sentiment. ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [June 30, 2024, 2:29pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/9 "2024-06-30T14:29:55Z")
> [@Ambifacient](#): > > and you can do the same with docker How? Please enlighten me. 🤔 ---
**Author:** ![Ambifacient](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/ambifacient/32/7815_2.png) [@Ambifacient](https://forum.storj.io/u/Ambifacient)\ **Post date:** [June 30, 2024, 2:33pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/10 "2024-06-30T14:33:33Z")
I have an example here: > [@How to force update to 1.104.1? (docker)](https://forum.storj.io/t/how-to-force-update-to-1-104-1-docker/26160/16): > > If you are running docker on linux, this is pretty easy to do, since storagenodes are packaged as binaries, so we simply overwrite the storagenode binary inside /app in the container, and then restart the container. For example this pulls a specific version from Github: #!/bin/bash VERSION=v1.104.1 CONTAINER=storagenode\_satet\_d1n2-node-1 ARCH=$(docker exec $CONTAINER printenv GOARCH) cat \<\ **Author:** ![mattventura](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/mattventura/32/7831_2.png) [@mattventura](https://forum.storj.io/u/mattventura)\ **Post date:** [June 30, 2024, 2:39pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/11 "2024-06-30T14:39:00Z") I’m assuming you meant “VM” in opposition to “Bare Metal”. Ubuntu is just another Linux distribution. Docker is just significantly easier to manage, especially for multiple nodes. A docker-compose file is far cleaner than any other setup. For example, if I want to change my payout address for all of my nodes, I change one line in the file, run a single command, and that’s it. If you use VMs for multiple nodes on a single box, then the additional overhead of that is probably going to kill any miniscule performance gain you could hope to squeeze out by not containerizing the node. You can also use Docker inside of a VM so that you only get the overhead of a single VM rather than multiple. You can optimize the performance of this by passing through an HBA and NIC (or a VF) directly to the VM, giving it close to baremetal network/storage performance. ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [June 30, 2024, 2:43pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/12 "2024-06-30T14:43:23Z")
Thanks @Ambifacient. TrueNAS Scale seems to be not plain vanilla docker but I will give this a try. ---
**Author:** ![jammerdan](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/jammerdan/32/1121_2.png) [@jammerdan](https://forum.storj.io/u/jammerdan)\ **Post date:** [July 1, 2024, 3:59am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/13 "2024-07-01T03:59:24Z")
I have them on Docker and they are easy to setup and manage. But Docker sometimes has some nasty issues where it cannot stop a container and needs a Docker restart itself or even a reboot. I think at some point I will move my nodes to bare metal but not yet. There are other issues that needs to be solved first. ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [July 1, 2024, 4:22am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/14 "2024-07-01T04:22:35Z")
The suggested procedure to force a docker upgrade did not work for TrueNAS Scale. I ended up replacing the storj version info server with my own one (VERSION\_SERVER\_URL). ---
**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\ **Post date:** [July 1, 2024, 7:44am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/15 "2024-07-01T07:44:42Z")
It would be even more convenient, if you would use a `docker-compose.yaml`. I’m store it on a smallest node’s HDD. ---
**Author:** ![salna](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/salna/32/9578_2.png) [@salna](https://forum.storj.io/u/salna)\ **Post date:** [July 1, 2024, 9:45am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/16 "2024-07-01T09:45:31Z")
I’m running lxc container without docker. ---
**Author:** ![salna](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/salna/32/9578_2.png) [@salna](https://forum.storj.io/u/salna)\ **Post date:** [July 1, 2024, 9:48am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/17 "2024-07-01T09:48:14Z")
I never got proper running TrueNAS storj app all the time was a problem with QUIC. ☹ ---
**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\ **Post date:** [July 2, 2024, 7:52am UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/18 "2024-07-02T07:52:42Z")
Hello @salna, Welcome to the forum! You may ignore this problem, since > [@QUIC misconfiguration in v1.86.1](https://forum.storj.io/t/quic-misconfiguration-in-v1-86-1/23610/25): > > There hasn’t been any progress on those QUIC bugs. It’s considered low priority because apparently uplinks quite rarely use QUIC in production. I suppose we’re recommending not to worry about what the dashboard says about your QUIC status for now. But usually it affects either a FreeBSD or ARM systems (do not ask me why). If you have a AMD64, you just need to check that’s everything correct: > **[Step 4. Configure QUIC - Storj Docs](https://docs.storj.io/node/get-started/quic-requirements)** > > Make the world your data center ---
**Author:** ![arrogantrabbit](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/arrogantrabbit/32/11200_2.png) [@arrogantrabbit](https://forum.storj.io/u/arrogantrabbit)\ **Post date:** [November 5, 2024, 4:35pm UTC](https://forum.storj.io/t/bare-metal-linux-ubuntu-and-docker-which-isetup-is-best/26877/19 "2024-11-05T16:35:58Z")
> [@Mitsos](#): > > Requires a bit of knowledge. I’d argue this requires less knowledge than using the docker. Storagenode has extensive help, it’s already self-contained executable with no dependencies, and you don’t need to fight against container orchestrator. The best way is always the one that involves fewer layers. > [@littleskunk](#): > > Try it out. Setup a node outside docker and test If you are running docker specifically on windows or macOS then you have a VM in between. Of course everything will be horseshit. Containers on the OS have no computational overhead, they share kernel with the host. There is no difference literally. > [@Ambifacient](#): > > You will need to manually update the node using bare metal No, you run storagenode updater to take care of that. > [@pangolin](#): > > docker but I will give this a try I can’t comprehend why is everyone so hell bent on docker. Advertising? It’s a commercial, shitty solution. There are other containerization solutions that are lower overhead and much better. Read about podman. It literally generates systemd wrappers for you, it does not have a daemon, etc. Edit. I just realized it’s an ancient thread… sorry for muddying the water. I got misled by helpful discourse again.