1

Homelab nerds, unite!

 1 year ago
source link: https://changelog.com/friends/9
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

Transcript

šŸ“ Edit Transcript

Changelog

Click here to listen along while you enjoy the transcript. šŸŽ§

So weā€™re here with Techno Tim. Do people call you Tim, or do they call you Techno? Is Techno your first name and Tim is your last name? Whatā€™s the deal here?

Oh, wow. Tough questions first. So people call me Tim. I think sometimes people call me Techno Tim. Actually, in college people called me just Techno, and itā€™s a kind of a long story, butā€¦

Yeah, yeah. In college, everyone just called me Techno. That was my name. Because in college, I used to play electronic music really loud in my dorm, and everyone said, ā€œHey, that guy plays techno music.ā€ My RA always had a bullet point in our weekly meeting to say ā€œTim, turn your techno music downā€, so my neighbor Gary, a hockey player, just started calling me Techno Tim. And ever since then, thatā€™s what I went with. That was my handle for gaming and everything, so I when I started the YouTube channel, I thought ā€œHey, why not?ā€

Iā€™m a listener and watcher, I suppose, of your YouTube channel. For the first time today I was like ā€œLet me go back as far as I can on this channel, to be like ā€œWhen did this guy begin?ā€ Because Iā€™ve been paying attention for a while; Iā€™d say at least about two years, maybe a year and a half, to your content. And I went back, and Iā€™m like ā€œThis dudeā€™s a gamer!ā€ Because your earliest stuff is gaming stuff, for five years. Youā€™ve been doing YouTube for like five years, but three of it has been just straight-up gaming. I donā€™t even know if you talk on there, or what youā€™ve done, but I caught a couple just to kind of see what you were doingā€¦ But now it makes sense why youā€™re called Techno Timā€¦ Because thatā€™s been your handle, and you were a techno music player, which - I like techno too, you know? Itā€™s good stuff. EDM, all that good stuff.

Yeah, yeah. Iā€™ve always liked electronics, back in the day, I should sayā€¦ But everyone called everything electronic techno, so thatā€™s what stuck. But it was more just EDM, just kind of chill-out music, too.

Trance, breakbeats, houseā€¦

Yesā€¦ I donā€™t know how old you are, but that goes back to my day. I was born in ā€™79, I lived in Orlando for a little bit, so I got to be steeped in some of the local folks thereā€¦ Digweed came to townā€¦

Yeah. I havenā€™t heard that name in a long time.

Yeah. Sasha, Digweed, Deep Dishā€¦ Thatā€™s like my era. Theyā€™re still around, but theyā€™re just not as cool. Then it became like Tiesto, and stuff like thatā€¦ So there you go. So homelab - letā€™s get into the innards of homelab. I think I have an idea of what homelab means to me. Now, you obviously have a YouTube channel thatā€™s primarily focused on homelabby things; I think mostly homelabby things. So how do you define a homelab? What exactly is a homelab to you, Tim?

Yeah, it means so many different things to so many different peopleā€¦ But for me, I try to bundle it all up into having an environment, whether that be virtual, physical, but just having an environment where you can tinker and play around with technology, without the fear of breaking things, or taking down a production environment. A lot of people that get into homelab are in IT, and so they inherit this environment from their enterprise, and they inherit this architecture from their enterpriseā€¦ And they donā€™t get to tinker much outside of that. Youā€™re playing in someone elseā€™s playpad, so to speak.

[04:01] And so with homelab, you can build up this environment and this architecture and explore things in your own environment, without asking for permission or bringing anything at work. So Iā€™ve always bundled it up into this environment where you can play with stuffā€¦ And then itā€™s multifaceted. Like, some people consider virtual machines on their desktop their homelab. Totally fine, I totally agree. A virtual environment on your desktop? Sure, why not? Some people think itā€™s a server rack full of stuff. It absolutely could be, like the one behind me. Or just a couple of Raspberry Piā€™s, or even one Raspberry Pi. Absolutely. It could be. But really just an environment. And it has many tentacles from there. It could be networking, it could be focused on hardware, it could be focused on storageā€¦ Thereā€™s just so many ways to go.

Yeah. So I tried to think about this ahead of time. I was like ā€œOkay, what do I thinkā€“ā€ Because I agree with everything you just said too, and I try to play it from my perspective, so software developer/product manager, now podcaster around softwareā€¦ Iā€™ve been doing it for 14 years just on this channel alone, but really have been podcasting for almost 20 years. So Iā€™ve talked to almost everyone in tech over the years. Not literally everyone, but weā€™ve talked a lot of different angles around how software is developed since 2009, so weā€™ve really eked it all out. And over that journey, I primarily focused on software. Iā€™ve always had my own dev environmentā€¦ And that was always a version of not so much homelab stuff, but like it was my single-machine, single-node environment that I had to mess with. Iā€™ve always been on a Mac in most cases, so thatā€™s Homebrew, thatā€™s CLI stuff, thatā€™s setting up Ruby back in the day, then itā€™s JavaScript, then itā€™s Node.js, then itā€™s npm, then itā€™s web environments, then itā€™s Elixirā€¦ Because our stack for Changelog.com is Elixir-based. Itā€™s a Phoenix application. You know, obviously GitHubā€¦ All those things have been like not homelabby stuff, but like the software developer things. But then I was like ā€“ I really didnā€™t get into home networking until aroundā€¦ I think I got my Unifi set up ā€“ that was really what got me further into just typical [unintelligible 00:06:08.24] was never easy to use. I was never a network person. But for me, it began ā€œHow can I set up a better home network?ā€ My wife is upset because Wi-Fi sucks in the bedroom, okay? That was ā€“ you know, I got into web development because my mom was like ā€œAdam, youā€™re really good at it. You should just keep doing this stuff.ā€ Iā€™m like ā€œMom, this is just a hobby.ā€ Sheā€™s like ā€œNo, you should just keep doing it. Youā€™re really good at it.ā€ And so now my wife is like ā€œHey, Wi-Fi sucks. Can you make it better?ā€ Iā€™m like ā€œWell, I guess I can tryā€¦ I donā€™t know how to do it. I make software for a living, and I build software for a living, I run software podcastsā€¦ But I donā€™t know how it really works.ā€ And so I studied it, and I learned. So for me, it was like a better network; how can I make Wi-Fi suck less in our house? Now I have multiple machines, Iā€™ve got to move data around the house, so now Iā€™ve got to understand true Ethernet-based networking. I understand ā€“ you put a cable into the wall, you get internet from a modemā€¦ But then I started to get really, really curious, and thatā€™s really kind of where the fun began for me as someone who was steeped in software, but then sort of like had to eke into the network world, to some degree. And then it was like multiple machines, and services, and like oh my goshā€¦ So yeah, as you said, the tentaclesā€¦

Yeah, yeah. Funny, my story is the opposite. So I am a software engineer by trade; thatā€™s kind of my day job. Things have changed a little bitā€¦ So I started out in infrastructure. I mean, the first time I ever learned about networking was trying to get my brotherā€™s PC connected to my PC, so we could play NBA Live ā€˜98, or something, over the network. And I remember ā€œOh my gosh, static IPsā€¦ I have no idea what Iā€™m doing.ā€ Iā€™m just typing in whatever Yahoo! told me to type in at the timeā€¦ And I remember seeing on our hub the network lights flashing, and we could play two players at the same time, even though our bedrooms are right across from each other. And I remember just like almost welling up in tears, because it was like ā€œOh, my gosh, we did it.ā€

[07:58] But anyway, so I started out in infrastructure. I kind of have a background in infrastructure, but started out in tech support, did server administration, did some networking stuff, and so I built up that way. And then I became a software engineer, within the last 8-9 years. So I kind of had that background, and then I got into software development, and I think that was a good play for me, because it taught me a lot about networking infrastructure, some of these core tenants of just running servicesā€¦ And then later on to build software. So I built apps, I built websites, Iā€™ve worked for large companies, startupsā€¦ And that taught me a lot about infrastructure.

And so after I became a software engineer, I started missing ā€“ like, I used to tinker with this stuff all the time at home, and I realized I wasnā€™t doing that as much anymore. Thatā€™s really how I got back into homelab, because I wanted to network stuff. I mean, Iā€™ve had a server in my closet, quote-unquote, for a long time, whether itā€™s running a small website, or a media serverā€¦ Iā€™ve done it for a long time.

Anyways, getting back into running services and software at home - at home now I have a full Kubernetes stack. I write my own code, I deploy it, I build it in containers, I ship it to my own Kubernetes stackā€¦ And itā€™s all self-hosted here at home, in my homelab. Youā€™re kind of abusing the term homelab as soon as you get into self-hosting production at home, but a lot of people do, I think, still call it homelab.

I still call it home ā€“ if itā€™s in the house, itā€™s a homelab, Timā€¦ Right?

I agree. Iā€™m there. Iā€™m there with you.

But itā€™s just more layers of sophistication, in my opinion. You can start small, like I did. I was trying to share my journey, to some degree, because itā€™s about curiosity.

You may not even really be like you were, in infrastructure, or even like I was, more in softwareā€¦ And then, I think for anybody, itā€™s usually the dad or the guy in the home thatā€™s like ā€œHey, Wi-Fi sucks.ā€ Or at least thatā€™s my stereotypical opinion. It may not be super-accurateā€¦ But itā€™s like ā€œWell, thereā€™s somebody thatā€™s curious about home automation.ā€ Thereā€™s somebody who cares about ā€“ okay, for example, in my home I can say ā€œliving room onā€ and the Apple TV will arc wake up my TV and turn on the living room TV. Or if the kids are upstairs in the family room, and Iā€™m like ā€œHey, kids, itā€™s time for lunchā€, or dinner, or whatever, if itā€™s the weekend, or itā€™s dinnertime, and theyā€™re not listening, Iā€™m like ā€œOkay, family room offā€, and the TV turns off. My watch probably is gonna start yelling at me here in a secondā€¦

Start to light up?

Yeah. So itā€™s like, that was cool. And then you kind of have certain things you want to do in your home, or even like NFC stuff, where you want the temperature changed because youā€™re close to the thermostat. Thereā€™s all sorts of little things that I think are homelabby. Thereā€™s home automation and smartness that I think is a blend of homelab. It may not be exactly that. And then youā€™ve got things like Plex. For me, Plex was a big deal to get into homelab. I was working with 45Drives a couple of years ago, got an AV15 that helped me learn a lot more about Linux, a lot more about ā€“ everything about ZFSā€¦ And then what it would actually take to basically tear that machine down and rebuild it in a way that was more Plex-friendlyā€¦ Because it had a Xeon processor that did not have QuickSync, andā€¦ Okay, I was like ā€œWhy in the world every time I transcode Iā€™ve got this beefy Xeon processor? Why does transcoding not work?ā€ I didnā€™t understand it. Then I learned, ā€œOkay, it really relies on QuickSync.ā€

And so you learn these things with each failure or learning point along the way. But Plex was a big deal, learning ZFS was a big dealā€¦ And then when I kind of got past that intimidation factor, I was like ā€œOkay, I donā€™t know anything really about Linux.ā€ I mean, Iā€™ve played with Linux, Iā€™ve deployed Linux servers, Iā€™ve got WordPress on Linux in DigitalOcean dropletsā€¦ And thatā€™s fun. But I followed a tutorial. I didnā€™t learn truly what it meant to be zero to Linux, running Linux, managing Linux, keeping it updated, keeping it secure, firewall, all those fun things.

[11:57] And so over time, Iā€™ve learned little by little more and more, through curiosity. And we kind of all come into this ā€œhomelab worldā€ from different areas. Do I need a rack full of gear? No, not necessarily. But if you have one, itā€™s still a homelab; if youā€™ve built your own Kubernetes high-availability cluster and you deploy your own software to it, thatā€™s still homelab too, Tim.

Yeah, thank you. Like I said, it means so many different things to so many different people. I think DIY in general encapsulates a lot of homelab. It doesnā€™t mean DIY like I built a shelf from wood and I hacked an IKEA rack, and now Iā€™m putting servers I got from a secondhand market. It could be as simple as ā€œHey, I may have a UniFi switch, totally fine. But you know what? This is my DIY PC that I converted to a server, and now Iā€™m installing and learning things about it.ā€

I think anything kind of DIY, or ā€œIā€™ll do it myself, or assemble it myself, or even configure it myselfā€ is really what encapsulates a lot of homelab, the spirit of homelab. I think you find a lot of people who like to save money, like to configure things, like to adapt things like, to bend things to their willā€¦ And I just love that about it. Anytime I talk to someone whoā€™s using something I learned, either a way that theyā€™re doing it that I havenā€™t thought of before, or theyā€™re doing something with it that I didnā€™t think was possible, which both are awesome.

Yeah, precisely. And you donā€™t have to have a full rack of gear. I even like repurposing. Iā€™m not not trying to save money necessarily, but I want ā€“ I tend to be the person who upgrades myself, Tim. So if I go to buy a car, they donā€™t have to talk me into like the nicest thing. Iā€™ve already pre-selected ā€“ Iā€™m actually coming to the lot to buy, not to look, in most cases. So Iā€™m that kind of person just generally. But I like the idea even of like repurposing that old PC to some degree, and just finding out how to truly, like you said, bend it to your will, and be able to do something with it.

Letā€™s dig into the stack, I suppose. Whatā€™s your chosen homelab stack? I mentioned UniFi was my gateway drug, to some degree. I literally bought some UniFi gear, and it sat there for months, at least two or three months, because I was just intimidated. Iā€™m like ā€œI donā€™t even know where to begin.ā€ I think I was watching Crosstalk Solutions, and Iā€™m like ā€œThank God that guy told me how to set it up the first timeā€, because this was like four or five years ago. Maybe four years ago or so. Iā€™m like, I donā€™t even know what to do with it. I got the boxes, and UniFi is notoriously not really good with like documenting how to do anythingā€¦ Itā€™s like ā€œHereā€™s the stuff. Itā€™s great. Just go figure out how to do it.ā€ And Iā€™m like ā€œI donā€™t want to do.ā€ Iā€™ve got this cloud key, I donā€™t even know what POE really meansā€¦ Iā€™ve got the USG, Iā€™ve got the cloud key, and Iā€™ve got a switch. Okay, thatā€™s what I need. I didnā€™t even know I needed an access pointā€¦ Iā€™m like an idiot, really, getting into this. So I mentioned UniFi was my gateway drug. What is your homelab stack? Where do you begin with your stack? Is it UniFi all the way up? I mean, how do you choose what your stack is?

Yeah, itā€™s changed over time. At first it was a lot of DIY solutions like pfSense. I was like ā€œOh, Iā€™ve got an old PC.ā€ I was really big of upgrading myself and handing those things down to my homelab. So that was a big part of my early days of homelab - I am going to upgrade my current PC, and then my old PC is going to become a new homelab PC. So I would basically hand me down this hardware to myself, and so I did that for a long time.

So I really got into pfSense for a long time. I tried a lot of software firewalls, open source software firewalls for a really long time. And then just recently, Iā€™ve been getting into UniFi stuff. And donā€™t feel bad about UniFi, I did the same things. Yeah, I looked at Crosstalk Solutionsā€¦

Paramount, right?

[15:51] Yeah. This guy on YouTube, [unintelligible 00:15:51.20] taught me how to do VLANsā€¦ So yeah, itā€™s totally fine. And so yeah, my network core now is UniFi. And it is a gateway, and it is a black hole, because once you start realizing ā€œOh, right behind me here I have an old switch that was downstairs in my big rack.ā€ And so I upgraded that switch with this switch up here, and then realized thereā€™s a bunch of these POE switches. Why would I want a POE switch? I thought Iā€™d never need thatā€¦ And then I was like ā€œOh, I want VLANs for the devices in my living room. So Iā€™ll plug in a little mini POE switch that powers from my big switch, and then I get three additional switches to plug my Xbox, to plug my TV, and plug everything else in, so they can be on different VLANs, or cameras, or what have you.ā€

So my network core almost ā€“ yeah, 100% UniFi. Access points, everything; switchesā€¦ All the way down UniFi, just because I like a single pane of glass to manage both the network, the firmware, and then the other pieces of the ecosystem. And so having one pane of glass for me is huge. And donā€™t get me wrong, I still run a version of pfSense in my homelab, virtualized, for testingā€¦ But having an easy way to update my cameraā€™s firmware - awesome. To update any of my devices firmware - totally awesome.

Yeah, you donā€™t waste your time, right? Keep it simple.

Thatā€™s right. And push out VLANs, and one can add a VLAN somewhere, it pushes that out to every device; I donā€™t even need to think about it. And so thatā€™s become valuable to me. Huge time saver. And not to mention, their apps are so good. Their apps on iPhone, Android, tablets, everything - they are so, so good. And even their web-based ones. Anyways, this is not a UniFi commercial, but Iā€™m a huge fan of them.

It is a UniFi commercial, Tim. I concur, because Iā€™m UniFi all the way down too, from the cameras, to the switches, toā€¦ I mean, I just ā€“ for the same reason; I watched your VLAN video, and Iā€™m like ā€œOh, I should do VLANs, because ā€“ā€ Long story short, I was building a new home, and so I just recently moved into it, and Iā€™m like ā€œWell, Iā€™ve got like three or four months until this thing is done, so Iā€™ve got my gear right here doing nothing, because Iā€™m not in the home nowā€¦ I should set up my future network. It should just be like when I get there, just plug it in and it works.ā€ Because what will often happen is youā€™ll get to the home, or move somewhere if thatā€™s the case youā€™re doing, and then youā€™ll be like ā€œNow I should do all the setup.ā€ Iā€™m like ā€œI can do all this preparatory.ā€ And then I saw your video on VLANs, and Iā€™m so intimidated by VLANs. I donā€™t even know how to do themā€¦ And Iā€™m still stuck, honestly. I had to flatten it out, because like I had one device that couldnā€™t talk to the otherā€¦ Iā€™ve got Sonos in my house, and I wanted the Sonos to be on the IoT VLANā€¦ And then my app on my iPhone could not talk to it. I was on my main trusted network, and it couldnā€™t talk. So Iā€™ve sort of abandoned the VLANs temporarily until I figured out my firewall issues. Iā€™ve got some passthrough concerns.

I know thereā€™s two settings. I know what they are. Thereā€™s two settings. MDNS is one. Thatā€™ll probably solve all your problems.

MDNS itā€™s called.

Okay. So I hit that brick wall, but Iā€™m like ā€“ I wanted to do VLANs, and have all this up. I know I should do these thingsā€¦ I mean, should and shouldnā€™t; itā€™s about security and concerns. I think Iā€™m okay for now, but long-term I want to be betterā€¦ But yeah, same thing with the VLANs. If my access points ā€“ which I currently only have two installed, but Iā€™ll eventually have fourā€¦ No, I have three, and Iā€™ll eventually have five access points throughout the house. One on the back patio, one kind of in the garage areaā€¦ I happen to have like a workshop garage that just is in the driveway area, that just needs more Wi-Fi out there, because I did a whole mapping, and stuff like that. I have one in my office, and kind of two that serve the home. And if you VLAN, like you said, it just pushes those out to the access points, and the access points serve up all the wireless networks you decide to create. And Iā€™m like ā€œThat to me is easy.ā€ Thatā€™s why I like UniFi, because if I didnā€™t use UniFi, Iā€™m sure it would be more manual, and Iā€™d have to like copy the config, and SSH into the actual device, or something like that. It would be not quite as software-driven, where UniFi really has nailed that. So I donā€™t mind being commercial, because I love UniFi. I wish they would pay us, butā€¦ Maybe they pay you. They donā€™t pay me.

[20:02] [laughs] But yeah, and then, just to touch more on UniFi, tooā€¦ Because I used to do a lot of home security stuff myself. I ran Blue Iris, Iā€™ve run Frigate, Iā€™ve run lots of different solutions. And at the end of the day, I was using a lot of these no-name cameras, with weird firmware, with weird accounts I couldnā€™t delete from who knows whereā€¦ And so thatā€™s why I really decided to get into UniFi security too for a long time, and UniFi Protect for cameras, is because now I have these devices that are updated and managed by UniFi, by a company I trust, and I donā€™t need to go and search for firmware and have all these weird local accounts, and stuff like that. So yeah, huge fan of basically all of their product lines. I havenā€™t tried them all yet. I still want to try out their secure access stuff, butā€¦

Do you have a doorbell yet? Or do you use something different?

I do have a doorbell, and I realized they released the POE one now, and Iā€™m like ā€“

Oh, manā€¦ Guess what I just got? I have a new home, so I just got the POE switch, or the POE doorbell. Itā€™s not installed yet though, so donā€™t feel good or bad for me yet. Next Wednesday, my network people ā€“ Iā€™m going to have somebody else install it, because I have stucco on the front, and it needs to be kind of dug out, and Iā€™m like, itā€™s a new homeā€¦ I want them to do it. Iā€™ll manage the connection to the POE and Iā€™ll adopt it, but they can do the install of the actual hardware itself, so my home stays safe.

Yeah, huge fan of POE. I feel like theyā€™ve breathed new life into a technology thatā€™s been around for, I donā€™t know, 20-30 years, probably more. I mean ā€“

POE has been around for a really long time. I mean, even Cat 5e was supporting POEā€¦ And yeah, I mean, people have powered things over Ethernet for a really long time, and I feel like it was just this untapped market that UniFi is now like ā€œHey, weā€™re gonna power LED lights, camerasā€¦ Everything. Phones, you name it.ā€ And other companies have done it, too. Theyā€™ve powered phones, and stuff like that. But I feel like theyā€™re expanding their line of things they support with POE, and itā€™s just so cool to see. Because I have a 48-port POE switch in my basement. I went 48-port, all POE, because I want to power more things over POE. And then on top of that, thatā€™s on battery backup. So if my power goes out in my home, I can still run my POE switch for two hours, and that will still power access points. I donā€™t have phones, [unintelligible 00:22:17.04] back there, butā€¦ Cameras, and all of the things that I plug into that UniFi switch will still be powered. The switch is everything, so having battery backup, and not having the battery backup individual things, and worry about my security camerasā€¦ Itā€™s so nice. Such a relief to know that my switch is powering all these things in my home, so if something happens, theyā€™re still going to be online.

Okay. So we love UniFi; letā€™s put that downā€¦ They know that. UniFi - call either of us; weā€™ll gladly find ways to work with you. And weā€™ll potentially even bend over backwards to do it. So big, big fan. Iā€™ve given them lots of money, probably too muchā€¦ But itā€™s good gear, and I like it. Okay, so letā€™s go from network - probably Cat 6, if you can choose it; Cat 5e, unless you have an older home that you just couldnā€™t choose the wiringā€¦ Cat 6 will let you do 10-gigabit, which most people donā€™t really need, but itā€™s future-proofingā€¦ So if you can, why not, right?

Thatā€™s right. And Cat 5e will too, over short runsā€¦ But yeah.

Right. Itā€™s less reliable. Itā€™s still possible, but just not reliable, because of interference.

Thatā€™s right.

And then the long-run, too; the long-run is really what diminishes the speed. I run 10-gigabit on Cat6 easily in almost all cases. The switches - I always choose SFP+, because I want the interconnectivity between an aggregation switch, or the actual switchā€¦ I happen to have the rackmount [unintelligible 00:23:41.18] I believe; itā€™s the 16-port with all the SPFs, or SFPs, and then like the four RJ45sā€¦ I have that because I had a lot more 10-gigabit transferring. And now Iā€™m like ā€œYou know what? I can just wait a little longer.ā€ Itā€™s more about transfer than it is ā€œI need the actual speedā€, because Iā€™m really the only power user in our home. Everyone else is convenience. They donā€™t even knowā€¦ And probably the same for you - they donā€™t even know what youā€™ve really built for them. My kids are like ā€œDad, this is amazing. I love it.ā€ They never say that. They just watch the TV. They just watch whatever; they just have their iPad and do whatever.

They really have no clue that no matter where they go in the home, there is amazing Wi-Fi . They just enjoy it.

Yeah. No news is good news when it comes to networkingā€¦ Because if you donā€™t hear anything, that means everythingā€™s working. You hear it when things donā€™t work.

Right. And so from there, I think youā€™ve gotta establish some small machineā€¦ Like, for me Pi-hole is an absolute in my network stack. Iā€™ve got - UniFi is the network, protect, obviously, with cameras; those are sort of a given. So assuming youā€™ve got your network settled - VLANs, no VLANs, it doesnā€™t matter; youā€™ve got an established network thatā€™s strong, with Ethernet or Wi-Fiā€¦ And then youā€™ve gotta establish some machines. So youā€™ve got an actual Raspberry Pi, or potentially some other smaller form-factor machine that can run some sort of Linuxā€¦ I like Docker in most cases. I havenā€™t ventured into the Kubernetes world yet. I think maybe Iā€™m waiting for you to release a ā€œzero to Kubernetes videoā€, and maybe then Iā€™ll actually go into that world, because Iā€™m quite intimidated by it.

Proxmox, if you like virtualization, obviously. I like to virtualize ā€“ and really thanks to you for explaining Proxmox, because you really preached this hypervisor. And I didnā€™t really think about ā€“ I mean, I understood Docker, and I can do containers and stuff like that. I never really considered virtualizing from one good, solid machine, and having my entire stack kind of live mostly on that machine. So for me, thatā€™s ā€“ in a lot of cases, thanks to you for trading those waters for me, and like saying ā€œHey, itā€™s safe over here. Come on over here to the Proxmox world and virtualize your Ubuntu servers, and do this or do that.ā€ And so I havenā€™t mimicked literally everything youā€™ve done, but youā€™ve sort of given me a map. Itā€™s almost like a gamerā€¦ Imagine the map is dark, and until somebody ventures into that room, and now itā€™s lit up for the mapā€¦ Tim has done that for me, so I appreciate that.

Yeah, no problem. Yeah. Fog of war. I like it.

So for me, thatā€™s Pi-hole, virtualized. Dockerā€¦ Thatā€™s my stack. I think Iā€™m mirroring your stack, but what about you?

No, I like it. Yeah, thatā€™s my stack, too. So first, I start with a machine, a hypervisor. So if youā€™re not familiar with hypervisor - most people are, but if youā€™re not, itā€™s just really a machine that you can run virtual machines inside of. There are different types of hypervisors, but for all intents purposes, run machines inside of machines.

My choice has been Proxmox. Itā€™s been for a long time. I used to run Hyper-V, which was a Microsoft product, Iā€™ve run ESXi at home, which is a VMware productā€¦ None of those gave me the flexibility that I needed at home without buying expensive licenses. And so Proxmox was there, it was open source, and early in its development, and it hit all of those things that I wanted; a web-based hypervisor that was performant, thatā€™s Linux-based, thatā€™s open source, and has some enterprise features if I want them.

And so itā€™s Proxmoxā€¦ From there, I usually virtualize everything. So everythingā€™s virtualized. I tried to virtualize everything, just because it makes management and backups a lot easier. Pi-hole is definitely one. Pi-holes - I have gone a little overboard; I have three Pi-hole servers. Two of them are load balanced behind a load balancer, with a software load balancer; not important.

But then I run containers. Iā€™ll say I run containersā€¦ I used to do a ton of Docker. So I run Portainer, which is a Web UI for Docker, which makes Docker very approachable for someone who doesnā€™t know Docker. It gives you a nice Web UI. And so Iā€™ve run a lot of containers in there; Plex, Pi-hole, you name it. [unintelligible 00:27:47.13] A lot of dashboard stuffā€¦

[27:52] And then since I did a lot of Kubernetes at work, I decided to do Kubernetes at home. I will say that it takes a lot; it takes a lot to grok Kubernetes, to understand Kubernetes, and then to run it at home and maintain it. So I donā€™t recommend it for the average home user. Itā€™s definitely not approachable. There are some things that make it a little more approachable, like Rancher, and even Portainer, but for the most part, not approachableā€¦ Because itā€™s made to be this huge state machine for running high-availability applications. And so you need lots of machines, lots of hardware, and lots of resources. You can minimize all of that, but at the end of the day itā€™s going to take mostly three machines, which is out of the question for most people.

So yeah, I containerize everything. I always try to containerize everything, mainly because I want to run multiple containers on one machine, so Docker containers on one machine. I donā€™t want to have to worry about global dependencies, or all of that stuff that you worry about if you have a virtual machine. If you think about it - you know, back in the day I used to install WordPress on a machine. And then I would install - you name it, some other software on a machine, because I wanted one machine to do everything. Well, at the end of the day, when you start doing that, you might, say, for WordPress need PHP 8, and MySQL 7, and then you install something else on that machine, which requires MySQL 8, and now you have these broken dependenciesā€¦ So thatā€™s where Docker comes in and kind of keeps all of those in little containers and silos, so that you can run multiple things without them affecting each other.

But yeah, everythingā€™s containerized. I run a ton of stuffā€¦ I run a ton of stuff at home. Uptime Kuma, I monitor and log all of my servicesā€¦ I have a lot of custom code that I wrote, a lot of websites that I writeā€¦ I mean, I do a ton of Node.js, I do a ton of Docker, I do a ton of TypeScript; so I build and deploy ā€“ I have CI running in my homelabā€¦ I write code, I push it to my CI, it runs my tests, it builds containers, and then it puts them in Kubernetes. It used to put them in Docker, but yeah, now it puts them in Kubernetes. And thatā€™s all a home. I learned how to do all of that kind of in my homelab, soā€¦ But yeah, itā€™s a lot of services. Probably too many. Some of them are for testing, but some of them have stood the test of time, like Pi-hole. I absolutely love it.

Yeah Pi-holeā€™s a given for me. And then really it just helped me learn more about how to use Docker Compose, how to really look at network ports, things like that, obviouslyā€¦ Which container to useā€¦ Because thereā€™s a couple of different flavors of Python you can use. You can use, I think, the Linux server version of it potentially, and then Pi-holeā€™s version of it, that they manage and deployā€¦

Do you think that you would be as deep or as many services as you run at home if you didnā€™t have your YouTube channel? Do you feel like itā€™s cyclical, where you obviously have a persona, and you have a channel that you like to share what you learn, but you also learn so that you can create content? I donā€™t know really what your content creator journey has been, or what really makes you do it. Does the channel feed the beast, basically? Are you having to do these things or feeling like you have to do these things because you have this channel?

Yeah, it is; it is cyclical in the fact that Iā€™ll create content that will go out into the world, people might recommend something else, or an alternative, and I feel like ā€œOh, maybe I should look at thisā€, or ā€œWhy didnā€™t I consider this?ā€ Then Iā€™ll look into that, and maybe create some content from that. But it definitely is. I never feel like itā€™s work. I mean, Iā€™m not gonna say that itā€™s all roses; sometimes editing takes a lot of time, and being creative on-demand is something different, and so that takes a lot of time and energy; not used to that being a software engineer, so thatā€™s tough. But the content itself is definitely fun. I definitely learn ā€“ like, I get a lot of my best ideas from peopleā€™s comments, too. Because people will recommend alternatives, or say what they did for a particular case, or say how they solved a problem, or some software that they use. And so a lot of times I find out about things in the comments, on some of the videos I release. But it is cyclical.

[32:07] There are times when I have to chase topics. And there are other times where Iā€™m putting something out because itā€™s something Iā€™ve been interested in. I try to treat my YouTube channel almost agile, or like a software project. I have things in the backlog, I prioritize them; as things become either more popular in the world, or its time has come, Iā€™ll prioritize that story or that video and work on it.

For a while, I was going after a lot of different services you can self host, which was totally fun. I learned so much in the first two years about self-hosting in general about Docker, about Docker Compose; even about Kubernetes, I learned so much by teaching this to other people. Sometimes I miss those days, just going out there and figuring out whatā€™s the latest from Linuxserver.io, because they have all the cool containers, and a standard way of writing your Compose, and standard properties, environment variablesā€¦ But I used to window-shop Linuxserver.io all the time, and say ā€œOh, could I run this at home? Do I need this?ā€ and ā€œHow would I use this?ā€ And for a long time ā€“ and I guess still is even the case, most of the things that you ever see on my channel are things Iā€™m doing, or that I believe in, or that Iā€™m using. I mean, thatā€™s how I started my channel. My channel was always, ā€œWhat projects am I working on right now?ā€ I still ask that same question on my Twitch channel. Itā€™s been that way for years. We all talk about what weā€™re working on this weekend, or things weā€™re excited about in tech, or projects weā€™re working on. And so my channels always been like what I did last weekā€¦ [laughs] And itā€™s still to this day what I did last week. Itā€™s really focusing on home, and home tech, and homelab projects; really focusing on projects Iā€™ve really done, and really do. Most of the time itā€™s not something that Iā€™m exploring, itā€™s things that Iā€™ve already done, and I think theyā€™re awesome, and I want to share them with people. So I donā€™t know if that makes me different than anyone else, but thatā€™s something that Iā€™ve always taken kind of seriously; all the things Iā€™ve put out are things I either run in my home, or services that I run, to this day.

The reason I asked you that is because you said youā€™ve got a CI in your homelab, which is an anomaly. Not everybodyā€™s gonna do that. I mean, thatā€™s homelab, because itā€™s in your home, Tim, but itā€™s not common for somebodyā€™s homelab. And then to have that built and test, which is what CI does, and deploy it somewhere. And you could deploy it to the cloud, but you choose to deploy it to your own locally-host high-availability three-node Kubernetes clusterā€¦ Which is totally cool, but thatā€™s not normal.

So the reason why you do that is because you probably have this channel and youā€™re also a software developer, and youā€™re also curious, so you kind of have to eat your own dogfood or drink your own champagne, whichever flavor of that, phrase you like to use, because thatā€™s why you do it.

Now that you said why and how you use Kubernetes, Iā€™m probably never gonna go and use Kubernetes. Iā€™ll probably just stick to Proxmox, virtualized servers and Docker, and call it a dayā€¦ Because thereā€™s an end to my means. The reason why I do homelab stuff isnā€™t necessarily so I can tinker. I do enjoy the tinker process and the curiosity, but I have other priorities. Iā€™ve got a family, Iā€™ve got kidsā€¦ My time with them to me is way more important than upgrading firmware. I know you like to upgrade firmware.

Everybody loves to upgrade firmware when it makes sense, but I donā€™t want to live and die by this upgrade, or whatever. So Iā€™d rather prioritize other things around me. So really, my joy in homelab is making it so that I donā€™t have to interact with as much. Do some of the upfront work and maybe dig for two weeks on a project, and then for the most part be off. My Plex server - it took me a while to learn. I literally took the AV15, which Iā€™m pretty sure youā€™re familiar with, because you have one, from 45Drivesā€¦ I took that and I removed the Supermicro board, replaced it with an Asus Z70ā€¦ Because I wanted to have ECC RAM, I wanted to run the Intel 13900K CPUā€¦ Like, I wanted to max it out and just have a beefy server, and I wanted to have as much storage that 15Drives could give me in that machine.

[36:25] And so Iā€™d never built a machine ever in my life, ever. I had never ā€“ like, I took everything out and put everything in. And obviously, I had a test board for a bit; it wasnā€™t in the machine the whole time. And it took me a while to ā€“ I tried to Proxmox this thing; I could not get virtualization to work. I couldnā€™t pass through the HBA to ā€“ and I just hit brick wall after brick wall. Iā€™m like ā€œYou know what - Iā€™m gonna install Ubuntu.ā€ I just went to straight ā€“ this machine is not virtualized in any way. Itā€™s just Ubuntu with Docker machines on it, essentially. But I did all that upfront work, and I learned everything I needed to get to that pointā€¦ And now itā€™s just simply change directory into the Plex directory, spin down that thing and do a new poll, spin it back up and prune the images, and keep my disk clean, or whateverā€¦ Thatā€™s the extent of like my Plex server.

Now, that board, and RAM, and ā€“ well the RAM probably isnā€™t, because ZFS isnā€™t RAM-hungry. It uses RAM very well. I wanted to have a lot of RAM, I wanted to have a lot of disk space, I wanted to have ā€“ I just wanted to build a beefy machine. So itā€™s under-utilized right now, so I do have more plans for it. I have no idea how I would use it more. I mean, if I put a home assistant on there itā€™s not gonna really ping this CPU. The most I ping the CPU really is during data transfers, or ā€“ so because itā€™s a ZFS server for the most part, pretty much Iā€™m just storing things there. I might do some 7V stuff. So we actually have ā€“ 7Z is what I meant to say. So we have - you know, these podcasts, when theyā€™re done, they maybe are like 4, 5, 7 gigs of data in a directory. Iā€™ll take that, and rather than store that 4, or 5, 6, or 7 gigs of data, Iā€™m 7Z-ing that directory down. Itā€™s usually about 40% to 50% compressed. And so Iā€™ll keep that as a single file, which is so much easier to transfer than 50 or 60 files in a directory. So thatā€™s the extent. The CPU gets pinged quite heavily during that algorithmic compression, but thatā€™s about it. But I learned a lot.

So I did all this upfront work to build this machine, to learn how it should work. And now itā€™s in my stack, and I never really have to touch itā€¦ Aside from keeping Linux updated, which is ā€“ Iā€™ve got security patches automatically implied. I mean, thatā€™s pretty much it; itā€™s pretty much handsfree.

Yeah, thatā€™s a good thing. I tell a lot of people a lot of times - like, a lot of people want to go huge enterprise, and make things as complicated as possible. Iā€™m guilty of that. Totally guilty. I rely on automation to help me out with some of the complexity, and logging, and all of thatā€¦ But a lot of people want to go all-out and make everything complex, and thatā€™s totally fine. And then you have people who basically want to set it and forget it, or not worry about it, or itā€™s a means to an end. I appreciate all of that. I tell people all the time, do what you want to do, because at the end of the day youā€™re the one thatā€™s going to be supporting it. And do you want to support it a lot, do you want to support it a little? And I always lean towards keeping things as simple as possible. A little different for me, because I have a channel and stuff, and I have to do all of this crazy stuff all the time to try to keep abreast on the professional side for DevOpsā€¦ But I totally appreciate keeping things simple.

I mean, thatā€™s a large reason why simplified my network, I simplified a lot of things, is because thatā€™s not where I want to spend my time. And like you said, you want to spend time with family, kids, and hobbies, and workā€¦ Do I want to spend my time on a particular problem that I created for myself? Not a lot of times, not a lot of times.

[39:54] Well, there is Netflix, there is Apple TV, and thereā€™s other things you can stream from. I choose Plex because I just prefer it ā€“ well, I mean, if for some reason culture doesnā€™t care for this movie anymore, Netflix didnā€™t stop serving it, and now I no longer have access to it. Or just not having to leverage the cloud so much. Just not having to put that kind of pressure on the backbone of humanity, really. At some point, itā€™s gonna be a bigger deal. If I own these discs, or if I donā€™t mind owning these disksā€¦ It also blocks out commercials for my kids. Thereā€™s all sorts of reasons why people choose to use Plex. I also happen to be a home theater geek, so in my home I have a 120-inch screen, a laser projector, THX speakers in the wall because Iā€™m just crazy like thatā€¦ Because I really appreciate movies. And so for me, itā€™s like, I donā€™t want to change discs anymore. I donā€™t want to have to keep a rack of blurays, 4k blurays, whatever, pick your flavor, and have to go swap them out. Iā€™d rather just - give me a lossless version of it, thatā€™s on my network, that gets served wherever I want, whether itā€™s a restaurant for my children, because they want to do something while weā€™re sitting there waiting for food or whatever, or weā€™re are on a trip or something like thatā€¦ We also have a travel trailer RVā€¦ So we will stream Plex from our home in our RV. We donā€™t have to take all those discs with us. Thereā€™s so many reasons why people choose it, and thatā€™s whatā€™s important to me and my family. Not everybody really cares about movies and access to their media library. I do. And I built this beefier service so I can make sure I can do it anywhere.

Yeah, thatā€™s fantastic. Iā€™m a huge fan of Plex, too. I do a lot of over-the-air TV recording, too. I love this free resource called OTA TV, and itā€™s great. I have a network tuner, and I figured out the whole antenna thing, and filtering out noise, and itā€™s so great to be able to record over-the-air TV and use the commercial skip on it, all from Plex. Itā€™s so awesome.

And my only concern really for the future is what if Plex isnā€™t around anymore? What if Plex stops being Plex? What if their business model changes to the fact that they no longer really prioritize the local media? It is changing already; they have streaming in Plex now, and I can see some of their priorities shiftingā€¦ I just hope they always keep these legacy features in the forefront of their long-term vision. Because if Plex ā€“ sure, you have Jellyfish, and maybe weā€™ll have others, maybe something will come out instead of Plex, an alternativeā€¦ But Plex is just really good. Their application, their iOS app is amazing for me; Iā€™m an iOS user. Their Apple TV app is just phenomenalā€¦ Itā€™s on most smart TVsā€¦ Itā€™s pretty much wherever you want to watch TV, and so my only concern really is, one, I donā€™t really do much over-the-air, so thatā€™s less a concern for meā€¦ But Iā€™m concerned for you now, so Iā€™ll add it to my list of concernsā€¦ Is what happens when thereā€™s no more discs to rip? What happens when media is only streamed? You canā€™t literally buy the physical copy to watch whenever you choose to watch it, in your DRM player, of courseā€¦ Thatā€™s still a thing. What happens when that changes? I guess at that point Plex would become on the road to obsolete for me, because I mostly care about my local media. But then, if that does happen, then obviously Plex will change their priorities, because - well, physical disks are just not a thing anymore.

Yeah, itā€™s scary to think about. It definitely is, for sure. Especially when streaming companies ā€“ Iā€™ve heard stories of them removing media that people have already purchased on that streaming platform.

Yeah. No media is safe unless you have a physical copy. Itā€™s like ā€“ I donā€™t know if youā€™re into Bitcoin at all, but the ā€œNot your keys, not your walletā€ kind of situation. Like, ā€œHey, not your media, not your ā€“ā€ Like, just because you own the discs too, you still have a license to use the disk. You donā€™t actually own it. But you can; you know, you have way more freedom than streamed, because you can find a way to change where itā€™s stored at. I donā€™t think ripping is against the law. Sharing - Iā€™m not sharing my content with you. Iā€™m not torrenting my media library. Thatā€™s not at all why I do any of that stuff. Itā€™s really for convenience for me and my family.

[44:01] The experience of swapping out discs is like caveman, right? Itā€™s like trying to create fire with sticks. Why would you do that? Like, if you have homelab sophistication or curiosities, why would you not find a way to run Plex? Why would you not find a way to have a small NAS, and run ZFS? Of course, not Btrfs or anything else, because nothing else exists besides open ZFS. I donā€™t know about you, Tim, but thatā€™s how I feelā€¦ Iā€™m just kidding. Iā€™m not a hater. I do prefer, but Iā€™m not a hater.

I know. I know. I hear it a lot. There are pros and cons to both. Once ZFS implements the resizing of pools, I think it might be a less argument for or against Btrf, or ButterFS. Because thatā€™s ā€“ I donā€™t want to say the one, but thatā€™s a huge feature that Btrfs has going for it, is that you can JBOD discs. You can add storage just by adding another disk, and itā€™ll resize the pool, and reshuffle everything around. Whereas ZFS, you canā€™t. Youā€™ve gotta grow your pool in a certain way, either double discs, or depending on how you divide it upā€¦ Itā€™s tough. Itā€™s tough. Iā€™ve been there. I had to move ā€“ my old ZFS pool was a certain size, and when I got my ā€“

I watched you swap out disks. I couldnā€™t believe how you grew that pool. I was like ā€œThis guyā€™s ballsy, man. Heā€™s swapping disks and heā€™s growing his ā€“ I mean, I was watching and I was just like sweating with you. Iā€™m just like ā€œOh, my goshā€¦ Is his data gonna be there when heā€™s done?ā€

Yeah. So itā€™s tough. So thatā€™s one of the challenges with ZFS. You know, Iā€™m all for just having some flexibility to ā€“ because ZFS is pretty awesome. I love the software RAID, I love all the integrity checks that it does, I love how quickly you can snapshot and back it upā€¦ At the same time, itā€™s pretty rigid for home. I want to be able to go buy a disc, one disc, or maybe two, and add it to my pool and expand my pool. Thatā€™s not there yet in some versions of ZFS.

Yeah, I talked to Matt Aarons about that, and I think that was a coming feature when we talked about it. I canā€™t recall if it was like landed in certain versions, or if it was coming. And even then, it wouldnā€™t really resilver the whole entire pool. It would still be unbalanced to some degree, but in the realm of ZFS, your data would all be in the same VDEV, or whatever it might be. But it was still not going to rebalance the whole disk array. Which, you know, just may be a technical challenge that it will never overcome. But the reason why I like ZFS is itā€™s so easy to use, it is pretty secure in terms of [unintelligible 00:46:30.15] and all sorts of the reasons that itā€™s just a good file system. Backing up - like, I have a backup system; I had ChatGPT write me some scripts that I run there, Bash scripts that help me do some cool stuff, that Iā€™m just like ā€œBackupā€ and it just like will back it up to it. I can learn those things, and I can write those commands every single time, and I can up arrow to my nth degree, and rerun the command, but who wants to do that? Iā€™m not gonna do that.

So I had ChatGPT write me some stuff. My pair programmer.

Thatā€™s alright.

Okay, letā€™s get back to the stack. So ZFS is in my homelab stackā€¦ Youā€™ve chosen Ubuntuā€¦ Ubuntuā€¦ Pick your way to say it. I think itā€™s Ubuntu, actually. Iā€™ve chosen Ubuntu. Iā€™m curious why you chose Ubuntu.

Where do I go? So Iā€™ve used Ubuntu since - I want to say 4.10, which would mean April of 2010.

Thatā€™s so long ago. Yeah, tell me about it. And I think thatā€™s the first time I heard about itā€¦ Like, yeah, it was Windows ā€“ I still am a Windows fan. Iā€™m not against Windows, I use Windows, Mac, Linux, I use them all, for different things. And back then it was all Windows. It was all Windows, and I just didnā€™t have a lot of experience with Linux. I had heard about it, and so that was the first approachable Linux for me, was Ubuntu. It had a desktop, it kind of felt like Windowsā€¦ So that was my first foray into Linux, really. And then from there, they had the server version. So as I used Ubuntu desktop, I could open up a terminal, and kind of tinker, and play around with Linux, and copy and paste these commands into there, and do things that people were doing on Linux server.

[48:05] So eventually, I got to the point where I was like ā€œWell, Iā€™ll use Linux headless nowā€, basically the server version, to where I donā€™t need the UI. And so I got really familiar with Ubuntu in general, or Debian I guess I should sayā€¦ But more so Ubuntu. And I learned their package manager, I learned all of the stuff about itā€¦ And so I just kept using it. And then being in infrastructure, and then being a software developer, a lot of people supported Ubuntu LTS for a lot of their stuff, whether it was MySQL, MongoDB, or anything. You could always guarantee that any software package or service was going to run on the latest LTS of Ubuntu.

So since the tech community considered it so stable, I just stuck with it. And I still do. And Iā€™ve tinkered with all different versions. So Iā€™m a huge fan. Iā€™ve been using it for a long time. And then with Microsoft now having WsL, and running Linux on Windows, and having Ubuntu kind of running on Windows too, itā€™s super-nice to be able to use. For me, approachable and accessible, stable and supported. Thatā€™s what it boils down to.

And I think everyone has their flavor of Linux that they like, orā€¦

Yeah. Youā€™ve got distro hoppers, or youā€™ve got some sort of hatingā€¦ Like, ā€œWhy do you like this distro?ā€ So did you explore all the distros ever? Or did you sort of like just land at Ubuntu and just stay there?

No, I distro-hopped. I think once you get kind of bitten by the Linux bug, I think then youā€™re like ā€œOkay, well, what else is out there? Is this the best one? Am I on the best one? Whatā€™s everyone else using?ā€ So I used to go out to DistroWatch all the time, all the time, and say ā€œHey, whatā€™s Ubuntu MATE? Or whatā€™s Fedora all about? Or Red Hat?ā€ or you name it, and hop around and try things. Arch, you knowā€¦ And then I did that too for my Linux firewall. So I ran a Linux firewall for a long time; I ran SmoothWall, IPCop, Untangle, pfSenseā€¦ And so that was part of my routine too, was Iā€™m gonna distro-hop with my Linux firewall. So DistroWatch, see what the top network distribution was, and hop that way, too.

At work I used Mac or Windows, and at home I used Linux, so I found every time I went to switch to another Linux, I felt like Iā€™m paying some debt to keep learning something else, and to keep trying something elseā€¦ And at the end of the day, running Linux at home for me was kind of a means to an end for some things. And so I started to be a little more pragmatic and say ā€œI just need this to work, I need it to run, because at the end of the day I need to get Docker containers running on here, I need to get Kubernetes on here.ā€ And so if it works, itā€™s stable, itā€™s supported, I had to put my pragmatic hat on and say ā€œI just need this to work.ā€ And so yeah, to answer your question though, I have distro-dropped a lot. A lot less lately.

Okay. Okay. So you stabilized to Ubuntu.

Thatā€™s right.

And since version four, essentially. 4.10. So I think I was 12.10 was the first version I installed. And I think that was around 2015-2016 maybe, something like that. And the first place I installed Linux myself was on a DigitalOcean droplet, and it was to run a WordPress server.

I did the firewall, all that good stuffā€¦ And that thing was stable, and ran without being rebooted for years. I mean, it was either DigitalOceanā€™s good job, or my good job, or the tutorialā€™s good job, I donā€™t knowā€¦ Or Linux itselfā€¦ So I was a fan of Ubuntu for a while. And so when it came to - about a year or so ago I kind of got back into Linux. I never really got out of it, but I never really tinkered with it day to day. But then I kind of got more into my homelab stuff, and was more concerned with which flavor of Linux I was runningā€¦ And I wanted to try them all; I want to try Debian, I wanted to try Red Hat, I wanted to try Rocky, I wanted to try all the different onesā€¦ But what made me come back to Ubuntu was, one, the reasons which you say, which is support and stability. But then I just recognized that it was always better resource-efficient; always better CPU-efficient, and phenomenally better on RAM, in comparison to most distros.

[52:05] I always kind of gauged it on like ā€œOkay, if I install basic Ubuntu, get Docker running on it, and spin up Pi-hole, what is the resource utilization on that?ā€ Well, basically nothing on the CPU, of course, because itā€™s not really a CPU-intensive application anyways. But the ram was like 300 megs, maybeā€¦ While I had four gigs or so on a small machine in most cases for that. It was just super-RAM efficient, and you could just add more and more. I believe that was even inside of Proxmox now that Iā€™m thinking about it. So it was like Proxmox, then Ubuntu as the - obviously, having a machine to run it on. And then Docker, and then the actual container itself. And it was sitting inside that container, 300 megs, but I would run htop on Proxmox itself; the resource utilization was just like basically nothing.

So if you add more and more to that; pfSense, or Plex, or something else, you just have a lotā€¦ And in the homelab, the things you really care about. And I think youā€™ve helped me understand this more, because you always talk about like kilowatt usage, and you know how much Watts something usesā€¦ Iā€™m like ā€œWhy does that even matter?ā€ And Iā€™m like ā€œOh yeah, the power bill.ā€ So thatā€™s important.

But then - like, when youā€™re tinkering, youā€™re just curious. Youā€™re just learning, so youā€™re like ā€œI donā€™t care how many Watts this thing takes. Does this work, and does it serve my use?ā€ And then youā€™re like ā€œOh, how can I now make it more efficient? CPU, RAM, Watts etc.ā€ And the point Iā€™m trying to make, I suppose, is just that you start to care about heat, you care about noise, and you care about wattage in homelab. And you care about reuse. So can I reuse something, and does it sound X? Does it power X? Okay, no. Let me spend some money.

You were recently doing a video on your mobile homelab forbidden travel router plus plus ultimate homelab thingy. I didnā€™t see it like you did. I thought it was hilarious, the times you said it on that episodeā€¦ But Iā€™m like, ā€œI need that for my travel trailer RV. I need a version of that.ā€ And I thought about like building a UniFi network, but that thing you built was just way better, because itā€™s everything in one single device, and itā€™s quiet, and itā€™s low-powered. So you start to think about ā€“ as we sort of go up and down this homelab stack, what matters I think is power, obviously, and noise, and does it create a lot of heat? Because if youā€™re in a small environment, or even a closet in most cases, are you generating a lot of heat that youā€™ve gotta somehow exhaust? These are things youā€™ve got to worry about. So talk about the Protectli, talk about this mobile homelab forbidden travel router plus plus ultimate homelab thingy that youā€™ve built.

[laughs] You nailed it. Yeah, so Iā€™ve had this idea for a while. Every time I travel, I bring devices with me. I think a lot of people in tech do.

I almost never. I will just bring a hotspot. Iā€™m the opposite. I would want to bring a lot of stuff, I just didnā€™t have anything to bring. So I just bring my hotspot and hope for the best.

Yeah, thatā€™s true. But I guess I was bringing a lot of things that needed to connect to another network. And off the top of my head [unintelligible 00:55:02.03] ā€œOh, a laptop.ā€ But no, it was a laptop, a phone, a tablet, maybe a gaming device, maybeā€¦ Whatever. And so those things grew. And then if my wife traveled with me, it was that times two. And so I always felt weird about like ā€œHey, we just got an Airbnb. Weā€™re just gonna connect all our devices to their Airbnb. Yeah, we 100% trust this thing.ā€

Trust them. ā€œYeah, letā€™s just trust them.ā€

You know? And I always felt weird about it. And I was like ā€œThereā€™s gotta be something better. I donā€™t trust this.ā€ And so for a while, I would bring a little Raspberry Pi, and I would plug it in, and broadcast a network. It didnā€™t do the greatest, but it did exactly what I wanted it to do. It was like this travel version of a network firewall, that only our devices got connected to. If I wanted, it could VPN back home, and then get all the protection I wanted. Or if I wanted, Iā€™d run Pi-hole on it.

[55:59] And so the Py did kind of okay at that; it did okay at that, for a lot of different reasons. And then I started looking at, okay, well, I need something a little bit more powerful than a Py. I wonā€™t get too technical, but I need something that does AES encryption, [unintelligible 00:56:12.05] doesnā€™t exist on ARM CPUs, or at least the Py, and it does on x86 processorsā€¦ So thatā€™s when I started looking for small, low-power, quiet devices that I could bring with me. Small. Iā€™m talking about the size of a phone, a large phone. And thatā€™s when I came across these Protectli devices. And then I started thinking, ā€œOkay, what are the things that I want to take with me?ā€ And it was that same thing; it was like ā€œHey, letā€™s build a firewall, so that I can connect only my devices to it. Letā€™s add an access point to this, so that I donā€™t have to connect to their access point. Iā€™ll connect to this deviceā€™s access point, and then I can uplink to their router. And then letā€™s add Pi-hole to it, because I want the same protection I have at home.ā€ You know, why have everyone track me as soon as I walk out the door?

And then I realized, hey, Proxmox is a great fit for this. These little devices - I mean, there are a lot of them, but this Protectli device, at the end of the day, itā€™s an Intel CPU that supports virtualization. So I was like ā€œWell, why not just put Proxmox on this and do exactly what I do at home, except for add an access point to it?ā€ And so thatā€™s kind of what I did. And it works great. Itā€™s super-complicated, it is funā€¦ But yeah, itā€™s great for ā€“ like, if youā€™re going to travel somewhere Iā€™d say for a week or more; or like your RV. Perfect for that. Because itā€™s something you could set up, you could have everyone connect to, and you can be sure that everyoneā€™s connected and safe.

Also, I can run Plex on it, and because it has QuickSync on that Intel CPU, because it has an Intel desktop class processor, with an Intel Iris, it can do transcoding there local, too. Obviously, most people are going to connect back home for Plex, but think of ā€“ like, youā€™re on the actual road trip, road tripping, and all your kids want to connect to a device, and you donā€™t want to use dataā€¦ You could easily serve that out locally through that machine, too.

Thereā€™s just so many possibilitiesā€¦ And every time I traveled, I thought ā€œThereā€™s got to be a better way.ā€ And then NetworkChuck did something similarā€¦ And I was like ā€œAwesome! This kind of ties together one piece that I was missing.ā€ I was just like noodling on this idea for a while, and eventually it kind of came together. But I think Proxmox made it so much easier than it was without Proxmox.

Now, there are tiny little travel routers too that Iā€™m gonna look into at some point, but itā€™s super-nice to be able to bring some things with you, and to be able to tinker and to spin up stuff, local services, whatever I want.

What I like about it is that it can run Plex, and I donā€™t always want to phone home for Plex, because the network isnā€™t always there, really. And so if I can actually have one ā€“ the reason why I like it is for all the reasons youā€™ve said; it can be the router for all the devices that I trust, I can connect to LTE, or a hard line to the local network if there is one available. If itā€™s an Airbnb, or this RV place happens to support that. Sometimes theyā€™ll give you a router that connects to their network, which you can then run an Ethernet port out of to something else. So you can still be their device, but then protect yourself from there. But the fact that I can run Plex and just run a mobile version of my Plex, so it doesnā€™t have to be my main version of it. I can just pull over the kidsā€™ directory, for example, which is - they have their own directory. All the stuff that the kids can watch is in the kids directory. I can just clone that to this device. Now, obviously, if itā€™s too big, and itā€™s 10 terabytes or whatever the number might be, maybe Iā€™m then choosy, or itā€™s a selection process. But I can always take a mobile version of my Plex, essentially.

And I wanted it for all the reasons - itā€™s low-power, Intel CPU, virtualization, can run Proxmoxā€¦ So thank you for doing all the hard work, Tim. And then the relationship, Iā€™m sure, because ā€“ finding hardware manufacturers that support open source the way that Protectli seems to based upon what youā€™ve shared about them - itā€™s kind of hard. If it werenā€™t for folks like you, and I think just YouTube in general, or like content creators, either being approached by these brands, or being curious and having these needs, and being like ā€œThereā€™s got to be a better way.ā€ If it werenā€™t for folks like you going and doing all that digging, then people like me would not be able to just piggyback off all your work and just ā€“ because Iā€™m gonna go and figure out how to do that for myself, because my idea was ā€œOkay, Iā€™m gonna get that small square USG, a POE thing with a POE access pointā€¦ā€ I was gonna do a small version of UniFi network. And like that thing basically is all that in one, plus it can run Plex. And also have ā€“ I think it supports SATA SSD, so I can maybe doing an eight-gig, or maybe I can plug inā€¦ I think thereā€™s some USB ports, or something like that, too. Maybe I can have an external device thatā€™s just for the storage. I donā€™t know, I havenā€™t thought that far, because Iā€™ve only recently just watched your video. But that to me is like, thatā€™s the better way to do it.

Yeah, itā€™s toughā€¦ Because I thought the same thing, like is there a mini UniFi thing I can bring with me, that autoconnects me back home? And I donā€™t think that exists yet. Or who knowsā€¦?

Well, theyā€™re listening. Theyā€™ll make it after this call. Theyā€™ll be like ā€œOkay, listen, theyā€™ve really promoted UniFi at the beginning, and now theyā€™re not doing it anymore. Theyā€™re building Protectli stuff. Weā€™ve got to find a way.ā€ Theyā€™re gonna listen.

Thank you for calling that out about me doing research and making relationships with companies, because thatā€™s kind of what it is, you knowā€¦ And thatā€™s another tough part about content creation - a lot of people think ā€œOh, theyā€™re just saying this because youā€™re getting paid.ā€ And itā€™s like, ā€œNo, I believe in this productā€, and either they approach me or I approach themā€¦ But at the end of the day, I believe in this product, and I want it to succeed. And yes, Protectli definitely has leaned into open source a ton. If you look at their documentation, they have everything you can possibly install on that device, between OpenWrt, Proxmox, you name it; theyā€™ve done a ton of documentation on it. And itā€™s a pretty cool device, too.

I didnā€™t even know that existed, the OpenWrt. I didnā€™t know it existed, I didnā€™t know ā€“ I mean, youā€™re helping me discover these new things that are already out there, and open source is just so big. Weā€™ve been covering open source on the Changelog for ā€“ I mean, basically, one year after GitHubā€™s birth; it was like maybe six months or so. We just saw the trend of open source moving faster. And the name of the show became really because I was watching open source change so often; Iā€™m like ā€œWell, thereā€™s nobody talking about what happened between this version and this version. Nobodyā€™s reading the changelog.ā€ And so then the show became called The Changelog, because we were chronicling open source changing via our blog; we had a blog back in the day. That became our newsletter and news feed, and then now just our news show. We have a new show on Mondays, thatā€™s a newsletter and a podcast in one. Itā€™s about eight or nine minutes; itā€™s a must listen, basically, if you want the top stories for that week. And then the newsletter obviously gives you more details.

We have an email called Changelog Nightly, that literally comes out daily, or technically nightly, and shows the trends on GitHub, repository-wise. Sadly, thereā€™s so much GitHub spam now that itā€™s made that newsletter kind of suck a little bit, and itā€™s so hard to sort of prune it. And it leverages Googleā€™s BigQuery, and some of itā€™s out of our controlā€¦ So all we can really do is filter; we canā€™t really change the queries much. But yeah, I mean, the power of open source is amazing, but I had no idea about OpenWrt, and how you can leverage itā€¦ So really, thank you for being what I call in the trenches. Youā€™re a content creator, but I think youā€™re this person whoā€™s curious, and you probably have these challenges, and youā€™re like ā€œWhat devices out there work?ā€ Okay, either they called you or you called them, but thereā€™s some sort of discovery process. And then thereā€™s a software discovery process. And then thereā€™s ā€œWell, actually this thing makes sense to run Proxmox, so will it actually virtualize?ā€ Well, because sometimes youā€™ll support IOMMU, and maybe you can virtualize some things. I think you had an issue with a video driver or something like that with Windows; thereā€™s always something finickyā€¦ Even though itā€™s supported, thereā€™s always something. And so it requires sometimes that person to go ahead of everybody else and sort of like recon. ā€œOkay, the path is safe. Come on, come this way.ā€

[01:04:23.00] Totally. A canary in the coal mine I feel like sometimes. But itā€™s tough, and Iā€™m glad you recognize that, because it starts with an idea sometimes, but thereā€™s so much, I realized, for tech YouTube too, at least for what Iā€™m doing for tech YouTube - thereā€™s a lot that goes into it. Not only the writing, the thumbnails, the things you guys see, but just - yeah, a lot of these are projects that I have to test ahead of time. And usually, I test them two or three times, because I donā€™t want surprises as Iā€™m recording. So a lot of work goes into it, but itā€™s fun. I learned a ton, and itā€™s fun to share that stuff, too.

Since weā€™re kind of on the subject and weā€™re probably getting close to time, can we kind of talk about the business of being a YouTuber, to some degree? Do you mind?

Yeah, no, sure.

Is that an open subject for you?

So I noticed recently - and because youā€™d mentioned Protectli, and this relationship, Iā€™ve noticed ā€“ and I donā€™t know if I had noticed it before, but Iā€™ve noticed this phrase in the top left corner of some of your videos, not all of themā€¦ ā€œIncludes paid promotion.ā€ And I think you have to do something when you publish a video, because there is some relationship, and you have to be forthcoming with YouTube the platform about the dealings of business behind the scenes. How does that work for you? Do you have dedicated sponsors? What is the business side of your channel like? How does it work for you?

Good question. I feel like this was the question I was hoping forā€¦

Because ā€“ well, I mean, there are a lot of people that are always trying to figure out ā€œIs this person being genuine, or is this person being paid to say this?ā€

Youā€™ve always seemed genuine to me.

Well, thank you.

Itā€™s either the way you talk, which I think you have a unique way of delivering, you have a pace with your voice; either itā€™s on purpose, or itā€™s just naturalā€¦ But youā€™ve always seemed, without having to say so, like youā€™ve gone on a journey, and youā€™re telling us the tale of the journey, and why it made sense for you to go on it. So youā€™ve always seemed very trustworthy to me in terms of being truthful, and honest with your dealings. Itā€™s never felt like you had to over-explain; it just seemed, the way you approached the topic, and the subject matter just seemed naturally trustworthy to me, personally.

Thank you. Well, I really appreciate that. Sometimes I get bogged down by the commentsā€¦ Itā€™s one comment thatā€™s like ā€œHeā€™s just getting paid to say this.ā€ And I shouldnā€™t read the comments, but I do.

Donā€™t read those comments, yeahā€¦

I knowā€¦ I canā€™t help it though.

Well, every time you see that comment, just imagine me going ā€œNot true. Tim, I believe in you.ā€

Alright, thank you. I appreciate it. So let me explain this the best way I can without ā€“ Iā€™m not a lawyer or anything like that, but YouTube has this checkbox. So when I create content, YouTube has this checkbox. And this checkbox says, ā€œCheck this checkboxā€, Iā€™m paraphrasing, ā€œif you received anything of value to create this video, or received money.ā€ So they kind of lumped them both into one. And me, Iā€™m a rule follower. Iā€™m a rule follower, and so I read into it deeply, and I think ā€œWell, on my latest video, Rackstuds sent me a free pack of Rackstuds.ā€ They didnā€™t pay me, didnā€™t say anything, they just said ā€œI want you to have them. Use them in any of your videos.ā€ And so to me, Iā€™m like ā€œOkay, Iā€™m posting this video, I received one thing for free in this videoā€¦ I should probably check the checkbox.ā€

So anyways, long story short, thatā€™s up for almost every single one of my videos, because one thing in my video was usually sent to me for free, that I used. So full disclosure. I try to disclose that in the video too, but there are times when I paid sponsors, who want to sponsor the video, or a segment in the video, and Iā€™m pretty clear about that, too. I usually have a segment in my videos that says ā€œHey, this video was sponsored by so and so.ā€

[01:08:01.08] And Iā€™m very picky on who I work with, Iā€™ve been fortunate enough to do that. I work with some really awesome brands, and so Iā€™m sticking with them. But the business of YouTube - itā€™s tough. Itā€™s trying to balance this ā€“ well, one, itā€™s being able to get paid for what youā€™re doing. That is tough. You have to have an audience that trusts youā€¦ And then YouTube has a rev share with ads, which isnā€™t muchā€¦ And then there are brand deals and sponsorships where brands can sponsor your videos for however much you charge for a segment on your video.

Iā€™ve done okayā€¦ Iā€™m a software engineer, so in general I earn a pretty good wage. Recently thatā€™s changed; Iā€™ve been doing half and half, sort of. Iā€™ve been fortunate enough to dial back some of my software engineering stuff and contracts, and do more of YouTube to try to give this a shot, to see if this is something I want to do for the next six monthsā€¦ But I will say, itā€™s a huge pay cut. But at the same time, Iā€™m doing - three of five days Iā€™m doing exactly what I want to do; just trying to make a business out of YouTube, and figuring out what that means. I donā€™t have a lot of mentorship. I actually have zero. I donā€™t have anyone to talk toā€¦

Bummer. It doesnā€™t seem like that from the outside.

Oh, thanks. But honestly ā€“ donā€™t get me wrong, Iā€™ve talked to other YouTubers, but it never gets into ā€œWhatā€™s your business model? How do you charge? How do you make money outside of YouTube?ā€ Itā€™s been all this trying to figure it out for myself, which is totally fine. But at the end of the day, I have to figure out if this works for me. Anyways, this is not meant to be a sob story, butā€¦

Well, itā€™s the journey. Itā€™s the journey that youā€™re going on. Youā€™re like ā€œHow do Iā€“ā€ And I think I understand, if Iā€™m reading between the lines, and also having gone down ā€“ Iā€™m not on the YouTube path. Weā€™ve been on podcasting primarily. I feel like audio is the best type of content; like, video does ā€“ I mean, I suppose, I couldnā€™t imagine you audibly talking about the things you talk about, because you need a visual to it. So thereā€™s some things that just donā€™t fit the podcast method, so to speak. But weā€™ve chosen podcasts first, audio podcasts first, and then video being a second-class citizen in all of our production. But I can empathize, because youā€™re toeing that line of like ā€œI want my listeners, and the people Iā€™m trying to cultivate as an audience, the people I genuinely care about - because I am one of them, so in a lot of ways what I produce is a mirror of what they desire in life, or what theyā€™re curious about, and they donā€™t know about it yet, and Iā€™m on this discovery pathā€ that weā€™ve talked about with youā€¦ And you want to stay genuine to that. But in order to do that, you do have to make money. So I mean, there is a relationship that comes there.

So itā€™s like ā€œWell, how do I capitalize from a business and revenue perspective without squandering, or just basically removing that trust that theyā€™ve given me?ā€ Because you want to toe that line. And the only way Iā€™ve been able to find out how to do that is just choose the brands that, like you had said, that you trust, that you believe in, that you would yourself use if you had that problem. And our case is a little bit different, because we donā€™t always have the problem every brand approaches us withā€¦ Tailscale is a good example. I use Tailscale. Theyā€™re one of our sponsors. I chose Tailscale because I like them. I use them. Iā€™m like ā€œHey, I would love it if you all sponsored a podcast. If you have any budget, Iā€™d love to talk about how these things work for us.ā€ And those for us are super-clear. You can tell where thereā€™s an ad spot.

I just mentioned Tailscale - they didnā€™t pay me to do that. Thatā€™s because I use them. Thatā€™s genuine. And so you do have that blend. And itā€™s unfortunate for you, because ā€“ yeah, itā€™s kind of crazy they lump both of those into one. But you have that struggle of like ā€œI want my audience to trust me, I want them to know that when I mention Protectli, or Racksys, I believe, or what was the other ā€“ the rack you just talked about today.

Yeah, Sysracks.

Sysracks. I had it backwards. Did you buy that? Do you own that? Would you buy that if you had to buy it? Did they give it to you? Like, all these questions come into play. I personally had that question when I watched that, and Iā€™m like ā€œWell, Tim, you have a big version of that. Why in the world do you need a second small version of that, Tim? What story are you not sharing here?ā€ And itā€™s not that Iā€™m thinking youā€™re dishonest, itā€™s just more like - I know you have to create a business around this, but then youā€™re like ā€œWell, did they give him this one, and now he just cares that much, and this is a small version of the big version? Whatā€™s the story here?ā€

[01:12:13.08] And itā€™s so challenging to be forthcoming with every detail without giving too much TMI. And then also, just bloating your content with all the explanatory of explaining why people should trust you. So for us, I always feel like every time I get a chance, in a podcast, naturally, to mention how we deal with sponsors, just saying like we choose to work with them. We donā€™t just take money from anybody, and this is because we truly trust and think that business is worth promoting, because you should know about this; you should know about their brand story, you should know more about the details. And thatā€™s how we choose them. So I donā€™t always preface every single ad with ā€œHereā€™s how weā€™re getting paid. Hereā€™s the business dealings. And by the way, hereā€™s the details about the business itself.ā€ Itā€™s a challenge. So I empathize to the nth degree with the challenge.

Yeah, thank you. I mean, you hit the nail on the head. A lot of people wonder, every video I releaseā€¦ And maybe itā€™s just me reading into stuff, but itā€™s tough. Itā€™s like, do I want to spend like 45 seconds in the beginning disclosing exactly how this product came to my house? And Iā€™m sure some people would be interested in that, but other people may not be. Plus, the algorithmā€¦ I mean, I have to deal with the algorithm on YouTube, too. So thatā€™s tough, too. YouTube analyzes everything you say, and all the engagement with your stuffā€¦

Is that right? Theyā€™re analyzing your words, too?

Oh, yeah. Everything. Everything plays into it. You could put a video out on YouTube with no title whatsoever, and YouTube already knows who your audience is, and whoā€™s going to click on itā€¦ I mean, theyā€™ll analyze the thumbnail too, but how much time do I want to spend talking about how I got this item? Well, if I do that in the first 30 seconds, people are going to click away. So thatā€™s gonna drop off. So itā€™s like ā€œOkay, the first 30 seconds of your video is to captivate the audience, not to talk about all your prerequisites, and stuff like that.ā€

So itā€™s tough. Itā€™s tough. So if you see that checkbox, most of the time it means that I received at least one thing for free in this video to make the video, because thatā€™s the FTC saying they have to do it, too. Thatā€™s Google basically saying ā€œHey, we have to do this for the FTCā€, and so I have to check that checkbox if I received one thing for free.

Iā€™ve heard a lot of people say ā€œOh, well, they didnā€™t give it to me for free. My money costs time, so this technically isnā€™t for free.ā€ And I donā€™t want to play the game. Iā€™m just going to check the checkbox almost every timeā€¦ If something in my video was free, then Iā€™m going to check the checkbox, because I never want the FTC or Google coming after me for not doing it.

Have you considered doing a video that explains the phrase they put up there, ā€œIncludes paid promotion?ā€ Like, almost just do a whole standalone video that the title is ā€œIncludes pay for motion. This is how it works for me.ā€

ā€œBecause youā€™re gonna see this on almost every video, and hereā€™s why. And this is the path that things come to me. Sometimes I reach out to them, sometimes they reach out to meā€¦ Sometimes they just send things to me, and I donā€™t even know itā€™s comingā€¦ Whatever the methodology is. And when you see that thing up there, because I canā€™t avoid it - Iā€™m forthcoming, Iā€™m a genuine person, I play by the rulesā€, all the reasons you just basically stated. ā€œWhen you see that, this is how my business here on YouTube kind of works. So that when you see that, this is how you can trust what I care about, and why things end up on my video.ā€

The Rackstuds - I bought mine. They didnā€™t send me any. And I heard about them from Tom Lawrenceā€¦ And I like them. I think theyā€™re pretty awesome. I didnā€™t see the one youā€™ve just mentioned before. I think those are brand newā€¦ Kind of cool. They donā€™t hold a ton of weight, so you canā€™t ā€“ I mean, I think you put your UPS on it, and it was a lighter version. Mine is 75 pounds, so it would not hold mine. And if it did, it would stress-test it and maybe break it. But those racks, those are pretty cool. I like them.

They are cool. They are super-cool. And Iā€™m not gonna lie, I was a little skeptical about them. I thought ā€œWell, cage nuts arenā€™t that hard to use.ā€

And thereā€™s a plethora; theyā€™re everywhere. Thereā€™s no shortage.

[01:16:06.06] Yeah, I like this thing that ā€“ I had stainless steel ones, and I was like ā€œYeah, theyā€™re pretty cool and shinyā€, and never have using them, seeing them on other channels, I thought ā€œWell, I think cage nuts are fine.ā€ And then this is exactly how it happened - Iā€™m working on this video for this new rackā€¦ I think itā€™s the owner for Rackstuds reached out and said ā€œHey, I watch a ton of your videos. Give me your address, I want to send you some Rackstuds.ā€ I said ā€œSure, why not.ā€ And then I decided to use them for thisā€¦ And Iā€™m a believer in them now. Itā€™s super-nice to be able to just ā€“ I donā€™t know, the new ones are awesome, because you just clip them in, and then you can put your device there and screw them in. But I also had to use the other ones, too. And I was surprised at how much weight they can hold. Iā€™m surprised at how much weight and how steady they are. I will say, if you ever put a screwdriver to them, put it to it gently.

Yeah. Iā€™ve only done it to get them off, because I would hand-tighten them too tight, and Iā€™ve only had to use a screwdriver to get them off.

Itā€™s never been to ā€“ like, I would just only hand-tighten. Because itā€™s plastic. I mean, itā€™s nylon of some sort, Iā€™m sure. But itā€™s not metal, you know?

Yeah, yeah. They are pretty amazing at what they do. So the 22-pound UPS is as far as Iā€™ve taken it. And this is a tiny little rack that I have behind me; itā€™s basically going to house a couple of things that I have coming up. Basically, studio stuff thatā€™s going to be rack mounted.

Right. So you have, like ā€“ I donā€™t know the map of your house, but I think you have a basement, and I think your main rack is in your basement, because thatā€™s what youā€™ve saidā€¦

Thatā€™s right.

Very colorful rack, you knowā€¦ But you have a large ā€“ I think a 32U rack, whichā€¦ Thatā€™s a lot of stuff. I think the 45Drives is probably for youā€¦ So youā€™ve got 28 to go from there. Maybe youā€™ve got a few switches, so maybe youā€™ve got down to 26ā€¦ I mean, youā€™re not filling the whole thing, are you? The whole 32U rack. Youā€™ve got a little bit of space left. Maybe like four or five Uā€™s, something like that.

Yeah, I do. And I have a disc shelf in there that Iā€™m selling now, and so yeah, things have evolved over time. I have some 1U servers in thereā€¦ I even have an Intel NUC cluster in thereā€¦ So yeah, things have definitely evolved.

What are you using that for?

My Intel NUC cluster?

Yeah. Is that your Kubernetes cluster then, that youā€™re deploying to? Or is it something else?

It was. So for a while it was for testing my Kubernetes. So I built this thing in Ansible, thatā€™s open source, that helps you deploy a high-availability Kubernetes cluster, and that was my testbed for a long time. Funny you mentioned power and heat, and all this stuff we were just talking aboutā€¦ Well, weā€™re in a heatwave here in Minnesota. I mean, itā€™s really hot. I mean, weā€™re talking like it was 95 yesterday, 94 today, and Iā€™ve been running these 1U servers in my basement, in my server rack for a while. And they get hot, theyā€™re loud, and they use a lot of power. And Iā€™ll preface it with theyā€™re pretty efficient. I mean, theyā€™re pulling 140 Watts each, which is pretty efficient compared to if you look at other things that are 200-300 Watts apiece. So theyā€™re already pretty efficient, but I thought, ā€œYou know what, I wonder if I can run Proxmox on this intel NUC cluster and replace one to one?ā€ Replace one 1U server running six to nine virtual machines, and move and migrate all of those virtual machines to one Intel NUC. And so I did it. And I did this, I want to say, a couple days ago. I was posting it on Twitter, basically; my almost live tweets.

And what Iā€™ve found was I was able to migrate all of those virtual machines to an Intel NUC, and run them all there, and shut down my 1U server, and I went from 140 Watts to only 26 Watts. And running the same exact workload. And then so I was like ā€œOkay, that worked out pretty well.ā€ Like, it was like a non-event. So then it was like ā€œLetā€™s migrate the other one.ā€ I migrated the other one, nine virtual machines, to another Intel NUC, and itā€™s running. Same thing. It saved, I donā€™t know, around 100 Watts there.

So then I was like ā€œOkay, well, Iā€™m going to shut down my 1U servers, and maybe on Monday Iā€™ll need them again, so Iā€™ll keep it on standby.ā€ Well, it is now Wednesday, and I havenā€™t needed to turn my 1Uā€™s back on.

Yeah. So Iā€™m running Proxmox on two Intel NUCs. It has one terabyte NVMe, and a 500-gig SSD for the OS. All my virtual machines are running in there, 64 gigs of RAMā€¦ You know, I was able to save a ton of power, and on top of that, things I didnā€™t realize - Iā€™m also not using my A/C ur fans as much too, because now the temperature in my server room dropped by almost 10 degrees.

So then my fans are on less, so then my A/C is on less.

Thatā€™s insane. So two 1U servers was generating 10 degrees? Thatā€™s a lot. Wow.

Have you done the math on what that equates to, like kilowatts per month? I mean, you pay your power bill, and Iā€™m like ā€œManā€¦ā€ My power bill goes up. And the A/C is the main user of that. And thereā€™s even ways you can cool down your coils, and stuff like thatā€¦ Because I live in Texas, so itā€™s always ā€“ like, itā€™s common to beā€¦ Well, itā€™s same temperature as you, Tim. 95 degrees outside. So there you go. Different parts of the world, but same temperature.

But yeah, have you calculated what that 100 Watts or 120 Watts equates to for the full month when you run that? Like how much youā€™ll save, or what the difference is kilowatts per hour?

No, I havenā€™t. So itā€™s a total of 200 Watts that I save, total, running 24/7. I havenā€™t calculated it out. I should. I probably will.

Thatā€™d be kind of cool.

Oh, yeah. For sure.

Like I said before, I never really thought about ā€“ I mean, obviously, I pay my power bills, so I think about power consumptionā€¦ But I never really considered ā€œOkay, as Iā€™m being curious with homelab things, and as I choose this deviceā€¦ā€ You know, the Protectli stuff is low-power, fanless even, and so itā€™s got that grate (or whatever you call it) on top to sort of dissipate the heat, and whatnot. You donā€™t think about the consumption, and then really how that effectsā€¦ Like, what if all the YouTubers in Minnesota did what you did, Tim? Iā€™m just kidding, thereā€™s probably not many of you up there. But what if everybody considered ā€œHow can I shave off 200 Watts of consumption 24/7?ā€ That might reduce the stress on the power grid. I mean, these are all utilities; you flip a switch, the lights come on. You expect that. Like, what happens whenever we stress the system to the point ā€“ during insane heatwaves, or peak times in winters or summers, whenever itā€™s too cold or too hotā€¦ What if we all like consider a little bit that power consumption, in particular - like, 200 Watts is a lot, and 10 degrees in one room change by turning off two devicesā€¦ Thatā€™s significant.

It is. So yeah, it had this compounding effect of less power, which - you know, those servers then generated less heatā€¦ And so I have an enclosed server, that enclosed server rack, and it has a temperature control unitā€¦ So as the heat would get past, I think, 87 degrees, it would kick on those fansā€¦ And so now that whole thing is no longer happening; itā€™s all being passively cooled. Well, passively from the rest of my house, butā€¦

Yeah, itā€™s crazy to think about. I think about it more and more. When I first got into homelab, I thought I needed this huge, gigantic serverā€¦ And it turns out very few things need a lot of compute. Like you mentioned earlier, itā€™s going to be compressing, or compiling, or transcodingā€¦ Other than that, most things run pretty okay on low-wattage processors.

Yes, yes. Well, I think weā€™re getting close to the length of ā€“ weā€™re beyond what I thought we would actually go in terms of timing. The only question I had left for you, and I think you may want to answer this, because you said that you wanted to talk about the other topic, which was the business of YouTubeā€¦ What are your plans for the future? I mean, you do a great job with your content. I appreciate the journeys you take to create the content you do, because in a lot of ways youā€™re the recon; youā€™re the recon team, and Iā€™m the follow-up team. Iā€™m just watching what youā€™re doing. Some things I just learn from, like with the PiKVM. I donā€™t really leverage that really much. I donā€™t have a lot of headless things where Iā€™ve got to deal with that. I SSH into most things I need to, so I donā€™t need a visual for almost anything really, unless I have toā€¦ And maybe then Iā€™ll go back and watch it, and maybe implement a PiKVM, or something like that.

[01:24:15.05] Proxmox - youā€™ve helped me get into that, obviously, considering low-power consumptionā€¦ But things like that. So what are the futures for you in terms of like the business of YouTube? Do you plan to grow a team? Do you have an editor? Will you build an empire? Will you be the next Linus? Whatā€™s going to happen? What do you want to do? What would be ideal for you?

Oh, that is a great question. I feel like Iā€™m at those crossroads right now. So the last couple of weeks I decided to focus more on YouTube. Iā€™ve had a full-time job outside of YouTube as a software engineer at this small startup for a long timeā€¦ And since then, Iā€™ve put less time in software engineering, and more time in YouTube. So Iā€™m honestly trying to still find my way. I would love to find an editor at some point, only because editing takes a lot of time.

Iā€™d love help with script-writing sometime. Everything I talk about are my own words, which - I always want my YouTube to be my own words, but it could use a little finesse sometimes, or it could use a little bit of help sometimes with some of my ideas.

Iā€™m okay with it being a one-person show right now. Itā€™s taught me a lot about how to write, how to produce, how to edit, how to do audioā€¦ All of these things I didnā€™t know about before. How to teach. I donā€™t want to say Iā€™ve taught, but Iā€™ve mentored people at work, and outside of workā€¦ And teaching people through video, through instructional material is a lot different. You know, zero feedback. Feedback is after the fact. And so itā€™s taught me a lot how to teach.

So I think these next six months are really just going to be focusing on, like you mentioned, the business of YouTube. I donā€™t necessarily want to grow an empire. I mean, I would love to have some help at some point, but I want to keep it authentic to me, and just be able to make this a sustainable business for myself, to be able to support my family doing this, and support doing what I loveā€¦ And thatā€™s combining tech and learning, and teaching too, and exposing people to new things. So yeah, if thereā€™s an audience out there for that, I would just like to capture more of that.

Yeah. Well, in terms of feedback, since I am a watcher/listener - I donā€™t know what the heck they call a person who watches somebodyā€™s YouTube videosā€¦ A consumer, or whatever. Subscriber? Maybe subscriber. Well, for a while there I think I didnā€™t even subscribe. The algorithm just would feed me your stuff, or other peopleā€™s stuff even. So you would be a watcher of somebodyā€™s and not really recognize that youā€™re not a subscriber, which does impact how the algorithm treats your contentā€¦ And thereā€™s all sorts of things that play into that.

But in terms of some direct feedback on your writing, I think you did a great job. I think the way you open up your videos - you ask a questionā€¦ I donā€™t know if itā€™s intentional fully, or how much you sort of like go back and re-examine the words youā€™ve written to scriptwrite your processesā€¦ I think your approach to it is really good. Your pace is good, your writing is goodā€¦ So whenever you consider bringing somebody on for that, I would still do what you can to be the kind of primary writer, and not leverage too much from somebody elseā€¦ Because I think your style is good already.

I do understand the burden that puts on you, because now youā€™ve got to be cognitively available for every piece of the process of building the thing. Youā€™d mentioned before, in the pre-call, that you released a video today. And half the battle is doing the thing, and half the battle is releasing the thing, and being there for the distribution process, and the questions that come from there, and the attention that comes from that. And I totally get that.

We have a saying around hereā€¦ Three things, actually. So kind of three pillars that kind of guide us. ā€œKeep the main thing the main thingā€, ā€œSlow and steady winsā€, and ā€œIf you feel like youā€™re going too fast, slow down and check yourself.ā€ So whatever pace you feel is your paceā€¦ Just because you say ā€œSlow and steadyā€, that doesnā€™t really mean slow. It just means a pace at which you can go steady. So you can be going really fast, but still be going slow and steady, because youā€™re at a steady pace.

[01:28:06.04] So pick your momentumā€¦ But if you feel like youā€™re not able to keep up, and the things that matter most to you, the main thing, ā€œKeep the main thing the main thingā€ - if youā€™re losing your grip on that, slow down and check yourself. Thatā€™s the rudders and the levers we tend to pull, having done this for 14+ years, and making a living doing it. This year has been the most unique year of all yearsā€¦ But thatā€™s our guiding principles, so to speak.

And then I think the last one is ā€œListeners firstā€, in our case, because weā€™re audio. So listener-first. Everything we do is based on the listener. If I donā€™t think theyā€™re a brand - if itā€™s a promotional thing - that they should hear, Iā€™m not going to work with them in any sort of business way. If itā€™s a piece of content, or a topic that we donā€™t feel the listener is going to engage in, or if how we speak - like I mentioned before, we remove the explicit tag off our shows for that reason. We want people to be in the car with their moms, their grandfathers, their kids, their dogs, whoever may get offended by offensive speech; you may not offend us, but you may offend somebody else, and weā€™re gonna do our best to curb that, so that we can hit the widest possible audience.

We always even say too, the hacker generation doesnā€™t begin at 20. They may begin at nine, or five, or whatever. My kids are really into that. Iā€™ve got a seven-year-old. Would I want my show playing? Yeah, he listens to my show when Iā€™m QA-ing it. He doesnā€™t always listen to it, but Iā€™m happy to play my content as a QA process while Iā€™m driving my truck, or car, or whatever, because I know that itā€™s safe. I know what the content is, and I want our listeners to have that same feeling. So listener-first, slow and steady, slow down and check yourself, keep the main thing the main thing.

I like it. Yeah, this is exactly what I neededā€¦ So I appreciate your advice.

Hey, yeah, Iā€™m happy to be ā€“ not just come on our show, happy to be a friend. That feedback process is insanely challenging, even with our stuff. Only till a couple of years ago did we start doing certain things that sort of solicited to some degree, or invited that feedback process. I think sometimes when you do such a good job, like I think you do - you do a great job - you seemā€¦ Not that youā€™re not approachable, but that maybe youā€™re too cool. That you wonā€™t say yes to coming on a rando homelab podcast. I didnā€™t think you would respond, honestly. I was like ā€œTimā€™s not gonna respond.ā€ And you responded so graciously, pretty quickly. And the email has that auto reply, so that may turn some people off; and I have no idea why you do that, you may have your reasons, butā€¦ If you want feedback, you have to provide feedback mechanisms.

I watch a lot of your stuff, but Iā€™m on zero of Twitch. So your live streams almost donā€™t exist to me. Maybe Iā€™m missing out. I just donā€™t livestream with folks, ever, really, and I donā€™t know who ā€“ maybe itā€™s a thing with my age demographic or whatever, but Iā€™ve just never done it with really anybody. And so I would just find ways ā€“ if you want that feedback, or that friendship, or that loop, so to speak, of not just you in the echo chamber, but you with, like, in the YouTube comments, find ways to recreate that somewhere else. But again, thatā€™s even half the battle too, because now youā€™ve got maybe a Slack or a Discord youā€™ve got to manage; now you got one more self-hosted thing youā€™ve got to CI and test in Kubernetes, and all this good stuffā€¦ So at every layer, Tim, thereā€™s just a new battle to consider how to win.

Thatā€™s right. Thatā€™s right. Yeah, I really appreciate it. All great advice.

Cool. Whatā€™s left? Anything left unsaid? Is there anything I didnā€™t ask you that you want to include here, right as weā€™re closing out this edition, this long edition of Changelog & Friends on homelabs?

You know, I donā€™t I donā€™t think so. Iā€™m just super-appreciative of the time and sharing me with your community, and feeling like ā€œHey, Tim is someone I want to share with your community.ā€ Because it means a lot. It means a lot to me. And Iā€™m the same way, I donā€™t curse, so you donā€™t even have to say to me; I wouldnā€™t even have cursed anyway. I like to keep a safe and welcoming chat or dialogue with anyone, so that anyone can play me anywhere and not second-guess ā€œDo I need to turn it down, or change the channel?ā€

Yes, ā€œWill he say something wrong?ā€ Super-quickā€¦ I watched this YouTuber, Sam the Cooking Guy. I donā€™t know if you cook, Tim, but my side hobby is backyard barbecue.

I donā€™t love to cook, but I love to cook certain things. And I watch Sam the Cooking Guy.

Well, I love to eat.

Yeah, I love to eat. I love to eat good food. And so nobodyā€™s making me good foodā€¦ My wife makes me amazing food, but I donā€™t have a chef. I donā€™t have anything like that, so Iā€™ve gotta be my own chef. Sam the Cooking Guy is amazing, but he is notorious for cussing. Itā€™s a cooking show. Itā€™s like Emeril, but way worse. Not on cable TV. But amazing food, amazing guy. I love his attitude, and I almost wouldnā€™t take Sam without the cursing, but I canā€™t watch Sam with my kids around. So I have to confirm when itā€™s safe for me to watch Sam the Cooking Guy. And if I do want them to watch some of the stuff heā€™s doing because itā€™s entertaining - well, I have to be like pre-watching it. So yeah, anywaysā€¦

But yeahā€¦ Tim, I appreciate the content you produce. Keep fighting the good fight, keep being curious like you areā€¦ Find a way to make it a sustainable business, and if you want a friend to help you along the way, Iā€™d be happy to be that friend for youā€¦ But thank you so much for coming on here and just sharing your time and sharing your homelab journey, and some of the opinions you have. Thank you.

Thank you so much, Adam. I appreciate it.

Changelog

Our transcripts are open source on GitHub. Improvements are welcome. šŸ’š


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK