Postmortem: Site Maintenance - March 2023

Hi everyone.

Firstly, welcome to all the new Patrons who joined over the last few weeks. And returning patrons, thanks for your continued support.  If you haven't already, connect your Patreon account to your site and Discord accounts to claim your benefits.

I am excited to share my recent experience of bringing Open3DLab to Kubernetes with you all. This is what the recent migration and downtime was all about. In this article, I'll describe what Kubernetes is in layman's terms, the process of migration, the challenges we faced, and the fun I had while exploring this new environment.

What is Kubernetes?

In simple terms, Kubernetes is an open-source platform that automates the deployment, scaling, and management of containerized applications. Containers are like lightweight, portable, and self-contained packages that hold everything needed to run a piece of software. In this case, the web server that runs the three site. Kubernetes helps in efficiently managing these containers, ensuring that your application runs smoothly and can scale up or down based on demand.

Migrating Open3DLab to Kubernetes

The decision to migrate Open3DLab to Kubernetes was a crucial step towards improving the platform's reliability and scalability. To my delight, the migration process turned out to be fairly painless! Despite the intermittent downtime, behind the scenes the migration was fairly uneventful. I also hope you enjoyed the maintenance page I put together. Most of the work involved migrating the Database server to the new environment. I had initially allotted the entire day for this, but it turns out, this was done within an hour of starting the maintenance. The rest was done by simply moving our existing Docker containers over to Kubernetes.

Challenges Faced

As with any migration, there were some challenges along the way. The majority of the problems we encountered were related to DNS and load balancing issues. It took some time to iron out these kinks and ensure that our domain names were pointing to the correct locations, and to have the load balancers pick up the right SSL certificates.

Another issue we faced was that the current load-balancers used in our Kubernetes setup do not support IPv6. While this might be a temporary setback, I am optimistic that IPv6 support will return in the future, enabling even better connectivity for our users.

Learning and Adapting

During the migration, I realized there were some small things I initially missed, like redirecting the 'www.' domains to the top-level domain. These were quickly resolved, and I have to say that I had a lot of fun playing around with the new Kubernetes environment. It's always a great experience to learn new technologies and see the improvements they bring to the table.

Focusing on What Matters

Now that the migration is mostly behind us, I can shift my focus back to the things that matter most - improving Open3DLab's user experience. I am eager to work on enhancing the platform's UI, making it more intuitive and user-friendly.

In Conclusion

Migrating Open3DLab to Kubernetes has been an exciting and educational journey. The experience has given me new insights into managing containerized applications and has laid a strong foundation for future growth. I am grateful for your continued support, and I can't wait to show you the improvements we have in store for Open3DLab!

I want to thank the Patrons once more. Your pledge helps keep the site running, and I couldn't be more thankful.

Best of luck to you all.

Salaryman