Organizing Terraform Code for Scalability and Maintainability
https://terrateam.io/blog/terraform-code-organization
Managing Infrastructure as Code (IaC) at scale is fundamentally different from handling a handful of resources. While getting started with Terraform/OpenTofu is relatively straightforward, maintaining large-scale infrastructure deployments introduces challenges that can’t be solved by simply writing more code. Code organization becomes a critical factor in whether your infrastructure remains manageable or devolves into a maintenance nightmare.
https://terrateam.io/blog/terraform-code-organization
AWS PrivateLink Cross-Region Connectivity
https://towardsaws.com/aws-privatelink-cross-region-connectivity-5c7db4b1ff7d
AWS PrivateLink provides a secure method for sharing and accessing services across VPCs and accounts. It ensures that all traffic remains within the AWS network, avoiding exposure to the public internet. Before December 2024, both service providers and consumers were required to be in the same AWS Region. With the launch of native cross-region connectivity for AWS PrivateLink, you can now share and access VPC endpoint services across different Regions.
https://towardsaws.com/aws-privatelink-cross-region-connectivity-5c7db4b1ff7d
Can I TF
https://cani.tf
As time passes, OpenTofu and Terraform become more distant from each other. CanI.TF helps us to understand their differences quickly.
https://cani.tf
terraform-module-releaser
https://github.com/techpivot/terraform-module-releaser
Simplify the management of Terraform modules in your monorepo with this GitHub Action, designed to automate module-specific versioning and releases. By streamlining the Terraform module release process, this action allows you to manage multiple modules in a single repository while still maintaining independence and flexibility. Additionally, it generates a beautifully crafted wiki for each module, complete with readme information, usage examples, Terraform-docs details, and a full changelog.
https://github.com/techpivot/terraform-module-releaser
httptap
https://github.com/monasticacademy/httptap
View the HTTP and HTTPS requests made by any linux program by running httptap -- <command>.
https://github.com/monasticacademy/httptap
Forwarded from DevOps от первого лица (Виталий Бутурлин)
byurrer.ru
Как устроен Vinyl в Tarantool
Разберемся как работает движок Vinyl в Tarantool, какие он создает файлы и для чего они нужны, что такое LSM-дерево и как оно выглядит, на практике посмотрим что с этим делать.
В прошлый раз было управление спейсами Tarantool со стороны пользователя, в этот раз углубляемся внутрь и разбираемся как устроен движок
🦧 Поверхностное представление о том, что
🤯 Оказывается здесь не классическое
Меня интересовали концептуальные механизмы с точки зрения администратора этой СУБД, поэтому в статье разберем:
🧐 Что такое
🗂 Из чего состоит файловая структура спейса на
🖼 Визуализируем хранилище
📥 Посмотрим как данные перемещаются по пирамиде
🛠 Определим как управлять габаритами пирамиды и на что они влияют
🎡 Какие фоновые процессы обслуживают движок
💣 Как работа
🪣 Как очистить дерево от старых версий и удаленных кортежей и вообще почему есть в этом необходимость
Детали в статье: https://byurrer.ru/tarantool-vinyl
P. S. если есть непонятки или я что-то упустил - пишите в комментариях ⬇️
Vinyl
.🦧 Поверхностное представление о том, что
Vinyl
работает с диском не дает полного понимания механизмов заложенных внутри для обслуживания кластера.🤯 Оказывается здесь не классическое
B-tree
как в реляционных СУБД типа InnoDB
в MySQL или Postgress, а LSM-tree
со всеми вытекающими. В документации по Vinyl
есть исчерпывающее объяснение разницы, но ...Меня интересовали концептуальные механизмы с точки зрения администратора этой СУБД, поэтому в статье разберем:
🧐 Что такое
Vinyl
🗂 Из чего состоит файловая структура спейса на
Vinyl
🖼 Визуализируем хранилище
Vinyl
(это пирамида)📥 Посмотрим как данные перемещаются по пирамиде
🛠 Определим как управлять габаритами пирамиды и на что они влияют
🎡 Какие фоновые процессы обслуживают движок
Vinyl
💣 Как работа
Vinyl
влияет на систему🪣 Как очистить дерево от старых версий и удаленных кортежей и вообще почему есть в этом необходимость
Детали в статье: https://byurrer.ru/tarantool-vinyl
P. S. если есть непонятки или я что-то упустил - пишите в комментариях ⬇️
Product management is broken. Engineers can fix it
https://newsletter.posthog.com/p/product-management-is-broken-engineers
How we've redefined the PM and engineer relationship
https://newsletter.posthog.com/p/product-management-is-broken-engineers
feluda
https://github.com/anistark/feluda
🔎 Feluda is a Rust-based command-line tool that analyzes the dependencies of a project, notes down their licenses, and flags any permissions that restrict personal or commercial usage.
https://github.com/anistark/feluda
Postgres in the time of monster hardware
https://www.enterprisedb.com/blog/postgres-time-monster-hardware
I don't know if you followed the release of the last generation of CPUs. AMD's latest Genoa CPU (AMD EPYC™ 9965) can run 768 threads. It has 192 cores per socket and 2 threads per core, with 2 sockets. Imagine adding 10 TB of RAM to such a beast! Of course, everyone will think of how useful it will be for virtualization. As a database person, I'd rather ask myself what Postgres could do with so many resources. I love simplicity in architecture. But I often meet customers with huge resource needs. With average hosts nowadays, the best answer for them is sometimes multi-parallel processing (MPP).
So, with this new hardware, can we stop using horizontal scalability? To understand the impact of running PostgreSQL on it, we must examine a few technical limits. The analysis will begin with NUMA (Non-Uniform Memory Access) architecture. Next, we will address I/O bandwidth limits. They are a big factor, no matter the CPU or memory. Next, we will look at how PostgreSQL behaves with many connections. This topic has historical limits that bring up key questions. Finally, we will test parallel queries. We will examine their scalability and effectiveness on systems with many CPU threads.
https://www.enterprisedb.com/blog/postgres-time-monster-hardware
Nping
https://github.com/hanshuaikang/Nping
Nping is a Ping tool developed in Rust. It supports concurrent Ping for multiple addresses, visual chart display, real-time data updates, and other features.
https://github.com/hanshuaikang/Nping
kvm
https://github.com/jetkvm/kvm
JetKVM is a high-performance, open-source KVM over IP (Keyboard, Video, Mouse) solution designed for efficient remote management of computers, servers, and workstations. Whether you're dealing with boot failures, installing a new operating system, adjusting BIOS settings, or simply taking control of a machine from afar, JetKVM provides the tools to get it done effectively.
https://github.com/jetkvm/kvm
tailpipe
https://github.com/turbot/tailpipe
Tailpipe is the lightweight, developer-friendly way to query logs.
Cloud logs, SQL insights. Collects logs from cloud, container and application sources. Query and analyze your data instantly with the power of SQL, right from your terminal.
Fast, local, and efficient. Runs locally, powered by DuckDB's in-memory analytics and Parquet's optimized storage.
An ecosystem of prebuilt intelligence. MITRE ATT&CK-aligned queries, prebuilt detections, benchmarks, and dashboards, all open source and community-driven.
Built to build with. Define detections as code, extend functionality with plugins and write custom SQL queries.
https://github.com/turbot/tailpipe
yaak
https://github.com/mountain-loop/yaak
Yaak is a desktop API client for interacting with REST, GraphQL, Server Sent Events (SSE), WebSocket, and gRPC APIs.
https://github.com/mountain-loop/yaak
It's a log eat log world!
https://obakeng.substack.com/p/its-a-log-eat-log-world
Let's discuss logging - unstructured, structured and canonical log lines - what they are and what value they bring to your production systems.
https://obakeng.substack.com/p/its-a-log-eat-log-world
Redis as a Primary Database for Complex Applications
https://faun.pub/redis-as-a-primary-database-for-complex-applications-501ced31f923
How Redis can be used as a primary database for complex applications that need to store data in multiple formats?
https://faun.pub/redis-as-a-primary-database-for-complex-applications-501ced31f923
Slicing Up—and Iterating on—SLOs
https://www.honeycomb.io/blog/slicing-up-and-iterating-on-slos
One of the main pieces of advice about Service Level Objectives (SLOs) is that they should focus on the user experience. Invariably, this leads to people further down the stack asking, “But how do I make my work fit the users?”—to which the answer is to redefine what we mean by “user.” In the end, a user is anyone who uses whatever it is you’re measuring.
https://www.honeycomb.io/blog/slicing-up-and-iterating-on-slos
Unlocking Kubernetes Observability with the OpenTelemetry Operator
https://www.dash0.com/blog/unlocking-kubernetes-observability-with-the-opentelemetry-operator
https://www.dash0.com/blog/unlocking-kubernetes-observability-with-the-opentelemetry-operator