DOCSEARCHbyAlgolia
Submit Docs

Suyuying's Technical Documentation

website·Indexed 29 days ago

https://suyuying.github.io/

A collection of technical notes and guides covering DevOps, SRE, and Infrastructure as Code (IaC). Topics include Terraform, Ansible, Docker, Kubernetes (kubeadm), AWS, Azure, GitHub Actions, pandas, and Linux server administration.

Tokens
137.6K
Snippets
530
Records
922
Agent score
74%

What's inside Suyuying Docs

  1. Overview of the Data Analysis Workflow

    The general process for data analysis typically follows these five steps:

    1. Data Collection
    2. Data Analysis using tools
    3. Visualization
    4. Modeling
    5. Interpretation of results

    Common methods for data collection, ordered from simplest to most complex, include: API $\rightarrow$ Browser Developer Tools (XHR/Fetch) $\rightarrow$ BeautifulSoup (HTML CSS/Tag parsing) $\rightarrow$ Selenium (HTML parsing and interaction).

  3. Overview of AWS EC2 and Bastion Server Architecture

    Amazon EC2 (Elastic Compute Cloud) is an IaaS offering that allows users to manage virtual machines (instances). A common secure architecture involves placing a Bastion server (jump box) in a public subnet to act as a controlled entry point for administrative tasks. The Bastion server manages access to internal resources (like web servers) located in private subnets, protecting them from direct public exposure and DDoS attacks.

  4. Overview of Docker Buildx for multi-arch images

    Docker Buildx is a CLI tool provided by Docker to build images from a Dockerfile. Its primary feature is the ability to build cross-platform images supporting multiple CPU architectures (e.g., x86, ARM, IBM Power).

    Key concept: Buildx uses 'nodes' (builders) as the hosts that perform the image creation. This differs from 'docker context', which manages Docker hosts and registries. Multiple nodes can be used to accelerate the build process.

  5. Overview of the Data Analysis Workflow

    The general process of data analysis typically follows these five steps: 1. Data Collection, 2. Data Analysis using tools, 3. Visualization, 4. Modeling, and 5. Interpretation of results. For data collection, the recommended approach is to start with the simplest method: API > XHR/Fetch analysis via Developer Tools > HTML parsing with BeautifulSoup (bs4) > HTML parsing and interaction with Selenium.

  6. Overview of AWS CloudWatch

    AWS CloudWatch provides real-time monitoring of AWS resource status and performance metrics (e.g., CPU utilization, network traffic, storage usage). It allows users to set alarms that trigger notifications when metrics reach predefined thresholds and provides logging capabilities to collect, monitor, and analyze application and resource logs.

  7. Overview of AWS Elastic Load Balancer (ELB) types

    AWS provides several types of load balancers via Elastic Load Balancing (ELB) to handle reverse proxying, SSL termination, and traffic distribution to target groups:

    • Application Load Balancer (ALB): Operates at Layer 7. Primarily used for HTTP and HTTPS traffic.
    • Network Load Balancer (NLB): Operates at Layer 4. Used for TCP, TLS, and UDP traffic.
    • Gateway Load Balancer (GLB): Operates at Layer 3 (Gateway) and Layer 4. Used for network services like NAT and firewalls to distribute traffic to multiple destinations.
    • Classic Load Balancer (CLB): Legacy version, rarely used in new setups.

  8. Overview of AWS CloudTrail

    AWS CloudTrail records and monitors API activity within an AWS account. It is primarily used to audit user operations and track which permissions are actually being used. This is particularly useful when transitioning from development to production to refine IAM Policies and implement the principle of least-privilege permissions.

  9. Overview of Terraform for Infrastructure as Code (IaC)

    Terraform, developed by HashiCorp, is an Infrastructure as Code (IaC) tool that allows users to manage both on-premises and cloud resources using human-readable configuration files. This approach enables version control, reusability, and shared configurations. Terraform can manage a wide range of components, from low-level infrastructure (such as compute, storage, and network resources) to high-level components (such as DNS records and SaaS features).

  10. Overview of AWS CloudWatch

    AWS CloudWatch provides real-time monitoring of AWS resource state and performance metrics (e.g., CPU utilization, network traffic, storage usage). It allows users to set alarms that trigger notifications when metrics reach a predefined threshold and provides logging capabilities to collect, monitor, and analyze application and resource logs.

  11. Overview of AWS CloudWatch capabilities

    AWS CloudWatch provides real-time monitoring of AWS resource status and performance metrics, such as CPU utilization, network traffic, and storage usage. Key capabilities include:

    • Monitoring: Tracking performance metrics of AWS resources.
    • Alarms: Sending notifications when a resource metric reaches a pre-defined threshold.
    • Logs: Collecting, monitoring, and analyzing logs from applications and resources.

  12. Overview of Docker Buildx for multi-arch images

    Docker Buildx is an official Docker CLI tool used to build Docker images from a Dockerfile. Its primary feature is the ability to build images across different platforms and CPU architectures (e.g., x86, ARM, IBM Power). It manages 'nodes' (builders), which are the hosts that actually perform the image construction. This is distinct from Docker contexts, which manage Docker hosts and registries.