Posts

Showing posts with the label Scaling

Featured Post

14 Top Data Pipeline Key Terms Explained

-
Image
 Here are some key terms commonly used in data pipelines 1. Data Sources Definition: Points where data originates (e.g., databases, APIs, files, IoT devices). Examples: Relational databases (PostgreSQL, MySQL), APIs, cloud storage (S3), streaming data (Kafka), and on-premise systems. 2. Data Ingestion Definition: The process of importing or collecting raw data from various sources into a system for processing or storage. Methods: Batch ingestion, real-time/streaming ingestion. 3. Data Transformation Definition: Modifying, cleaning, or enriching data to make it usable for analysis or storage. Examples: Data cleaning (removing duplicates, fixing missing values). Data enrichment (joining with other data sources). ETL (Extract, Transform, Load). ELT (Extract, Load, Transform). 4. Data Storage Definition: Locations where data is stored after ingestion and transformation. Types: Data Lakes: Store raw, unstructured, or semi-structured data (e.g., S3, Azure Data Lake). Data Warehous...
Post a Comment
Read more

Cloud Computing: Horizontal Vs. Vertical Scaling

-
Image
The purpose of cloud computing is resource utilization. You can scale up the resources in two ways - vertical and horizontal. Adding resources, you can do either horizontally and vertically . The advantages and drawbacks you can find in simple words. Scaling 1. Horizontal Scaling Advantages You can increase workloads in small steps. The upgrade-cost is far less. Scale the system as much as needed. Drawbacks Dependency on software applications is more for Data distribution and parallel processing. On top of that, fewer software applications exist in the market. You May Also Like:  9 Top Services AWS Provided 2. Vertical Scaling Advantages Since it is a single machine, it is easy to manage. On the fly, you can increase workloads. Drawbacks It is expensive. You need a huge investment. The machine should be powerful to take more workloads - future use. Below is the List of Resources that You can do both Horizontal and Vertical Scaling Platform Scaling Network Scaling Container Scaling...
Post a Comment
Read more