Posts

Showing posts with the label Complex programs

Featured Post

14 Top Data Pipeline Key Terms Explained

Image
 Here are some key terms commonly used in data pipelines 1. Data Sources Definition: Points where data originates (e.g., databases, APIs, files, IoT devices). Examples: Relational databases (PostgreSQL, MySQL), APIs, cloud storage (S3), streaming data (Kafka), and on-premise systems. 2. Data Ingestion Definition: The process of importing or collecting raw data from various sources into a system for processing or storage. Methods: Batch ingestion, real-time/streaming ingestion. 3. Data Transformation Definition: Modifying, cleaning, or enriching data to make it usable for analysis or storage. Examples: Data cleaning (removing duplicates, fixing missing values). Data enrichment (joining with other data sources). ETL (Extract, Transform, Load). ELT (Extract, Load, Transform). 4. Data Storage Definition: Locations where data is stored after ingestion and transformation. Types: Data Lakes: Store raw, unstructured, or semi-structured data (e.g., S3, Azure Data Lake). Data Warehous...

How to Write Complex Python Program Using Functions

Image
Here is an example of complex python program written using functions. Many times, in job interviews, you need to give a written test. There, you may need to answer tricky programs. Historically, people are afraid to take a test.  Especially in python .  Complex Python programs Below are the Complex Python Program Using Functions and examples of how to write the code. Counting lower and upper case letters Creating a list 1. Counting lower and upper case letters Below program counts the upper and lower case letters. def count_lower_upper(s): dlu = {'Lower': 0, 'Upper': 0} for ch in s: if ch.islower(): dlu['Lower'] += 1 elif ch.isupper(): dlu['Upper'] += 1 return(dlu) d = count_lower_upper('James BOnd') print(d) d = count_lower_upper('Anant Amrut Mahalle') print(d) Also read : How to Lose Your Weight 2. Creating a List Here it uses two input lists for creating a new list. Additionall...