Featured Post

15 Python Tips : How to Write Code Effectively

Image
 Here are some Python tips to keep in mind that will help you write clean, efficient, and bug-free code.     Python Tips for Effective Coding 1. Code Readability and PEP 8  Always aim for clean and readable code by following PEP 8 guidelines.  Use meaningful variable names, avoid excessively long lines (stick to 79 characters), and organize imports properly. 2. Use List Comprehensions List comprehensions are concise and often faster than regular for-loops. Example: squares = [x**2 for x in range(10)] instead of creating an empty list and appending each square value. 3. Take Advantage of Python’s Built-in Libraries  Libraries like itertools, collections, math, and datetime provide powerful functions and data structures that can simplify your code.   For example, collections.Counter can quickly count elements in a list, and itertools.chain can flatten nested lists. 4. Use enumerate Instead of Range     When you need both the index ...

How to Write ETL Logic in Python: Sample Code to Practice

Here's an example Python code that uses the mysql-connector library to connect to a MySQL database, extract data from a table, transform it, and load it as a JSON file. Here's an example:







Python ETL Sample Code


import mysql.connector

import json


# Connect to the MySQL database

cnx = mysql.connector.connect(user='username', password='password',

                              host='localhost',

                              database='database_name')


# Define a cursor to execute SQL queries

cursor = cnx.cursor()


# Define the SQL query to extract data

query = ("SELECT column1, column2, column3 FROM table_name")


# Execute the SQL query

cursor.execute(query)


# Fetch all rows from the result set

rows = cursor.fetchall()


# Transform the rows into a list of dictionaries

result = []

for row in rows:

    result.append({'column1': row[0], 'column2': row[1], 'column3': row[2]})


# Save the result as a JSON file

with open('output.json', 'w') as outfile:

    json.dump(result, outfile)


# Close the cursor and database connection

cursor.close()

cnx.close()

In this example, you will need to replace username, password, localhost, database_name, table_name, column1, column2, and column3 with the appropriate values for your MySQL database and table. 


The code will extract the data from the specified table, transform it into a list of dictionaries, and save it as a JSON file named output.json.

Comments

Popular posts from this blog

How to Fix datetime Import Error in Python Quickly

SQL Query: 3 Methods for Calculating Cumulative SUM

Big Data: Top Cloud Computing Interview Questions (1 of 4)