Posts

Showing posts with the label Cleaning data

Featured Post

15 Python Tips : How to Write Code Effectively

Image
 Here are some Python tips to keep in mind that will help you write clean, efficient, and bug-free code.     Python Tips for Effective Coding 1. Code Readability and PEP 8  Always aim for clean and readable code by following PEP 8 guidelines.  Use meaningful variable names, avoid excessively long lines (stick to 79 characters), and organize imports properly. 2. Use List Comprehensions List comprehensions are concise and often faster than regular for-loops. Example: squares = [x**2 for x in range(10)] instead of creating an empty list and appending each square value. 3. Take Advantage of Python’s Built-in Libraries  Libraries like itertools, collections, math, and datetime provide powerful functions and data structures that can simplify your code.   For example, collections.Counter can quickly count elements in a list, and itertools.chain can flatten nested lists. 4. Use enumerate Instead of Range     When you need both the index ...

10 Excusive Steps You need for Web Scrapping

Image
Here're ten Python technics to clean the scraped data. The scraped  Text has unwanted hidden data . So, as part of cleaning it try to remove these ten in your data. 10 Steps for Web scrapping Data is prime input for  text analytics projects . After cleaning, you can feed to Machine/Deep Learning systems. Removing HTML tags Tokenization Removing unnecessary tokens and stop-words Handling contractions Correcting spelling errors Stemming Lemmatization Tagging Chunking Parsing 10 Technics to Clean Text in Python 1. Removing HTML tags The unstructured text contains a lot of noise ( data from web pages, blogs, and online repositories.)when you use web/screen scraping.  The HTML tags, JavaScript, and Iframe tags typically don't add much value to understanding and analyzing text. Our purpose is to remove HTML tags, and other noise. 2. Tokenization Tokens are independent and minimal textual components. And have a definite syntax and semantics. A paragraph of text or a text documen...