I always wondered how our life would have been if Google hadn’t been there. We depend on most of things from our personal to professional life on Google and it’s app. Not even a single day goes by without accessing any of these Google apps. Our life is partially dependent on Google. My Mom always…
Pandas Exploratory Data Analysis: Data Profiling with one single command
We cannot see all the details through a large dataset and its important to go for a Exploratory data analysis. As a Data Scientist you would be always curious to know for a new data set what are the missing values in a column? How are the features co-related? What is the max, min or…
How to merge multiple csv files and upload to MySQL or PostgresSQL using Python
Often we encounter this challenge to deal with multiple csv files and we start looking out for options to import these files to MySQL or PostgresSQL Databases. For many of us this possess a challenge because we don’t know a good tool or a way to merge these csv files into one and import it…
How to Optimize your Pandas Code
Working with large dataset has always been a challenging and daunting task. The data is growing everyday but the resources and computational power required to process this big data is limited. In last few year we have seen Pandas growing popularity within the data science fraternity and it is one of the widely used python…
How to use AI powered Query in Google Spreadsheet
Dealing with data has always been a daunting task no matter how much data geek you are. Being a Data Scientist the moment I see a new dataset the first thing which comes to my mind is OMG! How would I clean or explore this data? Can I ever do a EDA(Exploratory Data Analysis) on…
Color Columns, Rows & Cells of Pandas Dataframe
I always wanted to highlight the rows,cells and columns which contains some specific kind of data for my Data Analysis. I wanted to Know which cells contains the max value in a row or highlight all the nan’s in my data. and Pandas has a feature which is still development in progress as per the…
Hey Google! When did I ask you to access my Purchase details?
Source: Google Image We live in a world full of data . Some of these data we choose to reveal and publish on Facebook,Google and Other social media sites. This includes our personal pics,tweets etc. I am happy to use a social media platform to share some of my personal moments with my friends and…
Text Matching: Cosine Similarity
Recently I was working on a project where I have to cluster all the words which have a similar name. For a novice it looks a pretty simple job of using some Fuzzy string matching tools and get this done. However in reality this was a challenge because of multiple reasons starting from pre-processing of…
Read Google Spreadsheet data into Pandas Dataframe
Many a times it happens that we have our data stored on a Google drive and to analyze that data we have to export the data as csv or xlsx and store it on a disk to convert into a dataframe. To over come this problem of Exporting and loading the data into Pandas Dataframe,…
How to read HTML Tables with Pandas
View the code on Gist.