Motivation: The General Elections in India are scheduled to be held between April and May. The volume of data generated through news and social media is huge. What an intriguing project to take up as a data scientist! Data Science offers algorithms to analyze those text, audio, and video data to infer the nation’s sentiment before, during, and after the elections. The statistical analysis of information available from all sources can provide a deep insight […]
May 1, 2020
Motivation We are inching closer to one of the most anticipated events in India — the General Elections! Everyone is hooked to the latest news and developments (and trust me, there is something happening every single day). This is a great time to be a data scientist. Why? There is so much data being generated thanks to these developments. We can come up with tons of use cases — visualizing sentiments, predicting sentiments, building models […]
Multi-class Classification with Linear and Boosted Trees Classifier Introduction Machine learning models include the step of preprocessing or feature engineering before the data is actually trainable. Feature Engineering includes normalizing and scaling data, encoding categorical values as numerical values, forming vocabularies, and binning of continuous numerical values. Distributed frameworks like Google Cloud Dataflow or Apache Spark are often well known for applying large scale data preprocessing. To remove the inconsistency between training and serving ML models from […]
