Today I would be making some soup. A beautiful soup. Beautiful Soup is a library in Python to extract data from the web. This lesson was particularly gruelling and challenging for me. I spent a couple of nights troubleshooting issues one after another, and another. Took me about 1-2 weeks to learn the very basics of beautiful soup in python.

Initially, when I was learning beautiful soup, I thought to myself what projects could be useful in the area of finance. Scraping stock prices and volume data is certainly not worth the time. It can easily be done with the yfinance library, alpha vantage or pandas data_reader.

Similarly, visiting a weather forecast website to scrape data wouldn’t be that value-adding either if I can just visit that web page directly and view it with ease.

So it has to be something that is useful, automated, time-saving and ideally insightful. After much thought, I