Tweet Scraping with Selenium

Scraping tweets with specific keyword by using selenium

Setup The Project

Install Python

I recommend that you install Python3.9x

Install Libraries

You need to install libraries by typing 'pip install -r requirements.txt' command.

Download Chromedriver

Download the ChromeDriver into your project's folder.

How this is working?

We are scraping tweets with selenium library. Here you can set the counter to any number you want. An average of 4 tweets are captured in each loop (we scroll the mouse and there are 4 new tweets in front of us), so when I set the counter to 10, I pulled up to 48 tweets. Lastly, we're looking at the data, that's all. Besides, we are using selenium in headless mode.