Web Scraping with selenium to get coordinates

Today I will teach you how to get some coordinates from a list of address in the most minimal time posible.

Install python and make sure you install the pip as well just run pip in the command or shell.

Now we need to check our chrome version, this will help us to know witch crhomedriver we need to download. We need to go to Setting > About Chrome.

Now we are ready to build our program.

In my local I create a folder name Python so in there I put all my inputs and output, but you could make it better.

We will make 3 scripts in order to make life easy. The first one I call getCoordanites.py this will have just one function that will scrap the information that we need. The second one is something silly is just to create a csv file. And the third one is the executable, in this one we can scrap with one to fifteen windows at the same time.

First import our libraries to use

Create the function

This is really easy as I just said

I will post 3 parts and I will explain what can you modify in there

We import the two script that we just made, also we need pandas and threading, we made 3 blanks list and create a function to iterate with the coordinates function and join everything into a data frame and make our output.

Our input file must consist with at list 2 columns with this names “ID” and “ADDRESS”

We create 4 blanks list, now the most important part here is r, d variables, in my example I want to make each window to scrap 25 address, you can change this. So r will represents the number of windows and d will be the residue, so the las windows will scrap 25 address or less

In this part we make every thing happen. I use the time library just to display how long it take to run the full scrap.

Related posts:

So you have used PySpark for your latest Data Engineering pipeline to transform large datasets, but have you ever wondered how it works internally? Try to take it in the following bit by bit. PySpark…

Apple just changes its powerful A 13 Bionic chip with the old A 10 Fusion and also adds a Single powerful camera lens in it, which is more accurate and powerful than in the old iPhone 8. A very…

World is full of people lost in eternity, I like to feel for people’s loneliness which deprives them of being happy.It would be like a alien on, our mother earth losing real connection of world.When…