NewStats: 3,265,016 , 8,185,341 topics. Date: Friday, 13 June 2025 at 07:30 AM 5b4t

Hello Nairalanders,

I want to share my experience in crawling leads from Jiji. As a web scraping enthusiast, I've tackled various sites, but this one proved to be difficult. This is because the phone numbers are in the product detail page and you have to be logged in to get it. Another issue I faced was that the website is loaded with java script and uses infinite scrolling.

I was able to circumvent these road blocks by using selenium to to the site with my personal details after which I saved the cookies as a json file. As the cite uses infinite scrolling I scraped all the sellers url links to a csv file. I then read the url links so as to crawl the site using the links.

my details have been saved as cookies in a json file, In the process of crawling the site again using the URLs, I applied the cookies from the json file. The crawler visited each seller's detail page using the saved URL links and clicked the "Show " button to extract the information.

Retailers specializing in second-hand items like laptops can leverage this approach coupled with applied analytics on the scraped the data to gain swift access to mouth-watering deals, faster than regular visitor

You can check out the code for executing the project in my github repo: https://github.com/StephDAnalyst/JijiLeadScraping

How can the data benefit my business?

How can I make money from this

GOSPELTRUTH31:
How can I make money from this

How it works often on Upwork or Fiverr clients make request to scrap specific websites or leads for cold email marketing.

DataMina:

How it works often on Upwork or Fiverr clients make request to scrap specific websites or leads for cold email marketing.

Do you offer classes online

GOSPELTRUTH31:


Do you offer classes online

Nope I don't but I am only interested in landing webscraping gigs. To learn webscraping, you can check out freecodecamp on YouTube

DataMina:
Hello Nairalanders,

I want to share my experience in crawling leads from Jiji. As a web scraping enthusiast, I've tackled various sites, but this one proved to be difficult. This is because the phone numbers are in the product detail page and you have to be logged in to get it. Another issue I faced was that the website is loaded with java script and uses infinite scrolling.

I was able to circumvent these road blocks by using selenium to to the site with my personal details after which I saved the cookies as a json file. As the cite uses infinite scrolling I scraped all the sellers url links to a csv file. I then read the url links so as to crawl the site using the links.

my details have been saved as cookies in a json file, In the process of crawling the site again using the URLs, I applied the cookies from the json file. The crawler visited each seller's detail page using the saved URL links and clicked the "Show " button to extract the information.

Retailers specializing in second-hand items like laptops can leverage this approach coupled with applied analytics on the scraped the data to gain swift access to mouth-watering deals, faster than regular visitor

You can check out the code for executing the project in my github repo: https://github.com/StephDAnalyst/JijiLeadScraping

Finally. Your please

OP,

Word of advice, never use your personal details for webscrapping

landiqa:


Finally. Your please

0813six3six5six03

airsaylongcome:
OP,

Word of advice, never use your personal details for webscrapping

Yea thanks I have changed that

Is webscraping lucrative?

blaskikv:
Is webscraping lucrative?

Sure

blaskikv:
Is webscraping lucrative?

Data Extraction! Absolutely, especially if you can by anti bots/capcha mechanism on website + being able to integrate the data into a database and automation

DataMina:
Hello Nairalanders,

I want to share my experience in crawling leads from Jiji. As a web scraping enthusiast, I've tackled various sites, but this one proved to be difficult. This is because the phone numbers are in the product detail page and you have to be logged in to get it. Another issue I faced was that the website is loaded with java script and uses infinite scrolling.

I was able to circumvent these road blocks by using selenium to to the site with my personal details after which I saved the cookies as a json file. As the cite uses infinite scrolling I scraped all the sellers url links to a csv file. I then read the url links so as to crawl the site using the links.

my details have been saved as cookies in a json file, In the process of crawling the site again using the URLs, I applied the cookies from the json file. The crawler visited each seller's detail page using the saved URL links and clicked the "Show " button to extract the information.

Retailers specializing in second-hand items like laptops can leverage this approach coupled with applied analytics on the scraped the data to gain swift access to mouth-watering deals, faster than regular visitor

You can check out the code for executing the project in my github repo: https://github.com/StephDAnalyst/JijiLeadScraping

Great job! Being able to handle the infinite scrolling on jiji page, different websites with different technicalities when it comes to data extraction. I did a project for a client recently, Airbnb and zillow, omoh the zillow gave me wahala small, reasons were, all the Web elements did not load except you scroll the page bit by bit down to the button, and to be able to scroll the page you have to minimise the driver window., very interesting.
Nice one op.

BlackhatMentor:


Sure

It sells on Upwork and Fiverr like pure water but being able to break through is the issue

Felixitie:


Great job! Being able to handle the infinite scrolling on jiji page, different websites with different technicalities when it comes to data extraction. I did a project for a client recently, Airbnb and zillow, omoh the zillow gave me wahala small, reasons were, all the Web elements did not load except you scroll the page bit by bit down to the button, and to be able to scroll the page you have to minimise the driver window., very interesting.
Nice one op.
Thanks. You are right there is no one perfect fit all to scraping. If it was that straight forward the client wouldn't have needed your service 👌

blaskikv:
Is webscraping lucrative?

see question Ooo. why you think elonMusk dey do everything possible to discourage it on twitter ?

That doesn't mean such skill is for everyone, before una go begin overFocus on am. To bebst of ma knowledge, every sector pays well - you just need be atleast good enough