An open-source web scraper for OLX (Indonesian classifieds platform) with a modern React frontend for browsing and searching scraped listings.
Features
- Complete Scraping: Extracts listings, prices, locations, images
- Search Functionality: Filter by category, location, price range
- Image Gallery: View all product images
- Contact Information: Extract seller contact details
- Real-time Updates: Periodic scraping for fresh data
- React Frontend: Clean UI for browsing results
- REST API: Express.js backend with API endpoints
Implementation
- Backend: Node.js with Express.js and Cheerio
- Frontend: React with modern hooks and state management
- Scraping Engine: Puppeteer for dynamic content
- Data Storage: JSON files and optional database support
- Responsive Design: Works on all devices
Use Cases
Perfect for market research, price comparison, and data analysis of classified listings in Indonesia.