PHP Classes

Web Crawler using MySQL DB: Retrieve Web pages and store links in a database

Recommend this page to a friend!
  Info   View files View files (4)   DownloadInstall with Composer Download .zip   Reputation   Support forum (2)   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStar 52%Total: 3,386 All time: 1,015 This week: 106Up
Version Licenses PHP version Categories
dbcrawler 1.0.0BSD License, GNU ...4.0HTML, Databases, Searching
Description 

Author

This class can be used to retrieve Web pages and store the URLs links in a MySQL database.

It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.

The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.

The class can also display in a Web page the list of URLs already stored from a given domain.

Picture of vivek
Name: vivek <contact>
Classes: 1 package by
Country: India India
Age: ???
All time rank: 94755 in India India
Week rank: 550 Up46 in India India Up

  Files folder image Files  
File Role Description
Plain text file spider_advanced.class.php Class advanced spider
Plain text file spider_advanced_example.php Example advanced class example file
Accessible without login Plain text file spider_simple.class.php Class DBCrawler
Plain text file spider_simple_example.php Example example

 Version Control Unique User Downloads Download Rankings  
 0%
Total:3,386
This week:0
All time:1,015
This week:106Up
User Ratings User Comments (1)
 All time
Utility:75%StarStarStarStar
Consistency:75%StarStarStarStar
Documentation:-
Examples:75%StarStarStarStar
Tests:-
Videos:-
Overall:52%StarStarStar
Rank:2272
 
Warning: include(spider.
15 years ago (milo)
35%StarStar