PHP Classes

Auto Weibo Crawler: Scrape and parse pages of the Weibo site profiles

Recommend this page to a friend!
     
  Info   Example   View files Files   Install with Composer Install with Composer   Download Download   Reputation   Support forum   Blog    
Last Updated Ratings Unique User Downloads Download Rankings
2024-01-10 (9 months ago) RSS 2.0 feedNot enough user ratingsTotal: 193 All time: 8,552 This week: 455Up
Version License PHP version Categories
autoweibo 1.6Free For Educatio...5PHP 5, Web services
Description 

Author

This class can scrape and parse pages of the Weibo site profiles.

There is one class that uses a Node.js server locally can access the Weibo site and login on behalf of a given user account to have access its profile pages.

Another class retrieves and parses the user profile pages and extract its details like the user posts, titles, body, images, post time, etc..

Picture of Ej Corpuz
Name: Ej Corpuz <contact>
Classes: 1 package by
Country: Philippines Philippines
Age: 33
All time rank: 415836 in Philippines Philippines
Week rank: 206 Up3 in Philippines Philippines Up

Example

<?php

include_once 'scrapeweibo.php';

$username = "username";
$password = "password";
$ssoversion = "1.4.18";
$server = "http://localhost:1337/?";
$weiboLink = 'weiboprofile/pagelink';

$scrape = new scrapeWeibo($username, $password, $ssoversion, $server, $weiboLink);
$datas = $scrape -> getScrape();

?>


Details

autoweibocrawler

Crawl a Weibo profile/page via curl using an existing account.


  Files folder image Files (7)  
File Role Description
Files folder imagedebug (1 file)
Files folder imagenode (1 file)
Files folder imageresults (1 file)
Plain text file autoweibo.php Class Class source
Accessible without login Plain text file index.php Example Example script
Accessible without login Plain text file README.md Data Documentation
Plain text file scrapeweibo.php Class Class source

  Files folder image Files (7)  /  debug  
File Role Description
  Accessible without login Plain text file readme.txt Data Dummy file

  Files folder image Files (7)  /  node  
File Role Description
  Accessible without login Plain text file server.js Data Auxiliary data

  Files folder image Files (7)  /  results  
File Role Description
  Accessible without login HTML file pagesite.html Data Sample output

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.
Install with Composer Install with Composer
 Version Control Unique User Downloads Download Rankings  
 100%
Total:193
This week:0
All time:8,552
This week:455Up