2
Get information on another website?
source link: https://www.codesd.com/item/get-information-on-another-website.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Get information on another website?
advertisements
I'd like to fetch all latest news from this site (at the center board): http://web.hanu.vn/en/ My latest approach was parsing html by using Simple HTML DOM Parser in PHP but I think it's so slow. My idea is to fetch news from almost 20 similar sites like this site. They are all developed by Moodle so they have the same html format. However, with 1 site it takes several seconds to fetch => 20 sites require a lot of time. Is there any better approach rather than parsing HTML? Or should I store the result in the database and after a period of time updating it rather than fetching it for each user request? Am I doing the so-called "crawling", isn't it?
Or should I store the result in the database and after a period of time updating it rather than fetching it for each user request?
Yes, you should. And stick to parsing HTML, do not use regular expressions for parsing HTML.
And what you are trying to do is web scraping, not yet crawling (unless you really crawl the pages).
Related Articles
PowerShell - HTML Analysis: Get Information from a Website
Update, Script is working with PowerShell V3.0, Thanks @ Doug I want to use the following PowerShell script to get flight status information from Lufthansa. I can see flight status information in the browser, but I haven't found any way to access thi
How do I get information from another form?
I have a problem where I can't get information from a second form in C#. I made a easy program to add some names to a ListView. And somehow I can't get the name from second form. Form 2: // this is second form private String name { get; set; } privat
How can I send information to another website and get its answer in Perl?
In a Perl script (with Ubuntu) I'd like to do something like use Blah; ... ... my $response = &Blah::Fetch($URL, {'method'=>'POST', 'parameters' => \%params}); which I've written for convenience to look a lot like a Prototype.js ajax call, but o
PHP - The fastest way to get content from another website and analyze that content
I have to get a few params of user's from website. I can do it because every user have an unique ID and I can search users by URL: http://page.com/search_user.php?uid=X So I added this URL in for() loop and I tried to get 500 results: <?php $start =
get information from a website with php, recursively browse each HTML node
I have done lot research but I haven't found my answer. I am trying to get some information from webpage, Which have the following HTML structure <div id="xxx" class="some1"> <h1>This is the time</h1> <div class=&q
Get information from another table with Propel?
I have a users table, which has a foreign key with another table called town, Now I'm trying to get all users including the name of the town they belong to, $users = UserQuery::create() ->select(array('fos_user.id, fos_user.username, fos_user.email,
SQL table getting information from another table based on an IF statement with a stored procedure
I am having a problem figuring out how to get column info from a different table then the one I am accessing through a SELECT command and to select certain cells of that column based on a IF statement. Here is the SQL code: SELECT Name, Age, Grant FR
get information from another array where id = id
soo i have 2 tables. train_information user_train_information When somebody submits something in a form. it get put in the train_information table and looks like this: Now, when people are logged in and select the train from a selector. his happens i
How to add get information form another file and use it in a variable
I have a batch program which needs to obtain & use 3 variables as shown below. SET ID-BLUE=X:\ID-BLUE.TXT SET ID-RED=Y:\ID-RED.TXT SET ID-GREEN=Z:\ID-GREEN.TXT The data can be obtained from a user prepared resource file C:\DISKCOLOR.TXT, contents whi
How to get information from an iframe that uses a flash image cursor using javascript?
I am developing a Wordpress theme. In one page I have to use iframe to get content from another website. That page is an image slider and it uses flash for it. I don't have any idea about flash. It uses something like AC_FL_RunContent. I need to get
How do I get a specific text from another website using jquery?
I need to get text found within a span, within a div, within a div, etc. in another website (cross-domain) After hours and hours of researching, I still have not been able to get anything to work. As of right now, this is what I have: <head> <scr
How to get json data from another website in Flask?
I want to make a website with Flask to show some data posted from another website such as this one.In short,I want to list the data from that website. Should I use this method: flask.Request.get_json()? I do not know how to get a Request object. Coul
How to get information on the referral link?
Suppose I have one link in Website A and is redirected to the Website B, when it click over the link. Website A may be the blog, article or social bookmarking site. I need to know how to get URL of the Website A. I owns Website B. So I need to write
Unable to get jQuery to get JSON from another domain (using JSONP)
I'm using an API (which I made and can alter if necessary) which spits out some JSON (using PHP's json_encode, so it's valid). I'm using it on another website on another domain to retrieve data. Unfortunately, I can't seem to get it to work. The requ
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK