6

A Damn Fine Day from an Engineer's Perspective

 3 years ago
source link: https://fuzzyblog.io/blog/optimization/2014/08/27/a-damn-fine-day-from-an-engineer-s-perspective.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

A Damn Fine Day from an Engineer's Perspective

Aug 27, 2014

Before

=================================================
num_pages: 39
unique urls count: 74
crawl_time_in_secs: 108.357335
overall page velocity: 0.36 in pages per second
overall url velocity: 0.68 in urls per second
=================================================

After

=================================================
num_pages: 39
unique urls count: 74
crawl_time_in_secs: 22.346326
overall page velocity: 1.75 in pages per second
overall url velocity: 3.31 in urls per second
=================================================

After some more work

=================================================
num_pages: 38
unique urls count: 112
crawl_time_in_secs: 12.278745
overall page velocity: 3.09 in pages per second
overall url velocity: 9.12 in urls per second
=================================================

Posted In: #ruby #optimization #performance


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK