Software Development | MentorMate, Inc.
T: 612.823.4000 1437 Marshall Avenue, Suite 200
F: 651.789.0023 St. Paul, MN 55104 USA.
E: spyder@mentormate.com Map & Directions

Changelog for SpyderMate v2.70

*New Schedule feature for registered members that allows for you to setup automatic crawls every week/month
*Added History range search by date and made other History UI improvements
*Optimized crawling function for better and faster sites crawls
*Optimized CSV export
*SpyderMate now respects Robots.txt
*Fixed issues crawling some unusually structured web sites
*Fixed issue with Archive.org occasionally reporting inaccurate results
*SpyderMate reports are now blocked from being indexed in search engines
*Added time of crawl in the history tab