Changelog for SpyderMate v2.70

*New Schedule feature for registered members that allows for you to setup automatic crawls every week/month
*Added History range search by date and made other History UI improvements
*Optimized crawling function for better and faster sites crawls
*Optimized CSV export
*SpyderMate now respects Robots.txt
*Fixed issues crawling some unusually structured web sites
*Fixed issue with Archive.org occasionally reporting inaccurate results
*SpyderMate reports are now blocked from being indexed in search engines
*Added time of crawl in the history tab