The web scraping has gone slower than expected. Unhandled erros which required code tweaks in place. On the final 100 pages and going over the others. As I have heard in my interviews with providers, they have gamed the system. Service titles include location and service category all over the place. Going to require a lot of curation and culling of records now.

Posted on Fri 06 Mar 2015 10:51:32 AM EST by Chris Mathews