[dev] [CatalinFrancu/dexonline] 991c10: change crawl rate

[GitHub via Dev]

  Branch: refs/heads/master
  Home:   https://github.com/CatalinFrancu/dexonline
  Commit: 991c10710d2a89a6fc907a4c73422a783c139079
      https://github.com/CatalinFrancu/dexonline/commit/991c10710d2a89a6fc907a4c73422a783c139079
  Author: Cătălin Frâncu <cata at francu.com>
  Date:   2014-05-30 (Fri, 30 May 2014)

  Changed paths:
    M wwwbase/robots.txt

  Log Message:
  -----------
  change crawl rate