• Home
  • Logos (λόγος)
  • Haaretz (הארץ)
    • Recipes
    • 魚
  • Kendo (剣道)
  • Development
  • Wiki
  • 韓承佑

Sojourning Dinosaur

Veritas omnia vincit 信使可覆

googlebot

Googlebot searching far in the future

August 12, 2019 by mhan Leave a Comment
Screenshot of nginx access log

While monitoring the logs, I’ve encountered an interesting URL being examined by Googlebot. It’s a type of pattern I’ve been seeing for last several months and decided to make a comment about it today. There’s a very little doubt that Googlebot is partially driven by machine learning algorithm, and for some reason it’s querying a date of May 14, 2143 on this instance. It’s targetting a Read the Bible in a Year service area I’ve created for my church few years ago at https://kumcabq.org/dailyreading. Apparently, Googlebot has figured out that it could traverse through time and started to query what seems to be arbitrary dates. Here are some dates it has queried in the wee hours of August 12, 2019, in the descending order of query times:

2033-12-07
2025-03-07
2069-05-11
2026-09-01
1865-10-15
2148-06-21
2026-08-31
1865-10-14
2034-10-05
2148-06-22
1865-10-13
2148-06-23
2034-10-06
2026-08-30
2014-12-04
1865-10-12
2132-12-11
2125-12-22

Okay, on the second look, it is actually traversing through one day at a time for years 1865, 2132, 2125, 2026, 2034, 2069, 2025, 2033, and so on. The log has many more dates. It almost looks like an artificial intelligence trying to figure out what correlation, if any, is there between the date and the Bible passages presented on the page. This seems to have gone on for a while. This is just taking up unnecessary bandwidth… not sure what to do — slap the Googlebot’s hand when it gets to this page again, or maybe take the page down?

Posted in: AI, Haaretz (הארץ) Tagged: artificial intelligence, googlebot, machine learning, seo
Visit Us On TwitterVisit Us On FacebookVisit Us On Linkedin

TEMPUS FUGIT

December 2019
S M T W T F S
« Oct    
1234567
891011121314
15161718192021
22232425262728
293031  

Recent Posts

  • Notes on [brain] fatigue
  • Notes on neck health
  • Wi-Fi 6 is coming
  • poetryforlifeforever.com
  • Googlebot searching far in the future

Recent Comments

    Archives

    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • February 2019
    • January 2019
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • February 2017
    • January 2017
    • October 2016
    • September 2016
    • August 2016
    • July 2016

    Categories

    • AI
    • Development
    • Haaretz (הארץ)
    • Kendo (剣道)
    • Logos (λόγος)
    • Recipes
    • System administration
    • Uncategorized

    Copyright © 2016 ~ 2019 Michael Han