Comments Off on OpenAI Crawlers Can Update Its User Agent String
OpenAI made a number of clarification changes to its crawler help documentation to say that version number of the user-agent string may be updated and it may use a user-agent string with an additional robots.txt marker.
