Skip to content

Commit

Permalink
refactor(maintainability): dry
Browse files Browse the repository at this point in the history
  • Loading branch information
helmut-hoffer-von-ankershoffen committed Dec 28, 2024
1 parent b2f2f2b commit 0ad3099
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/starbridge/web/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ async def ensure_allowed_to_crawl(url: str, user_agent: str) -> None:
message = (
f"The sites robots.txt ({robot_txt_url}), specifies that autonomous fetching of this page is not allowed, "
f"<useragent>{user_agent}</useragent>\n"
f"<url>{url}</url>"
f"<url>{url}</url>\n"
f"<robots>\n{robot_txt}\n</robots>\n"
f"The assistant must let the user know that it failed to view the page. The assistant may provide further guidance based on the above information.\n"
f"The assistant can tell the user that they can try manually fetching the page by using the fetch prompt within their UI.",
Expand Down

0 comments on commit 0ad3099

Please sign in to comment.