Fixing a problem with BeautifulSoup lib, which causes 'browse_website' command to fail

[peterbanda]

Background

As reported in the issue #2514, browse_website command fails (in particular, its parsing part) with an error module 'collections' has no attribute 'Callable'.

The issue appears on Python 3.10 (3.10.11) as well as 3.11 (3.11.3), and on both, the master branch and the last stable release - version 0.2.1.

Changes

I was able to fix the issue by following: https://stackoverflow.com/questions/69515086/error-attributeerror-collections-has-no-attribute-callable-using-beautifu

In particular, added the following imports to the file web_selenium.py before from bs4 import BeautifulSoup

import collections
import collections.abc

collections.Callable = collections.abc.Callable

Documentation

No in-code documentation needed.

Test Plan

Tested the fix on four cases (Python 3.10/3.11 with AutoGPT versions: master and 0.2.1).
In all the cases, after modifying the file web_selenium.py as described above, the issue disappeared 🎉

PR Quality Checklist

• My pull request is atomic and focuses on a single change.
• I have thoroughly tested my changes with multiple different prompts.
• I have considered potential risks and mitigations for my changes.
• I have documented my changes clearly and comprehensively.
• I have not snuck in any "extra" small tweaks changes

[jazelly]

Suggested change

	from pathlib import Path
	import collections
	import collections.abc
	from pathlib import Path

[peterbanda]

Note that there is a simpler fix for this issue in PR #2680, which is more preferable (at least from my side).

@Pwuts, @jazelly: If you agree I can close this one.

[Pwuts]

Closing in favor of #2680