WebArena benchmark for BrowserGym
Project description
WebArena benchmark for BrowserGym
This package provides browsergym.webarena
, which is an unofficial port of the WebArena benchmark for BrowserGym.
Note: the original WebArena codebase has been slightly adapted to ensure compatibility.
Setup
- Install the package
pip install browsergym-webarena
- Download tokenizer ressources
python -c "import nltk; nltk.download('punkt')"
- Setup the web servers (follow the webarena README).
BASE_URL=<YOUR_SERVER_URL_HERE>
- Setup the URLs as environment variables
export SHOPPING="$BASE_URL:7770/"
export SHOPPING_ADMIN="$BASE_URL:7780/admin"
export REDDIT="$BASE_URL:9999"
export GITLAB="$BASE_URL:8023"
export WIKIPEDIA="$BASE_URL:8888/wikipedia_en_all_maxi_2022-05/A/User:The_other_Kiwix_guy/Landing"
export MAP="$BASE_URL:3000"
export HOMEPAGE="$BASE_URL:4399"
Usage
import gymnasium as gym
import browsergym.webarena # register gym environments
env = gym.make("browsergym/webarena.310")
List of all the available WebArena environments
env_ids = [id for id in gym.envs.registry.keys() if id.startswith("browsergym/webarena")]
print("\n".join(env_ids))
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for browsergym_webarena-0.0.1a7.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2113203a384c1ec87af1072131fb02c8a39c2e6c96067d97eaa030af05d37825 |
|
MD5 | 628291eece1e952869932a338222eee0 |
|
BLAKE2b-256 | 072f42457d3b87b1162bac25f91ce0d1490c33138f6795f2bb3ce3b230b993ef |
Close
Hashes for browsergym_webarena-0.0.1a7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | da9cba012e300aac581dcbc9baa8715d9578f081a8bad01a8f187a005610c4bb |
|
MD5 | 4de118a28583685d3cd96bd9fa519d9d |
|
BLAKE2b-256 | db647872ec3e98d18cfb9411853ae72843b4e3c7c1f7c85b578f757ddf28c4c0 |