WebArena benchmark for BrowserGym
Project description
WebArena benchmark for BrowserGym
This package provides browsergym.webarena
, which is an unofficial port of the WebArena benchmark for BrowserGym.
Note: the original WebArena codebase has been slightly adapted to ensure compatibility.
Setup
- Install the package
pip install browsergym-webarena
- Download tokenizer ressources
python -c "import nltk; nltk.download('punkt')"
- Setup the web servers (follow the webarena README).
BASE_URL=<YOUR_SERVER_URL_HERE>
- Setup the URLs as environment variables
export SHOPPING="$BASE_URL:7770/"
export SHOPPING_ADMIN="$BASE_URL:7780/admin"
export REDDIT="$BASE_URL:9999"
export GITLAB="$BASE_URL:8023"
export WIKIPEDIA="$BASE_URL:8888/wikipedia_en_all_maxi_2022-05/A/User:The_other_Kiwix_guy/Landing"
export MAP="$BASE_URL:3000"
export HOMEPAGE="$BASE_URL:4399"
Usage
import gymnasium as gym
import browsergym.webarena # register gym environments
env = gym.make("browsergym/webarena.310")
List of all the available WebArena environments
env_ids = [id for id in gym.envs.registry.keys() if id.startswith("browsergym/webarena")]
print("\n".join(env_ids))
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for browsergym_webarena-0.0.1a10.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 36dd28521ee15e5d3851fc684874215e2929974d3006ba3148cf2096a7c40b68 |
|
MD5 | 690f6c93d9c5e95275c19e18b970e9e5 |
|
BLAKE2b-256 | 477fec3887f796dcaf000708d30a032e6dbdfa3ce39a14d99e379a18c55a0b63 |
Close
Hashes for browsergym_webarena-0.0.1a10-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 71e207a5d94a9d2938dbf3c67c77db1833d7839ff2e31fb6a55b2f56a9ba9e70 |
|
MD5 | 4742faf70f842580ed93b9f64bbc38d4 |
|
BLAKE2b-256 | 94cd652bc46bbd3efa9825b69d4b9330f4cbd1168a7c4e7f3ba7f1018fce5ea4 |