WebArena benchmark for BrowserGym
Project description
WebArena benchmark for BrowserGym
This package provides browsergym.webarena
, which is an unofficial port of the WebArena benchmark for BrowserGym.
Note: the original WebArena codebase has been slightly adapted to ensure compatibility.
Setup
- Install the package
pip install browsergym-webarena
- Download tokenizer ressources
python -c "import nltk; nltk.download('punkt')"
- Setup the web servers (follow the webarena README).
BASE_URL=<YOUR_SERVER_URL_HERE>
- Setup the URLs as environment variables
export SHOPPING="$BASE_URL:7770/"
export SHOPPING_ADMIN="$BASE_URL:7780/admin"
export REDDIT="$BASE_URL:9999"
export GITLAB="$BASE_URL:8023"
export WIKIPEDIA="$BASE_URL:8888/wikipedia_en_all_maxi_2022-05/A/User:The_other_Kiwix_guy/Landing"
export MAP="$BASE_URL:3000"
export HOMEPAGE="$BASE_URL:4399"
Usage
import gymnasium as gym
import browsergym.webarena # register gym environments
env = gym.make("browsergym/webarena.310")
List of all the available WebArena environments
env_ids = [id for id in gym.envs.registry.keys() if id.startswith("browsergym/webarena")]
print("\n".join(env_ids))
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for browsergym_webarena-0.0.1a8.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | fc5491e626c1599de66e9c58190e251da25acdaceefa06936b794203b1bd205e |
|
MD5 | 5bffe3df057ae1c10bb6a4505db34215 |
|
BLAKE2b-256 | 77efd57f55ca83d18c0ab9eedc44ad96582afb817ed0322ed23bdf1319086b8f |
Close
Hashes for browsergym_webarena-0.0.1a8-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d349a174da327f8892a3dafa7f7e3b2a690c2215daae6b0b20aaf3c7eb2fff70 |
|
MD5 | f97e260115f33f0c48c9c580970b7fcf |
|
BLAKE2b-256 | a2dd5c94aa412d22b4f17dc02139383b90cabd3224b63008d24d62d3b2c286f5 |