Skip to main content

WebArena benchmark for BrowserGym

Project description

WebArena benchmark for BrowserGym

This package provides browsergym.webarena, which is an unofficial port of the WebArena benchmark for BrowserGym.

Note: the original WebArena codebase has been slightly adapted to ensure compatibility.

Setup

  1. Install the package
pip install browsergym-webarena
  1. Download tokenizer ressources
python -c "import nltk; nltk.download('punkt')"
  1. Setup the web servers (follow the webarena README).
BASE_URL=<YOUR_SERVER_URL_HERE>
  1. Setup the URLs as environment variables
export SHOPPING="$BASE_URL:7770/"
export SHOPPING_ADMIN="$BASE_URL:7780/admin"
export REDDIT="$BASE_URL:9999"
export GITLAB="$BASE_URL:8023"
export WIKIPEDIA="$BASE_URL:8888/wikipedia_en_all_maxi_2022-05/A/User:The_other_Kiwix_guy/Landing"
export MAP="$BASE_URL:3000"
export HOMEPAGE="$BASE_URL:4399"

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

browsergym_webarena-0.1.0rc7.tar.gz (5.5 kB view hashes)

Uploaded Source

Built Distribution

browsergym_webarena-0.1.0rc7-py3-none-any.whl (5.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page