LLM plugin for Anthropic's Claude
Project description
llm-claude
Plugin for LLM adding support for Anthropic's Claude model.
Installation
Install this plugin in the same environment as LLM.
llm install llm-claude
Configuration
You will need an API key from Anthropic. Request access at https://www.anthropic.com/earlyaccess then go to https://console.anthropic.com/account/keys
You can set that as an environment variable called ANTHROPIC_API_KEY
, or add it to the llm
set of saved keys using:
llm keys set claude
Enter key: <paste key here>
Usage
This plugin adds models called claude
and claude-instant
.
Anthropic describes them as:
two families of models, both of which support 100,000 token context windows:
- Claude Instant: low-latency, high throughput
- Claude: superior performance on tasks that require complex reasoning
You can execute them like this:
llm -m claude-instant "Ten great names for a new space station"
llm -m claude "Compare and contrast the leadership styles of Abraham Lincoln and Boris Johnson."
Options
max_tokens_to_sample
, default 10_000: The maximum number of tokens to generate before stopping
Use like this:
llm -m claude -o max_tokens_to_sample 20 "Sing me the alphabet"
Here is the alphabet song:
A B C D E F G
H I J
Development
To set up this plugin locally, first checkout the code. Then create a new virtual environment:
cd llm-claude
python3 -m venv venv
source venv/bin/activate
Now install the dependencies and test dependencies:
pip install -e '.[test]'
To run the tests:
pytest
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llm_claude-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e825c8148eb51a1439a6de8d64dad76a820764c6b8cb92226bea5dc26759787a |
|
MD5 | 1f0e623b9d00582e2fdd0273f23aac37 |
|
BLAKE2b-256 | 6f239d5ed1952cc33f25c5d1526ecfa5f99e0d86747e4428312549c67b5d2f9a |