Contains Retrieval Augmented Generation related utilities for Azure Machine Learning and OSS interoperability.
Project description
# AzureML Retrieval Augmented Generation Utilities
This package is in alpha stage at the moment, use at risk of breaking changes and unstable behavior.
It contains utilities for:
Processing text documents into chunks appropriate for use in LLM prompts, with metadata such is source url.
Embedding chunks with OpenAI or HuggingFace embeddings models, including the ability to update a set of embeddings over time.
Create MLINdex artifacts from embeddings, a yaml file capturing metadata needed to deserialize different kinds of Vector Indexes for use in langchain. Supported Index types: - FAISS index (via langchain) - Azure Cognitive Search index
## Getting started
You can install AzurrML RAG package via pip.
`bash pip install azureml-rag `
## Documentation
TBA
# Changelog
## 0.1.2 (2023-05-05)
Refactored document chunking to allow insertion of custom processing logic
## 0.0.1 (2023-04-25)
### Features Added - Introduced package - langchain Retriever for Azure Cognitive Search
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for azureml_rag-0.1.2-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b172577761bf6542769ac00e687f71c1401e0c69f6b115c05c09cb352bab4374 |
|
| MD5 | f5c02c691a5829fade0af83c08410cc9 |
|
| BLAKE2b-256 | dfbe4dc18a991e774ebba44b68436663e1c880e740aac51a5fce1182058dea60 |
