Airflow Toloka Provider

This library allows you to run crowdsourcing Toloka processes in Apache Airflow - a widely used workflow management system

Here you can find a collection of ready-made Airflow tasks for the most frequently used actions in Toloka-Kit.

Getting started

$ pip install airflow-provider-toloka

A good way to start is to follow the example in this repo.

Configuration

In the Airflow Connections UI, create a new connection for Toloka.

• Conn ID: toloka_default
• Conn Type: Toloka
• Password: enter your OAuth token for Toloka. You can learn more about how to get it here.

Tasks uses the toloka_default connection id by default, but if needed, you can create additional Airflow Connections and reference them as the function toloka_conn_id argument.

Useful Links

• Toloka homepage.
• Apache Airflow homepage.
• Toloka API documentation.
• Toloka-kit usage examples.

Questions and bug reports

• For reporting bugs please use the Toloka/bugreport page.
• Join our English-speaking slack community for both tech and abstract questions.

License

© YANDEX LLC, 2022. Licensed under the Apache License, Version 2.0. See LICENSE file for more details.