Search Providers package for Mediacloud
Project description
Media Cloud Providers Library
A package of search providers for Media Cloud, wrapping up interfaces for different social media platform.
UNDER CONSTRUCTION- Probably won't get a huge amount of attention for a little bit, but I'm putting this up now since I've done this extraction already.
Install with pip (pip install .
) and the install.sh
script.
Requires environment variables set for various interfaces to work correctly.
Build
Make sure pip install flit twine
so you can build and deploy to PyPI.
- Bump the version number in
pyproject.toml
- Add a note about changes to the version history below
- Commit the changes and tag it with a semantic version number
- Run
flit build
to create an installation package - Run
flit publish
to upload it to PyPI
Version History
- v0.5.2 - Fix to allow override of chunk'ing in MC client
- v0.5.1 - Fix use of media cloud to respect domains clause on story list paging
- v0.5.0 - Integrate new mediacloud-news-client into onlinenews-mediacloud
- v0.4.0 - Specify custom base URLs via new string param to
provider_by_name
andprovider_for
- v0.3.0 - Add support for paging through stories directly, and including text in paged results for speed
- v0.2.6 - Fixed querying by domain on new mediacloud system
- v0.2.5 - Alignment with new mediacloud system. Old onlinenews provider is now "onlinenews-mclegacy", "onlinenews-mediacloud" now queries the new index.
- v0.2.4 - Added support for api keys via "provider_by_name"
- v0.2.3 - removed support for API keys in environment variables- now expected as an argument in
providers.provider_for
- v0.2.2 - transition to use the dedicated mediacloud-api-legacy package to avoid version conflictsgit
- v0.2.1 - add in a date hack to resolve a lower-level bug in the Media Cloud legacy count-over-time results
- v0.2.0 - add in support for Media Cloud legacy database
- v0.1.7 - corrected support for a "filters" kwarg in online_news
- v0.1.6 - Added support for a "filters" kwarg in online_news
- v0.1.5 - Added politeness wait to all chunked queries in twitter provider
- v0.1.4 - Added Query Chunking for large collections in the Twitter provider
- v0.1.3 - Added Query Chunking for large queries in the onlinenews provider
- v0.1.2 - Test Completeness
- v0.1.1 - Parity with web-search module, and language model
- v0.1.0 - Initial pypi upload
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mc_providers-0.5.2.tar.gz
(123.0 MB
view hashes)
Built Distribution
mc_providers-0.5.2-py3-none-any.whl
(123.0 MB
view hashes)
Close
Hashes for mc_providers-0.5.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a676d49bd051ea64a379d15cda29fbc7993e07babfcbd1b50e2a18ca0882d46c |
|
MD5 | d21fab50660e4dc2a49e2b81d1b29568 |
|
BLAKE2b-256 | 6e25c2c691cb5bc2c64893ec000e8423bbb1a5afb8c50c761b3c225413252a0b |