Skip to main content

Python programmatic web browser to fetch data and test web sites

Project description

Copyright 2009-2018 Sloft http://bitbucket.org/sloft/pynav

Name: pynav
Version: 1.0
Summary: Python programmatic web browser to fetch data and test web sites
Home-page: http://bitbucket.org/sloft/pynav/
Author: sloft
License: LGPL
Download-URL: http://bitbucket.org/sloft/pynav/downloads/
Description: Python programmatic web browser to fetch data and test web sites
________________________________________________________________

Features:

-Post authentication
-User agent support
-Automatic cookie handling
-HTTP Basic Authentication support
-HTTPS support
-Proxy support
-Timeout support
-Reg exp searching
-Links fetching with reg exp filter
-History (pages, posts and responses)
-Save and load history from a file and replay navigation
-Random sleep time beetween pages
-Errors handling
-Content type filters
-Check 404 urls
-Check resource datetime
-Handle robots.txt
_______________________________________________________________

Bug reporting and features asking are welcome.
Use the the bug tracker: http://bitbucket.org/sloft/pynav/issues?status=new&status=open


Python version: 3.5+

INSTALLATION:

- With pip:
pip3 install pynav

- From sources:
python3 setup.py install


2018-10-11 Pynav 1.0

* New: pynav ported to Python 3
* New: Python 2.6 is no longer supported, Python 3.5 minimum is now required.
* New: Add useragent.py containing an updated user agent list, update Browser to use it
* New: Add Type Hints for IDE completion in Browser
* New : formdumper deleted because ClientForm does not meet Python 3 requirements
* New : 3 Response methods are no longer supported : Response.dump_form(), Response.dump_forms(), Response.formDumper()

* Qual: Migrate Python 2.6 code to Python 3.5
* Qual: Browser.check_404() renamed to Browser.is_404()
* Qual: # -*- coding=utf-8 -*- removed in all files because utf-8 is the default source encoding in python 3

* Fix: Browser.download() bug when url is the root url + rename built-in name bytes in Browser._humanize_bytes()
* Fix: header datetime conversion regression in Browser.check_new_resource(), Response.date and Response.last_modified
* Fix: relative url bug in Browser.response.images with urllib.parse.urljoin



Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pynav-1.0.tar.gz (10.4 kB view hashes)

Uploaded Source

Built Distribution

pynav-1.0-py3-none-any.whl (12.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page