A library of neural nets in theano
Project description
The theanets package provides tools for defining and optimizing several common types of neural network models. It uses Python for rapid development, and under the hood Theano provides graph optimization and fast computations on the GPU.
The package defines models for classification, autoencoding, regression, and prediction. Models can easily be created with any number of feedforward or recurrent layers and combined with different regularizers:
L1/L2 weight decay
L1/L2 hidden activation penalties (e.g., sparse autoencoders)
Dropout/gaussian noise (e.g., denoising autoencoders)
Several optimization algorithms are also included:
Many algorithms from scipy.optimize.minimize
Greedy layerwise pre-training
Installation
Install the latest published code using pip:
pip install theanets
Or download the current source and run it from there:
git clone http://github.com/lmjohns3/theanets cd theanets python setup.py develop
Example
Let’s say you wanted to create a classifier and train it on some 100-dimensional data points that you’ve classified into 10 categories. You can define your model and train it using a few lines of code:
import climate
import theanets
import my_data_set
climate.enable_default_logging()
exp = theanets.Experiment(
theanets.Classifier,
layers=(100, 200, 100, 10),
)
exp.train(
my_data_set.training_data,
my_data_set.validation_data,
optimize='sgd',
learning_rate=0.01,
momentum=0.5,
hidden_l1=0.1,
)
exp.network.predict(my_data_set.test_data)
The trained network lets you make predictions on unseen test data.
More Information
Source: https://github.com/lmjohns3/theanets
Documentation: http://theanets.readthedocs.org
Mailing list: https://groups.google.com/forum/#!forum/theanets
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
