Graph engine - distributed graph engine to host graphs.
Project description
DeepGNN Overview
DeepGNN is a framework for training machine learning models on large scale graph data. DeepGNN contains all the necessary features including:
- Distributed GNN training and inferencing on both CPU and GPU.
- Custom graph neural network design.
- Online Sampling: Graph Engine (GE) will load all graph data, each training worker will call GE to get node/edge/neighbor features and labels.
- Automatic graph partitioning.
- Highly performant and scalable.
Project is in alpha version, there might be breaking changes in the future and they will be documented in the changelog.
Usage
Install pip package:
python -m pip install deepgnn-torch
If you want to build package from source, see instructions in CONTRIBUTING.md
.
Train and evaluate a graphsage model with pytorch on cora dataset:
cd examples/pytorch/graphsage
./run.sh
Training other models
Examples folder contains various models one can experiment with DeepGNN. To train models with Tensorflow you need to install deepgnn-tf
package, deepgnn-torch
package contains packages to train pytorch examples. Each model folder contains a shell script run.sh
that will train a corresponding model on a toy graph, a README.md
file with a short description of a model, reference to original paper, and explanation of command line arguments.
Migrating Scripts
We provide a python module to help you upgrade your scripts to new deepgnn versions.
pip install google-pasta
python -m deepgnn.migrate.0_1_56 --script_dir directory_to_migrate
See CHANGELOG.md
for full change details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Hashes for deepgnn_ge-0.1.58.dev5-py3-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 83d5d88a05bc49be6fa8af58076d845bdc6c0ff74c165d4b7cc31e42ec4da4cd |
|
MD5 | 4cc267d2c5feb76a7ea8d19d0945d398 |
|
BLAKE2b-256 | d6315aef6f4b2ad6562663ae8505bea16c7ca8217d1c5ed3a801531a06a4a149 |
Hashes for deepgnn_ge-0.1.58.dev5-py3-none-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5c3a9adbcf2ba210506b0f12cb7f51e7ff2984709eaccfa312ecdab8a21577b9 |
|
MD5 | bf77f0ae3bd26452e180261a2a51e48f |
|
BLAKE2b-256 | f762b6242c815c17c84a5f9a5d143c4ded3fe45d897c598a60e1e67a8d27a884 |
Hashes for deepgnn_ge-0.1.58.dev5-py3-none-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3ac9c17a4188d449cefcf5b876201c1521f0226d03bb07d95a9d4d9bff4cf618 |
|
MD5 | ac9b2bb614ee8f13d9cf7a91c78f236f |
|
BLAKE2b-256 | b92b5b282560f8b6194ef45e85fa748904d8a99d7460f0ec33bb9904e706de8d |