PPLNN, which is short for “PPLNN is a Primitive Library for Neural Network”, is a high-performance deep-learning inference engine for efficient AI inferencing. It can run various ONNX models and has better support for OpenMMLab.
- On Debian or Ubuntu:
apt-get install build-essential cmake git python3 python3-dev
- On RedHat or CentOS:
yum install gcc gcc-c++ cmake3 make git python3 python3-devel
Cloning source code:
git clone https://github.com/openppl-public/ppl.nn.git
- Building from source:
cd ppl.nn ./build.sh -DHPCC_USE_X86_64=ON -DPPLNN_ENABLE_PYTHON_API=ON
- Running python demo:
PYTHONPATH=./pplnn-build/install/lib python3 ./tools/pplnn.py --use-x86 --onnx-model tests/testdata/conv.onnx
Refer to Documents for more details.
- Ops and Models
- Building from Source
- Develop Guide
Questions, reports, and suggestions are welcome through GitHub Issues!
|WeChat Official Account||QQ Group|
This project uses Contributor Covenant as code of conduct. Any contributions would be highly appreciated.
This project is distributed under the Apache License, Version 2.0.