算法优化部署 TensorRT

Jetson Xavier NX (16GB) 刷机及移植

那棵树看起来生气了

2023-10-14 10:40:02

0 点赞

74 阅读

2023-10-14

刷机教程
交叉编译
trtexec Onnx转TensorRT
查看资源占用
NX 环境搭建
mqtt上报结果
参考

刷机教程

https://blog.csdn.net/six_sixsix666/article/details/124217780

手把手教你 JETSON XAVIER NX 刷机，安装Ubuntu系统与环境_jeston nx刷机没有ubuntu登陆界面-CSDN博客

交叉编译

https://developer.nvidia.com/embedded/jetson-linux-archive
https://developer.nvidia.com/embedded/jetson-linux-r3541
https://catalog.ngc.nvidia.com/orgs/nvidia/containers/jetpack-linux-aarch64-crosscompile-x86

trtexec Onnx转TensorRT

转模型需要对应的版本，请使用部署机器所在环境转换

固定尺寸模型转换

./trtexec \
--onnx=repvgg_a1.onnx \
--saveEngine=repvgg_a1.engine \
--workspace=1024  \
--fp16

1
2
3
4
5

动态尺寸模型转换

./trtexec \
--onnx=repvgg_a1.onnx \
--saveEngine=repvgg_a1.engine \
--workspace=1024 \
--minShapes=input:1x3x32x32 \
--optShapes=input:1x3x32x320 \
--maxShapes=input:1x3x32x640 \
--fp16

1
2
3
4
5
6
7
8
9

查看资源占用

sudo pip install -U jetson-stats
sudo systemctl restart jetson_stats.service

1
2

重启生效

NX 环境搭建

设置环境变量，以便可以找到nvcc

export PATH=/usr/local/cuda/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH
export CUDA_ROOT=/usr/local/cuda

1
2
3
4

mqtt上报结果

deepstream_app_config.txt

# deepstream_app_config.txt
[sink1]
enable=1
type=6
topic=testtopic
msg-broker-conn-str=172.22.1.200;1883;testtopic
msg-broker-proto-lib=/opt/nvidia/deepstream/deepstream-6.3/lib/libnvds_mqtt_proto.so
msg-broker-config=mqtt.txt

msg-conv-payload-type=0
msg-conv-config=dstest5_msgconv_sample_config.txt
disable-msgconv=0 # set to 0 to enable msgconv, which convert the NVEVENT metadata from primary/secondary GIE into mqtt message
#msg-conv-frame-interval=1

1
2
3
4
5
6
7
8
9
10
11
12
13

mqtt.txt

# mqtt.txt
[message-broker]
username=user
password=123

1
2
3
4

运行

注意：如果使用deepstream-app将无法与mqtt通信

deepstream-test5-app -c deepstream_app_config.txt

https://hackmd.io/@2kHYGtJaRV-DxVpSmefW0w/rkcduw2y3#EOF
https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_ref_app_test5.html
https://forums.developer.nvidia.com/t/deepstream-6-3-mqtt-clientid-and-keep-alive-configurations/267896
https://forums.developer.nvidia.com/t/deepstream-deepstream-test5-app-terminates-when-mqtt-connection-timed-out/268898
https://forums.developer.nvidia.com/t/deepstream-6-3-mqtt-examples-question/264286
https://github.com/pabsan-0/libnvds_mqtt_proto
https://github.com/marcoslucianops/DeepStream-Yolo
https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_ref_app_deepstream.html#sink-group
https://forums.developer.nvidia.com/t/custom-payload-for-mqtt-broker/283274

参考

版权属于：

那棵树看起来生气了

本文链接：

https://dengyb.com/archives/57.html（转载时请注明本文出处及文章链接）

作品采用：

《署名-非商业性使用-相同方式共享 4.0 国际 (CC BY-NC-SA 4.0)》许可协议授权

那棵树看起来生气了

参差荇菜，左右流之。窈窕淑女，寤寐求之。

151 文章数

20087 浏览量