tensorrt推理onnx模型(二)

本文介绍 tensorrt推理onnx模型(二) tensorrt推理onnx模型(二) This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 继续上一篇的探索,实际上由于上一篇的api已经过时,最新的TensorRT5.1的API已经完全变了。 我们依旧以mobilenet为例,……

阅读全文

onnx模型tensorrt推理实践

本文介绍 onnx模型tensorrt推理实践 onnx模型tensorrt推理实践 This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 现在很多场景模型部署都是用tensorrt,因为显卡速度比cpu快很多,加上一些场景还真的不在乎成本,因此为了使得系统更加稳定可靠,用ten……

阅读全文

下一站-最舍不得的一次离职

本文介绍 下一站-最舍不得的一次离职 下一站-最舍不得的一次离职 This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 准备离职,职场的下一站到站了。 最后一天花了点时间,记录一下此时此刻的感悟。搞了很长时间的技术,一直没有时间提笔写一些东西,今天正好,万籁寂静,微风拂面,且提笔记……

阅读全文

pytorch module权重共享的诡异操作

本文介绍 pytorch module权重共享的诡异操作 pytorch module权重共享的诡异操作 This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 记录一个十分诡异的操作。 事情的经过是这样的,我在对一个模型进行trace的过程中遇到一个错误: File "/usr/local/lib/python3.6/dist-packages/torch/jit/__init__.py", line 1469, in __init__ check_unique(param) File "/usr/local/lib/python3.6/dist-packages/torch/jit/__init__.py", line 1461, in check_unique raise ValueError("TracedModules don't support parameter sharing between modules") ValueError: TracedModules don't support parameter sharing……

阅读全文

RetinaNet:TensorFlow2.0从零到实现

本文介绍 RetinaNet: TensorFlow2.0从零到实现 FPN+SSD精度与速度兼修的检测器从零到实现 This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 在不久之前,写了一篇从零实现YoloV3的的文章,采用的是最新的tensorflow2.0的API,踩了不少坑。给我最大的感觉就……

阅读全文

rust编写一个vim

本文介绍 rust编写一个vim rust编写一个vim This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 关于rust的安装以及国内换源的一些铺垫操作,参考manaai社区的帖子. rust能干啥?能打败C++?能不能打败C++我们不讨论,我只想告诉大家,rust一门未来你一……

阅读全文

PriorBox到底是如何生成的?

本文介绍 PriorBox到底是如何生成的? PriorBox到底是如何生成的? This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 最近在用libtorch部署一些先进的快速的one-stage检测器, 参考晚上的一个项目, 里面直接提供了一个csv里面包含的是Prior. 那么问……

阅读全文

深度学习量化之GEMM通用矩阵乘法

本文介绍 深度学习量化之GEMM通用矩阵乘法 深度学习量化之GEMM通用矩阵乘法 This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu GEMM 深度学习走到最后,就得从理论到应用部署。除了一些网络设计,新的优化方法,新的任务,已有任务的指标刷新等领域以外,深度学习模型的量化是一个很重要……

阅读全文

记录今天遇到的两个坑

本文介绍 记录今天遇到的两个坑 记录今天遇到的两个坑 This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu 今天遭遇了两个坑,都是关于C++的。总结来说就几点: 以后部署环境尽量,千万别,也没必要,不用,不需要自己从源码安装某个库。因为你无法保证别人编译安装的链接版本号就是一致的。……

阅读全文

ROIPooling与ROIAlign的思考

本文介绍 ROIPooling与ROIAlign的思考 ROIPooling与ROIAlign的思考 This article was original written by Jin Tian, welcome re-post, first come with https://jinfagang.github.io . but please keep this copyright info, thanks, any question could be asked via wechat: jintianiloveu ROIPooling 是FasterRCNN里面使用的层, 它的作用是抽取出合适的特征来做物体检测和位置回归,而ROIAlign是MaskRCNN……

阅读全文