Skip To Main Content
Shuowei Zhang on Muck Rack

Shuowei Zhang

As seen in: CSDN
Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work. Claim your profile
Back to Shuowei Zhang’s profile

Articles by Shuowei Zhang

PVT论文Pytorch代码解读_Shuowei Zhang的博客-CSDN博客

|
By Shuowei Zhang
| CSDN
PVT论文代码实现 论文地址：https://arxiv.org/abs/2102.12122v2 Pytorch代码地址：https://github.com/whai362/PVT PVT结构图 PVT有什么用 PVT将金字塔结构结合到了Transformer中，提高特征图的分辨率，有利于将Transformer应用到语义分割、目标检测等下游任务中。 提出了Spatial-Reduction Attention来替代原来的Multi-Head Attention，显著降低运算成本。 PVT结构代码 import torch import torch.nn as nn import torch.nn.functional as F from functools import partial from timm.models.layers import DropPath, to_2tuple, trunc_normal_ from timm.models.registry import register_model from...
Open in Who Shared Issue with article?

ViT论文Pytorch代码解读_Shuowei Zhang的博客-CSDN博客

|
By nn.Layer Norm, .Layer Norm, Shuowei Zhang
| CSDN
论文地址：https://arxiv.org/abs/2010.11929 Pytorch代码地址：https://github.com/lucidrains/vit-pytorch ViT结构图 调用代码 import torch from vit_pytorch import ViT def test(): v = ViT( image_size = 256, patch_size = 32, num_classes = 1000, dim = 1024, depth = 6, heads = 16, mlp_dim = 2048, dropout = 0.1, emb_dropout = 0.1 ) img = torch.randn(1, 3, 256, 256) preds = v(img) print(preds.shape) assert preds.shape == (1, 1000), 'correct logits outputted' if __name__ == '__main__': test() ViT结构 class ViT(nn.Module):...
Open in Who Shared Issue with article?
Show More