section(“6) pack unpack”) B, Cemb = 2, 128 class_token = torch.randn(B, 1, Cemb, device=device) image_tokens = torch.randn(B, 196, Cemb, device=device) text_tokens = torch.randn(B, 32, Cemb, device=device) show_shape(“class_token”, class_token) show_shape(“image_tokens”, image_tokens) …
Tag:
