LTXVideoTransformer3DModel¶
A Diffusion Transformer model for 3D data from LTX was introduced by Lightricks.
The model can be loaded with the following code snippet.
from mindone.diffusers import LTXVideoTransformer3DModel
import mindspore as ms
transformer = LTXVideoTransformer3DModel.from_pretrained("Lightricks/LTX-Video", subfolder="transformer", mindspore_dtype=ms.bfloat16)
mindone.diffusers.LTXVideoTransformer3DModel
¶
Bases: ModelMixin
, ConfigMixin
, AttentionMixin
, FromOriginalModelMixin
, PeftAdapterMixin
, CacheMixin
A Transformer model for video-like data used in LTX.
PARAMETER | DESCRIPTION |
---|---|
in_channels
|
The number of channels in the input.
TYPE:
|
out_channels
|
The number of channels in the output.
TYPE:
|
patch_size
|
The size of the spatial patches to use in the patch embedding layer.
TYPE:
|
patch_size_t
|
The size of the tmeporal patches to use in the patch embedding layer.
TYPE:
|
num_attention_heads
|
The number of heads to use for multi-head attention.
TYPE:
|
attention_head_dim
|
The number of channels in each head.
TYPE:
|
cross_attention_dim
|
The number of channels for cross attention heads.
TYPE:
|
num_layers
|
The number of layers of Transformer blocks to use.
TYPE:
|
activation_fn
|
Activation function to use in feed-forward.
TYPE:
|
qk_norm
|
The normalization layer to use.
TYPE:
|
Source code in mindone/diffusers/models/transformers/transformer_ltx.py
418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 |
|
mindone.diffusers.models.modeling_outputs.Transformer2DModelOutput
dataclass
¶
Bases: BaseOutput
The output of [Transformer2DModel
].
PARAMETER | DESCRIPTION |
---|---|
`
|
The hidden states output conditioned on the
TYPE:
|
Source code in mindone/diffusers/models/modeling_outputs.py
24 25 26 27 28 29 30 31 32 33 34 35 36 |
|