目前还只训练了imagenet，一百多万张图，1000类，类别标签生图，后续考虑加上文本生图
目前共有12篇帖子。
图像生成模型训练实验
 |
首先训练了VAE作为图像压缩模型，然后训练DiT作为图像生成模型
|
|
150000步采样（batchsize=32,按照这个计算，全数据集每张图已经过了四遍）：
悄悄打开魔盒：单张3090训练速度非常有限，一小时只有一万步左右，所以到现在还看不出来什么稳定的图像
悄悄打开魔盒：回复 @悄悄打开魔盒：初学者建议先使用手写数字数据集MNIST或者衣服数据集Fashion-MNIST，图片小，训练速度快，能很快看到效果
[查看詳情]
|
|
 悄悄打开魔盒：100万步训练，单张3090约耗时四天。这是前16类图像的采样结果。
0 n01440764 鱼 , tench, Tinca tinca1 n01443537 鱼, goldfish, Carassius auratus 2 n01484850 鱼, great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias 3 n01491361 鱼, tiger shark, Galeocerdo cuvieri 4 n01494475 鱼, hammerhead, hammerhead shark 5 n01496331 鱼, electric ray, crampfish, numbfish, torpedo 6 n01498041 鱼, stingray 7 n01514668 鸡 , cock8 n01514859 鸡, hen 9 n01518878 鸵鸟 , ostrich, Struthio camelus10 n01530575 鸟, brambling, Fringilla montifringilla 11 n01531178 鸟, goldfinch, Carduelis carduelis 12 n01532829 鸟, house finch, linnet, Carpodacus mexicanus 13 n01534433 鸟, junco, snowbird 14 n01537544 鸟, indigo bunting, indigo finch, indigo bird, Passerina cyanea 15 n01558993 鸟, robin, American robin, Turdus migratorius
[查看詳情]
|
|
 悄悄打开魔盒：
16 n01560419 鸟, bulbul 17 n01580077 鸟, jay 18 n01582220 鸟, magpie 19 n01592084 鸟, chickadee 20 n01601694 鸟, water ouzel, dipper 21 n01608432 鸟, kite 22 n01614925 鹰, bald eagle, American eagle, Haliaeetus leucocephalus 23 n01616318 鹰, vulture 24 n01622779 猫头鹰 , great grey owl, great gray owl, Strix nebulosa25 n01629819 壁虎, European fire salamander, Salamandra salamandra 26 n01630670 壁虎, common newt, Triturus vulgaris 27 n01631663 壁虎, eft 28 n01632458 壁虎, spotted salamander, Ambystoma maculatum 29 n01632777 壁虎, axolotl, mud puppy, Ambystoma mexicanum 30 n01641577 蛤蟆, bullfrog, Rana catesbeiana 31 n01644373 青蛙 , tree frog, tree-frog
[查看詳情]
|
|
 悄悄打开魔盒：
32 n01644900 青蛙, tailed frog, bell toad, ribbed toad, tailed toad, Ascaphus trui 33 n01664065 龟 , loggerhead, loggerhead turtle, Caretta caretta34 n01665541 龟, leatherback turtle, leatherback, leathery turtle, Dermochelys coriacea 35 n01667114 龟, mud turtle 36 n01667778 龟, terrapin 37 n01669191 龟, box turtle, box tortoise 38 n01675722 蜥蜴 , banded gecko39 n01677366 蜥蜴, common iguana, iguana, Iguana iguana 40 n01682714 蜥蜴, American chameleon, anole, Anolis carolinensis 41 n01685808 蜥蜴, whiptail, whiptail lizard 42 n01687978 蜥蜴, agama 43 n01688243 蜥蜴, frilled lizard, Chlamydosaurus kingi 44 n01689811 蜥蜴, alligator lizard 45 n01692333 蜥蜴, Gila monster, Heloderma suspectum 46 n01693334 蜥蜴, green lizard, Lacerta viridis 47 n01694178 蜥蜴, African chameleon, Chamaeleo chamaeleon
[查看詳情]
|
|
 悄悄打开魔盒：
200 n02097474 狗, Tibetan terrier, chrysanthemum dog 201 n02097658 狗, silky terrier, Sydney silky 202 n02098105 狗, soft-coated wheaten terrier 203 n02098286 狗, West Highland white terrier 204 n02098413 狗, Lhasa, Lhasa apso 205 n02099267 狗, flat-coated retriever 206 n02099429 狗, curly-coated retriever 207 n02099601 狗, golden retriever 208 n02099712 狗, Labrador retriever 209 n02099849 狗, Chesapeake Bay retriever 210 n02100236 狗, German short-haired pointer 211 n02100583 狗, vizsla, Hungarian pointer 212 n02100735 狗, English setter 213 n02100877 狗, Irish setter, red setter 214 n02101006 狗, Gordon setter 215 n02101388 狗, Brittany spaniel
[查看詳情]
|
