[论文速览]LLaVA: Visual Instruction Tuning[2304.08485]
作者: 秋刀鱼的炼丹工坊
作者简介: 经中此篇如此高深，我确实不懂。
描述: 论文题目:Visual Instruction Tuning / LLaVA: Large Language and Vision Asistant 论文地址:http://arxiv.org/abs/2304.08485 项目地址:https://llava-vl.github.io/ LLaVA-Med: Large Language and Vision Assistant for BioMedicine https://arxiv.org/abs/2306.00890 Flamingo: BV1pu411G7ce * 视频受up能力限制经常出现中英混杂，散装英语等现象，请见谅。如论文理解报道出了偏差，欢迎各位怒斥。 ** 新论文推荐，过往论文查找，欢迎编辑这个文档： https://docs.qq.com/sheet/DSUdOTG9xWUdydVB6 *** Slides每1-2月会上传到置顶动态地址
![[论文速览]LLaVA: Visual Instruction Tuning[2304.08485]](/image/e70f51855bd470691b72d85181c90bd4742e9107.jpg)
![[论文速览]LaFTer: Label-Free Tuning of Zero-shot Classifier...[2305.18287]](/image/62dfef96f373ae7366d1b14e10aeef5c960395c9.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]OWL-ViT: Simple Open-Vocabulary Object Detection with ViT[2205.06230]](/image/b12d6db9c796519cb92473fcf3faeb9bfe8f8f09.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Visual Prompt Tuning / VPT[2203.12119]](/image/2e914ba575599f48de14cf4a0f954bd5f01d98a2.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]BLIP-2 ...with Frozen Image Encoders and Large Language Models[2301.12597]](/image/0165dab78f9f9b5e55215680d3fc1b42c16491d2.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Socratic Models: Zero-Shot Multimodal Reasoning[2204.00598]](/image/9a1d0f5207e1c0e779c8d580d7961ff655a244f3.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Ferret-v2: An Improved...for Referring and Grounding with LLMs[2404.07973]](/image/27c3c75e59cd3515af31bc1c99d267c2092bd4cb.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Aggregating Nested Transformers[2105.12723]](/image/d421d14158808a20d6b8f85141adce23fcf59e4a.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Deformable Convolutional Networks; DCN[1703.06211]](/image/7f943dee72e49231af989279937c8ab69bc58e7a.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]EViT: Expediting Vision Transformers via Token Reorganizations[2202.07800]](/image/cab99e2b1d0ddc5415d6582fd3686ff3a1b0e07d.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]VoxPoser: Composable 3D Value Maps for Robotic...[2307.05973]](/image/77dbc942572d99289d47d32f0ccb669d5876581e.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]Barlow Twins:Self-Supervised Learning via Redundancy Reduction[2103.03230]](/image/1bcf9e12198846b6f9f3abc1d7fc23be3d4f191a.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Align before Fuse / ALBEF: ...[2107.07651]](/image/9f9bab856fdcc4503bab86e4d4d13f07bfabf65d.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]Crossway Diffusion: Improving Diffusion-based ... via SSL[2307.01849]](/image/a865c5d2505c2d84c03a2cc7e72ae120cd5854f7.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]LongLoRA: Efficient Fine-tuning of Long-Context LLMs[2309.12307]](/image/44bf09151bc465b3f3acb8c01537857030d6cb4d.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Drag Your GAN: Interactive Point-based Manipulation...[2305.10973]](/image/14f3c6573919b66c652903718dd66d88c8507380.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]CLIP Dense Inference Yields Open-Vocab ... For-Free[2309.14289]](/image/040ce691f7b55db4c2ecfedfb0479f4ac529061d.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]DeiT: Data-efficient Image Transformers[2012.12877]](/image/dcc355c0e181bc0795eb94f32bc610c619a3644f.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Denoising Diffusion Implicit Models / DDIM[2010.02502]](/image/047f17737becb370fb0e7652f9b04567b763f3dc.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]CeiT: Incorporating Convolution Designs into Visual Tr[2103.11816]](/image/d3006d27d41873b489a76f242f6b01af0c621ea8.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]BiFormer: Vision Transformer with Bi-Level Routing Attention[2303.08810]](/image/615293b2b427919f5e60e6cdc71f64c2e63ec45b.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Finite Scalar Quantization: VQ-VAE Made Simple[2309.15505]](/image/780db069a28a0ddad29ef9b54e03003e18ac5bcb.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Bootstrapping Language-Image Pre-training...[2201.12086]](/image/49d17247debc220e9ed7092ebc91e1197e08359b.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Efficient Visual Pretraining with Contrastive Detection[2103.10957]](/image/c6ed0f6f8c00e21abb50428e240fd3c83213e4fd.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]Regularized Vector Quantization for Tokenized Image Synthesis[2303.06424]](/image/1752fa577031247b5525a5b409ff253e1333078d.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]DAT: Vision Transformer with Deformable Attention[2201.00520]](/image/e82720fd9f531018e32df9ea33690cb799e92c57.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Learning to Learn with Generative Models of NN Checkpoints[2209.12892]](/image/ae47e9b9f347382b250a0bfa71800e38227f4104.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Scalable Video Object Segmentation with Simplified Framework[2308.09903]](/image/959464f0ef932a16280a9367a9a94bead0e01dc4.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]LoRA: Low-Rank Adaptation of Large Language Models[2106.09685]](/image/2f4cb362cc5e24a347a012cfa05220728950cc9a.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Denoising Diffusion Probabilistic Models / DDPM[2006.11239]](/image/b34e3a1e703a0348ba6a908740da086f055c5222.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]Point Transformer V2[2210.05666]](/image/315ba3a4cee3b386b91b917645182e2935d121ef.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]An Empirical Study of Training Self-Supervised ViT[2104.02057]](/image/c1c21e44dab686ef10a7529dc87530ba0d00e06d.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Bottleneck Transformers for Visual Recognition[2101.11605]](/image/f58910cf5afa49a2022a114b6b2c84fba938c152.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]LLaRA: Supercharging Robot Learning Data for VLM Policy[2406.20095]](/image/9785f9a0d0deadc1303736a7165537e65be2679b.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Open Vocab. Semantic Seg. with Patch Aligned Contrastive...[2212.04994]](/image/f298a1e73d9abf4aa926658ab0355eaf98a36389.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]DINO Emerging Properties in SelfSupervised Vision Transformers[2104.14294]](/image/ec6eaec1f853d6aad9a3a04299962364a2069c9a.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文速览]Token Turing Machines[2211.09119]](/image/a71eac2a1aeb688208f1eac04f995a2707c9726c.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]End-to-End Video-Language Transformers..Masked Visual-token..[2111.12681]](/image/b88649f74500f092d4a1195c0609443662bf561c.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]TNT: Transformer in Transformer[2103.00112]](/image/7fdd630342ba1eb8257c44e4882cb9bb4fb5a8dc.jpg@336w_190h_!web-video-rcmd-cover.avif)
![[论文简析]VAE: Auto-encoding Variational Bayes[1312.6114]](/image/32a4cea5038b1139545f6343f31252e7190ee6ae.jpg@336w_190h_!web-video-rcmd-cover.avif)