Skip to content
@UniX-AI-Lab

UniX-AI-Lab

UniX-AI-Lab


GitHub Org   Non-Profit   License   Active



Towards Real-World Perception and Modeling —
building open AI systems that perceive, understand, generate, and act.



🧭 Who We Are

UniX-AI-Lab is an open, non-profit research collective working toward:

Towards Real-World Perception and Modeling

We build intelligent systems that can continuously perceive, understand, model, and interact with the real world.

Our research spans four closely connected directions:

Multimodal Perception & Understanding · Visual Generation & Editing
Unified World Modeling · Agentic Reasoning

We are particularly interested in Multimodal Large Language Models (MLLMs) for video understanding, streaming perception, long-context multimodal reasoning, and real-world interaction.

We believe meaningful progress requires connecting perception and generation: an intelligent system should not only recognize what is happening, but also understand temporal dynamics, predict future states, reason about actions, and model how the world evolves.

Our work combines academic rigor with practical capability. We care deeply about why things work, not only that they do. Every model, dataset, benchmark, and codebase we produce is released openly whenever possible.


🔬 Research Pillars

👁️ Multimodal Perception & Understanding

Building multimodal systems that understand real-world visual and temporal information.

Topics we explore:

  • Multimodal Large Language Models (MLLMs)
  • Image and video understanding
  • Streaming and online video understanding
  • Long-video and long-context reasoning
  • Temporal grounding and event understanding
  • Audio-visual-language alignment
  • Embodied and interactive perception

🎨 Visual Generation & Editing

Developing generative models that create, edit, and simulate realistic visual worlds.

Topics we explore:

  • Image, video, and 3D generation
  • Diffusion and flow-based models
  • Instruction-following visual editing
  • Controllable and compositional generation
  • Identity, layout, motion, and style control
  • 3D-consistent generation
  • Reinforcement learning for generative models

🌍 Unified World Modeling

Unifying perception, generation, and prediction to model how real-world states evolve.

Topics we explore:

  • Unified understanding and generation
  • World models and future-state prediction
  • Any-to-any multimodal architectures
  • Physical, social, and causal reasoning
  • Multimodal tokenization and representation learning
  • Cross-modal grounding and alignment
  • Interactive environment modeling

🤖 Agentic Reasoning

Building systems that reason, plan, use tools, and act in dynamic environments.

Topics we explore:

  • Multimodal autonomous agents
  • Tool-augmented reasoning
  • Long-horizon planning and decision-making
  • Multi-agent collaboration
  • Reinforcement learning for reasoning
  • Scientific discovery automation
  • Agents grounded in streaming perception

🚀 Featured Projects

Human-aligned stress testing of video generators as future world-state predictors.

WorldReasonBench reframes video generation evaluation as world-state prediction: given an initial state and an action, can a model generate a future video whose evolution remains physically, socially, logically, and informationally consistent?

🎬 436 curated cases · 4 reasoning dimensions · 22 subcategories
🤖 11 closed- and open-source generators benchmarked head-to-head
🧑‍⚖️ WorldRewardBench: ~6K expert preference pairs over 1.4K videos
📈 ScorePR ↔ human ρ = 0.955

Video Generation World Model Benchmark Reward Model

Stars arXiv HF Paper Dataset

🌐 Project Page

🔮 More Coming Soon

We are actively developing projects toward real-world perception and modeling.

In the pipeline:

  • Multimodal models for streaming video understanding
  • Long-video perception and temporal reasoning benchmarks
  • Unified vision-language understanding and generation
  • Instruction-driven video generation and editing
  • Interactive world models for future-state prediction
  • Multimodal agents for real-world reasoning

Watch this space — or better yet, join us.


💡 Our Philosophy

Open Research  ≠  Slow Research
Non-Profit     ≠  Low Quality
Accessible     ≠  Trivial

We operate by a few core principles:

Principle What it means in practice
Radical openness Code, weights, data, and evaluations — public whenever possible
Depth over breadth We would rather understand one thing deeply than five things superficially
Community first Research should be reproducible, readable, and useful to everyone
No gatekeeping Research direction should be guided by scientific value and community impact
Frontier, not incremental We pursue fundamental contributions rather than marginal benchmark gains
Perception meets modeling Understanding the real world requires connecting observation, prediction, generation, and action

📄 Publications & Preprints

Publication list coming soon. All work will be posted to arXiv and linked here.

We target top-tier venues including NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, ACL, and EMNLP, and release preprints as soon as they are ready.


🛠️ Tech Stack

Python PyTorch JAX HuggingFace CUDA FastAPI Docker GitHub Actions


🤝 Join Us

UniX-AI-Lab is open to researchers, engineers, and students who share our mission.

Ways to contribute:

  • 🐛 Issues & PRs — bug fixes, new features, and documentation improvements
  • 💬 Research discussions — open an issue to discuss ideas before implementing
  • 📝 Writing — help us write papers, blog posts, or tutorials
  • 🔁 Reproduction — replicate prior work and share what you find
  • Star — help other researchers discover our work

We especially welcome:

  • ML researchers at any career stage, including PhD students
  • Engineers who care about open-source research infrastructure
  • Researchers interested in multimodal perception, video understanding, generation, world models, and agents
  • Anyone passionate about responsible and transparent AI development

📬 Contact & Links

🐙 GitHub github.com/UniX-AI-Lab
📧 Email Open an issue — we respond to all of them
🌐 Website Coming soon

UniX-AI-Lab is an independent, non-profit research collective.
We have no corporate sponsors and no commercial agenda — just curiosity and open science.

If you use our work, please cite it. If you improve it, please share it.



visitors

Popular repositories Loading

  1. WorldReasonBench WorldReasonBench Public

    WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors

    Python 22

  2. .github .github Public

  3. Evolving-Visual-Generation Evolving-Visual-Generation Public

    Forked from EvolvingLMMs-Lab/Evolving-Visual-Generation

    [Roadmap] Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling

    TeX

Repositories

Showing 3 of 3 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…