About Jhelum Labs

Advancing Artificial Intelligence Through Research and Engineering

Jhelum Labs is an independent artificial intelligence research and development initiative dedicated to building advanced AI models, exploring new machine learning techniques, and contributing to the development of capable, reliable, and responsible artificial intelligence.

We believe that advancing AI requires more than simply using existing technologies. It requires understanding how models work, experimenting with new architectures, developing training systems, evaluating model capabilities, and continuously improving the methods used to build intelligent systems.

Our Work

Our work focuses on the research, engineering, and development of artificial intelligence systems, with an emphasis on language models and modern machine learning.

  • AI Model Development — Designing, training, and improving language models and other AI systems.
  • Machine Learning Research — Exploring model architectures, training methodologies, optimization techniques, and approaches to improving model performance.
  • AI Safety and Reliability — Investigating model limitations, evaluation methods, robustness, and responsible approaches to AI development.
  • Research and Experimentation — Conducting technical experiments, documenting results, and developing research papers that communicate our methods and findings.
  • Open Research — Sharing research, technical documentation, and model resources where appropriate to support transparency, learning, and collaboration.

Our Model Development

Jhelum Labs develops its own experimental AI model series, including the W-1.1 family. Through these projects, we explore the practical challenges of building language models — from data preparation and tokenization to model architecture, training, evaluation, and inference.

Each experiment provides an opportunity to learn, test ideas, identify limitations, and improve our engineering practices. Our longer-term direction is to develop increasingly capable AI systems through systematic experimentation and research.

W-1.1

123M-parameter decoder-only Transformer. RoPE, RMSNorm, SwiGLU, 32K BPE vocab, 2,048-token context. Trained on H100 80 GB.

Read architecture →

W-1.2 Roadmap

353M parameters, grouped-query attention, 50K vocab, 4,096-token context, 8B token training target.

Read roadmap →

Open Weights

All released weights are published under Apache-2.0 with SHA-256 verification. Download and run locally with the provided generate.py.

Get started →

Our Approach

We approach AI development through a combination of scientific curiosity, engineering discipline, iterative experimentation, and technical documentation. We value measurable progress over unsupported claims and believe that publishing methods, acknowledging limitations, and evaluating systems carefully are important parts of responsible AI research.

We aim to make our work understandable and useful to developers, researchers, students, and others interested in the future of artificial intelligence.

Our Mission

Our mission is to advance artificial intelligence through independent research, original model development, and responsible engineering. We aspire to contribute useful knowledge, build capable AI systems, and make meaningful progress in machine learning through continuous experimentation and open scientific inquiry.

Looking Ahead

As we continue developing our model series and research projects, Jhelum Labs remains focused on learning, innovation, and long-term progress in artificial intelligence. We see every model, experiment, and research paper as part of a broader effort to understand and advance the possibilities of AI.

Jhelum Labs — Building AI. Advancing Research. Exploring What Comes Next.

Contact

For research inquiries, technical discussions, collaborations, or general questions, contact us at:

Email: team@jhelumlabs.in
Website: https://jhelumlabs.in

Contact research team →