Startup Deep Dive : Ziroh Labs — Ziroh Labs claims its Kompact AI runs LLMs of up to 30 billion parameters on CPUs and cuts infrastructure and operating costs by 70-80%

Ziroh Labs is a deeptech startup with teams in Bengaluru and Palo Alto that builds Kompact AI, a platform for running large language models on CPUs instead of GPUs.

This Startup Deep Dive explains what Ziroh Labs does, how it makes money, who backs it, how it compares with rivals and what could go wrong, using publicly available information. It is educational and not investment advice. Last updated: October 2026.

Ziroh Labs in Brief

  • What it is: Ziroh Labs is an Indian Deeptech / AI inference software company based in Bengaluru and Palo Alto (reports differ).
  • Who it serves: businesses, institutions, consumers, learners and public-sector buyers.
  • Builds Kompact AI, a platform to run LLMs on CPUs rather than GPUs
  • The platform has a CPU execution runtime, a REST-based remote server hosted via NGINX, OpenTelemetry-based observability and OpenAI-compatible client libraries
  • Kompact AI One is a semantic caching module meant to improve throughput for similar queries
  • Funding: Reports differ; one database lists about $210K over 4 small rounds.

Ziroh Labs Quick Facts

Company Ziroh Labs
Founded 2016
Headquarters Bengaluru and Palo Alto (reports differ)
Founders Hrishikesh Dewan
Sector Deeptech / AI inference software
Total funding Reports differ; one database lists about $210K over 4 small rounds
Latest round Business plan competition award of about $0.21M, August 2018 (database entry)
Valuation Not disclosed
Website Not disclosed

Figures marked “reported” come from published reports and may differ between sources; “Not disclosed” means no reliable public figure was found.

What Is Ziroh Labs?

Ziroh Labs operates in the Deeptech / AI inference software space in India. Understanding a company like this starts with three questions: who is the customer, what painful problem is being solved, and why the solution is better than the alternatives. The sections below apply that lens to Ziroh Labs.

  • Builds Kompact AI, a platform to run LLMs on CPUs rather than GPUs
  • The platform has a CPU execution runtime, a REST-based remote server hosted via NGINX, OpenTelemetry-based observability and OpenAI-compatible client libraries
  • Kompact AI One is a semantic caching module meant to improve throughput for similar queries
  • Support was expanded in 2025 to 300+ LLMs across text, speech, vision and multimodal workloads, though many were not yet released
  • Targets organisations hit by GPU shortages, energy costs or on-premise compliance needs

The Origin Story of Ziroh Labs

Every company starts from a noticed gap and a team willing to commit to closing it. Strong origin stories are specific: a clear problem, a founding team with relevant skills, and an early product that real customers could test. Founder-market fit, meaning the team’s lived experience or technical depth in the domain, tends to predict how fast a young company learns.

  • Founders: Hrishikesh Dewan.
  • The company is reported as founded in 2016 with Hrishikesh Dewan as co-founder and CEO
  • Dewan's path from Guwahati to Silicon Valley was profiled in a January 2026 feature
  • The company describes itself as a global startup with teams in Palo Alto and Bengaluru
  • It describes itself as focused on privacy-preserving cryptographic systems and a software-defined security stack in earlier profiles

Key Milestones and Challenges

No startup grows in a straight line. Early years usually involve slow adoption, product rewrites, hiring mistakes and funding gaps. In the Deeptech / AI inference software sector the common turning points are a first paying customer, a regulatory approval, a successful product demonstration or a funding round that lets the team invest ahead of demand. How a team responds to setbacks says more about resilience than any single headline.

  • 2018: listed in a database as winning a business plan competition prize of about $0.21M
  • 2025: Kompact AI launched on the IIT Madras campus and benchmarks validated there
  • 2025: support expanded to 300+ LLMs
  • 2025: Kompact AI One semantic caching module launched
  • 2025: partnership with Camb AI to run its text-to-text LLM on commodity and server-grade CPUs
  • 2026 plans: broader model support, OEM and integrator partnerships and developer SDKs

Ziroh Labs Funding and Investors

Funding history shows how much outside confidence a company has attracted and how long it can operate before needing more capital. Figures below are reported and may differ between sources; valuation figures are estimates unless the company has confirmed them.

  • Aug 2018: about $0.21M, business plan competition, Samsung Global Startup Acceleration Program named as investor (database entry; reliability uncertain)

How Does Ziroh Labs Make Money? (Business Model)

A business model describes who pays, how often and how much it costs to serve them. Strong models show repeat usage, improving margins with scale and acquisition channels that do not depend only on paid spend. Weak models show one-off sales, rising costs and growth that stops when spending stops. For companies selling to businesses, institutions, consumers, learners and public-sector buyers, sales cycles and contract size matter as much as headline growth.

  • Sells a software platform to run LLMs on CPUs for developers, startups and enterprises
  • Pitch is lower cost than GPU infrastructure, with a claimed 70-80% cost reduction (company claim)
  • Working on proof-of-concept trials with unnamed BFSI and healthcare enterprises for document intelligence and internal knowledge assistants
  • Seeks OEM, global system integrator and data centre partners

The Numbers: Ziroh Labs Financials

Financial figures show whether growth is turning into a self-sustaining business. Small and private companies often disclose little, so any number below is included only if it was found in public reporting.

  • Directory lists 40+ employees

Market Opportunity for Ziroh Labs

Market size is easy to exaggerate, so a useful approach separates the total market from the portion a company can realistically reach with its current product and distribution. The main forces behind demand in this sector are rising digital adoption, cloud and mobile penetration, growing enterprise technology spending, government digitisation programmes and a deep pool of engineering talent. Each of these widens the opportunity, but capital efficiency and execution decide who captures it.

  • Demand for alternatives to scarce and costly GPUs for LLM inference
  • Enterprise AI adoption in regulated sectors such as BFSI and healthcare

Technology and Product at Ziroh Labs

Technology is rarely the whole moat, but it drives speed, cost and customer experience. A practical way to assess it is to separate the capability the company controls from the commodity infrastructure it rents. In this sector the important factors are product quality, data and integration depth, security, scalability and the speed of shipping improvements.

  • CPU-based LLM execution runtime with accuracy claimed to be maintained
  • Claims to run models up to 30 billion parameters on CPUs
  • Semantic caching for throughput
  • OpenTelemetry observability and OpenAI-compatible client libraries

Team and Culture at Ziroh Labs

Teams are the most important and least measurable asset of a young company. Look at how complementary the founders’ skills are, how deep the second layer of leadership is, and how the company hires and retains specialists. Culture shows up in small repeated behaviours: how quickly bad news travels upward and whether commitments to customers are kept.

  • Hrishikesh Dewan, co-founder and CEO
  • Teams in Palo Alto and Bengaluru

Ziroh Labs Competitors: Competitive Landscape

A fair competitive analysis names direct rivals, adjacent players who could move into the space, and the customer’s default alternative. Durable advantages include proprietary data or technology, licences and approvals, brand trust, switching costs and cost leadership.

  • Direct competitors of Ziroh Labs vary by product line; a verified rival comparison was not available from public sources.
  • What to compare: Product readiness, pricing, customer base, funding runway and regulatory standing.

Risks and Challenges for Ziroh Labs

  • Performance claims are the company's own and not independently verified
  • Limited public financial and funding disclosure
  • Many of the 300+ announced models were not yet available
  • Competes against GPU-centric inference ecosystems
  • Competition: low barriers to entry and well-funded rivals can compress pricing and slow growth.
  • Funding risk: technology businesses often burn cash before reaching profit and depend on investor appetite.

Risk is not a reason to avoid a company; it is a reason to price it correctly and to monitor the right indicators over time. Regulation in this sector is shaped by data protection rules under the Digital Personal Data Protection Act, sector regulators, consumer protection law and IT rules.

Ziroh Labs Growth Outlook: What to Watch

  • Plans for broader enterprise capability, OEM and integrator partnerships and developer SDKs in 2026
  • Success depends on converting proof-of-concept trials into paying customers
  • Key indicators: recurring revenue, customer retention, gross margin, customer acquisition cost and runway.
  • Funding position: Whether Ziroh Labs can reach its next milestone before needing new capital.
  • Regulation: Changes from data protection rules under the Digital Personal Data Protection Act, sector regulators, consumer protection law and IT rules.

Industry Context: Where Ziroh Labs Fits

India's technology startup ecosystem is one of the largest in the world, supported by cheap data, a large base of smartphone users, digital public infrastructure and a deep engineering talent pool. Companies now build for education, software, mobility, logistics, agriculture, defence, media and more, selling both to Indian customers and abroad.

Durable technology companies usually combine a clear customer problem with repeatable distribution and disciplined unit economics. Growth funded only by spending tends to fade, while products that customers keep using and paying for build compounding advantages.

For readers new to this field, a useful habit is to separate announcements from evidence. A plan, a partnership or a funding headline describes intent, while a delivered product, a paying customer or an audited financial statement describes results. Comparing the two over time shows how reliably a company turns promises into outcomes.

Bull Case and Bear Case for Ziroh Labs

An investment thesis is a short, testable statement of why a company could become far more valuable, together with what evidence would prove it wrong. The points below are general to this sector and are not forecasts for Ziroh Labs.

Bull case

  • A large and growing base of digital users and businesses expands the addressable market.
  • Recurring revenue and strong retention can compound growth.
  • Selling into global markets widens the opportunity beyond India.

Bear case

  • Heavy competition can compress pricing and margins.
  • Dependence on external funding can force painful cost cuts.
  • Regulation or platform changes can disrupt a product quickly.

Lessons Founders and Investors Can Take from Ziroh Labs

Studying a company in the Deeptech / AI inference software space offers lessons that go beyond any single firm. The points below are general lessons for the sector and are not claims about Ziroh Labs.

  • Solving a clear, frequent customer problem matters more than adding features.
  • Retention and repeat usage are better health signals than sign-ups.
  • Disciplined spending extends runway and keeps options open when funding tightens.
  • Distribution, not just product quality, decides who wins in crowded markets.
  • Building trust through data protection and reliability is part of the product.

How to Evaluate Ziroh Labs as a Startup

  • Customer clarity: Can Ziroh Labs name its customer and the problem it solves in one sentence?
  • Evidence of demand: Look for repeat customers, signed contracts or measurable usage rather than announcements alone.
  • Economics: Check whether margins improve as volume grows.
  • Execution: Compare announced timelines with what has actually been delivered.
  • Funding runway: Estimate how long current capital lasts at the present spending rate.
  • Regulatory standing: Confirm required approvals are in place.
  • Customer concentration: Check whether a few customers account for most of the revenue.
  • Management depth: Look for experienced leaders beyond the founders and a stable core team.

The Takeaway

Ziroh Labs is part of India’s growing Deeptech / AI inference software ecosystem. The useful lesson from studying it is the discipline of asking structured questions about customers, economics, advantage and resilience. Companies that answer them well, repeatedly and under pressure are the ones that endure. Readers should treat any single report, ranking or funding headline as one input among many, and should re-check key facts against recent company announcements. Because public information on young companies is often limited, patience in verifying claims is part of good analysis. Public sources can also describe the same company in different ways, so it is worth checking dates, definitions and whether a figure refers to revenue, total income or transaction value, and whether it covers one entity or a wider group, before drawing conclusions. Small differences in rounding, currency conversion or reporting periods can also change how a figure reads. Comparing the same figure across several recent reports helps show whether it is stable or has changed over time. This article is educational and is not investment advice.

  • Clear customers and repeat demand matter more than announcements.
  • Regulation and capital needs shape how fast a startup in this sector can grow.
  • Track a few leading indicators over time rather than one headline metric.

Ziroh Labs FAQs: Frequently Asked Questions

What is Ziroh Labs?

Ziroh Labs is a deeptech startup with teams in Bengaluru and Palo Alto that builds Kompact AI, a platform for running large language models on CPUs instead of GPUs. It is profiled in the Startup Deep Dive series, which explains business model, funding, competitors and risks.

Who founded Ziroh Labs?

Ziroh Labs was founded by Hrishikesh Dewan, and the company reports a founding year of 2016.

How much funding has Ziroh Labs raised?

Reports differ; one database lists about $210K over 4 small rounds. Funding figures are reported and may differ between sources, so readers should check the latest company announcements.

How does Ziroh Labs make money?

Ziroh Labs earns revenue from its Deeptech / AI inference software products and services sold to businesses, institutions, consumers, learners and public-sector buyers. The exact revenue mix is described in the business model section and is not fully disclosed publicly.

Who are the competitors of Ziroh Labs?

Competitors of Ziroh Labs depend on the specific product line. A verified comparison was not available, so see the evaluation checklist above.

What are the main risks for Ziroh Labs?

Main risks include competition: low barriers to entry and well-funded rivals can compress pricing and slow growth, funding and capital needs, competition and regulation by data protection rules under the Digital Personal Data Protection Act, sector regulators, consumer protection law and IT rules. This is educational content, not investment advice.

Related Startup Deep Dives: CynLr — Raised $10 million Series A in November 2024 led by Pavestone and Athera Venture Partners, taking total funding to $15.2 million | Yali Aerospace — Backed by Zoho Corporation in May 2024; FY25 revenue Rs 7.3 lakh with a loss of about Rs 99.4 lakh. Browse the full Startup Deep Dive series.

Source

Source: Publicly available data, published reports, industry research, and other credible sources.

Picture of Indian Startup Times

Indian Startup Times

Leave a Reply

Your email address will not be published. Required fields are marked *