Item detail
github.com

ExLlamaV3

RepoRadar surfaced ExLlamaV3 — a code repository — into the Radar section, where it sits at Gold tier with a 'try now' verdict. Its strongest signal is workflow potential, scored 9.8 out of 10.

Score8.7
Popularity100.0
Risknone
TierGold
Score breakdown
Usefulness9.0
Novelty7.0
Momentum8.0
Maturity9.3
Open-source/build8.4
Evidence7.2
Workflow potential9.8
Setup ease6.4

Popularity is tracked separately. Support, ads, sponsorships, and tips never affect these signals.

Why it matters

Most local-inference stacks force a choice between quantization quality and multi-GPU throughput. ExLlamaV3 ships both in one library and documents prebuilt CUDA wheels per toolkit version, so a two-card desktop can run a large MoE model without hand-building extensions.

Where this stands now

ExLlamaV3 ranks #47 of 3231 tracked Radar items by composite score (8.7 against a section median of 4.9). The section currently carries 2115 Bronze, 645 Gold, 471 Silver. RepoRadar has retained observations for this record since 2026-09-19 (21 days in the current window). Signal extremes versus the section: momentum at the 85th percentile; novelty at the 72th percentile.

Who should use it

local AI users developers self-hosting LLMs people running MoE models on consumer hardware

Who should skip it

Pass on ExLlamaV3 if its scope or audience does not match what your team is building right now.

About this signal

ExLlamaV3 is tracked by RepoRadar as a code repository in the Radar section. First seen 2026-09-19; the source record was last checked on 2026-09-19. The current verdict is 'try now' with a Gold tier and Moderate setup difficulty. The standout signals for ExLlamaV3 are workflow potential (9.8) and maturity (9.3), while setup ease (6.4) trails — that balance shapes where it fits best. This page summarizes the public evidence on the linked source page and states where additional review is still needed.

How this item is evaluated

The ExLlamaV3 record combines a 8.7/10 composite score with separate popularity (100.0), risk (none), and setup (Moderate) signals. See the scoring methodology for the current weights and evidence definitions.

Questions worth asking before you adopt this

Putting this into practice? Read How to evaluate an AI tool before you adopt it for the checklist behind this score.

Risk explanation

No inherent user-impacting risk: it runs models locally and does not require account or vendor credentials.

Evidence links
Closest alternatives / related signals
local ai inference quantization gpu llm python
Verification record

What RepoRadar actually verified

Discovered

Automated discovery and source capture. Last checked 2026-10-10T17:09:29.745535Z.

No editorial or hands-on review is claimed. This record remains at Discovered.

Verification sources

Longitudinal intelligence

How this decision record is moving

Raw history JSON →

21 dated snapshots retained from 2026-09-19 through 2026-10-10; see the snapshot index for explicit coverage gaps. Stars, version, release, pricing, integration, risk, maintenance, verdict, score, and momentum fields remain explicit even when a source has not reported them. Repository momentum is a normalized 0–10 RepoRadar signal; GitHub stars appear only where the popularity monitor retained exact timestamped observations.

RepoRadar score8.7 current · +0.0 net
Repository momentum9.0 current · +0.0 net
GitHub stars (observed)1,636 current · +176 net
GitHub stars1,636 exact observation
Versionv1.6.0
Last release2026-10-07T17:08:24Z
MaintenanceActive
Current riskNone
Current verdictTry now
Pricing baselineNo structured commercial pricing baseline
Pricing checkedNot applicable or not recorded
Pricing freshnessNo dated commercial pricing review
Integrations baselineNo structured integrations recorded

Recent dated points

DateScoreMomentumStarsRiskVerdictMaintenance
2026-10-108.79.01,636NoneTry nowActive
2026-10-098.79.01,625NoneTry nowActive
2026-10-088.79.61,612NoneTry nowActive
2026-10-078.79.01,606NoneTry nowActive
2026-10-068.79.01,598NoneTry nowActive
2026-10-058.79.31,588NoneTry nowActive
2026-10-038.79.01,579NoneTry nowActive
2026-10-028.79.01,572NoneTry nowActive
2026-10-018.79.01,567NoneTry nowActive
2026-09-308.79.01,550NoneTry nowActive
2026-09-298.79.01,548NoneTry nowActive
2026-09-288.79.31,537NoneTry nowActive

Why the record changed

Stars change

Stars changed: 1632 → 1636.

Stars change

Stars changed: 1625 → 1632.

Stars change

Stars changed: 1622 → 1625.

Stars change

Stars changed: 1612 → 1622.

Stars change

Stars changed: 1606 → 1612.

Stars change

Stars changed: 1601 → 1606.

Version change

Version changed: v1.5.4 → v1.6.0.

Stars change

Stars changed: 1598 → 1601.

Stars change

Stars changed: 1595 → 1598.

Stars change

Stars changed: 1588 → 1595.

Stars change

Stars changed: 1579 → 1588.

Version change

Version changed: v1.5.3 → v1.5.4.