Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
574 commits
Select commit Hold shift + click to select a range
1984442
docs: compare qwen35 and qwen35moe schemas
Sep 4, 2026
30d7d49
feat: admit dense qwen35 GGUF hybrid models
Sep 4, 2026
6028ff2
fix: preserve qwen35moe GGUF config width
Sep 4, 2026
c60f0f5
feat: decode qwen35 dense GGUF weights
Sep 4, 2026
c9f0fb0
docs: record qwen35 dense loader milestone
Sep 4, 2026
b00f3ce
docs: record qwen35 construction validation
Sep 4, 2026
e62b3c1
docs: record reproducible Q4 MMV_Y=4 promotion candidate
Sep 5, 2026
e2d8f6c
docs: record Gemma4 native text matrix
Sep 5, 2026
7797d2d
docs: record matched Gemma4 llama.cpp control
Sep 5, 2026
f74a3e6
feat: opt in to Gemma prefill overlap
Sep 5, 2026
111f144
docs: record Gemma prefill overlap rejection
Sep 5, 2026
c70b31d
perf: enable Gemma ROCm prefill warmup
Sep 5, 2026
eaf19ab
perf: parameterize Gemma expert memory ratio
Sep 5, 2026
8ac3adf
docs: reject higher Gemma memory ratio
Sep 5, 2026
6916669
bench: add Gemma prompt length control
Sep 5, 2026
713026f
docs: record Gemma prompt scaling
Sep 5, 2026
14a12e8
bench: match llama.cpp Gemma prompt scaling
Sep 5, 2026
5341af5
docs: record matched long prompt control
Sep 5, 2026
c7cffd5
bench: match Gemma concurrent prompt scaling
Sep 5, 2026
5f8cb0e
bench: match llama.cpp concurrent prompt scaling
Sep 5, 2026
9291f52
docs: record matched Gemma concurrency
Sep 5, 2026
41f769e
docs: record eight-client Gemma stress
Sep 5, 2026
f68a901
docs: record two-client Gemma control
Sep 5, 2026
1257759
perf: parameterize Gemma scheduler request limit
Sep 5, 2026
5d86645
docs: record Gemma scheduler admission candidate
Sep 5, 2026
dbb4e63
docs: record max six Gemma scheduler candidate
Sep 5, 2026
03575af
docs: consolidate current cross-model benchmark matrix
Sep 5, 2026
2a2d8af
docs: add machine-readable cross-model manifest
Sep 5, 2026
1b34eef
docs: refresh live 284b capacity evidence
Sep 5, 2026
3a631a3
docs: record same-format Qwen GGUF control
Sep 5, 2026
f8a9f91
docs: record exact-format Qwen raw controls
Sep 5, 2026
e6884a2
docs: record warmed Qwen GGUF matrix
Sep 5, 2026
a50a68e
docs: complete warmed Qwen GGUF comparison
Sep 5, 2026
2087e16
docs: update campaign completion audit
Sep 5, 2026
54354ea
docs: add final AMD campaign report
Sep 5, 2026
4eca6fe
docs: refresh upstream review status
Sep 5, 2026
15a018a
docs: add upstream handoff checklist
Sep 5, 2026
fa8e760
docs: record final handoff audit
Sep 5, 2026
835ae63
docs: anchor 284b capacity limits to primary paper
Sep 5, 2026
9c39cdb
docs: compare paper and local expert bandwidth evidence
Sep 5, 2026
39ab06b
docs: gate 284b claims on exact checkpoint identity
Sep 5, 2026
a98c4cf
docs: refresh DeepSeek capacity metadata gate
Sep 5, 2026
3622777
docs: pin DeepSeek release revision for paper gate
Sep 5, 2026
f79a240
docs: record pinned DeepSeek config identity
Sep 5, 2026
17a5c77
feat: add reproducible DeepSeek metadata capacity gate
Sep 5, 2026
abb64cc
docs: carry capacity rejection into handoff audit
Sep 5, 2026
6d12d09
docs: add DeepSeek expert slice metadata
Sep 5, 2026
7577fb6
feat: add isolated DeepSeek expert slice harness
Sep 5, 2026
32f1d84
test: validate expert slice metadata selection
Sep 5, 2026
d8dc4f5
docs: reconcile DeepSeek capacity gate status
Sep 5, 2026
e495f3e
docs: record real-shape DeepSeek ROCm slice
Sep 5, 2026
25b0e12
docs: compare real-shape slice bandwidth
Sep 5, 2026
78cc702
docs: record larger DeepSeek expert slice
Sep 5, 2026
7013365
docs: record cross-shard DeepSeek slice
Sep 5, 2026
31c44dd
docs: record expert route churn controls
Sep 5, 2026
f91446c
docs: add DeepSeek route transfer projection
Sep 5, 2026
803a3ce
test: align HIP GGUF default flag contract
Sep 5, 2026
bd6d4a2
docs: record HIP flag contract validation
Sep 5, 2026
ff76ede
feat(rocm): add four-row GGUF MMV screen
Sep 1, 2026
33ce651
docs: close current-branch MMV Y4 qualification
Sep 5, 2026
57c57c3
docs: record current MMV Y4 campaign closure
Sep 5, 2026
50bd6dd
fix: make AIME quality contract explicit
Sep 5, 2026
4fb00c9
docs: distinguish active AIME quality contract
Sep 5, 2026
865db9a
docs: record AIME contract probe boundary
Sep 5, 2026
ce8d1ba
docs: record paired MMV Y1 control
Sep 5, 2026
8ad5b63
test(rocm): align legacy copy catalog assertion
Sep 5, 2026
4a9c05f
Merge upstream main into AMD ROCm branch
Sep 5, 2026
58eab4e
docs: record upstream sync and ROCm guard validation
Sep 5, 2026
5a56629
docs: record native ROCm extension build
Sep 5, 2026
618ae4f
docs: preserve ROCm extension build artifact
Sep 5, 2026
5afc1f4
docs: record FP8 GEMV tile32 repeatability gate
Sep 5, 2026
07bf428
docs: reject FP8 tile32 under Qwen concurrency
Sep 5, 2026
e7a5a92
docs: correct warmed tile32 concurrency gate
Sep 5, 2026
08d344e
docs: record exact branch ROCm regression
Sep 5, 2026
47c5926
feat(rocm): expose opt-in NVFP4 deep-K tile
Sep 5, 2026
cd897f7
docs: record deep-K NVFP4 candidate gate
Sep 5, 2026
36b9ec7
docs: record MMV Y8 infrastructure attempt
Sep 5, 2026
7e7f77c
docs: record clean-window MMV Y8 attempt
Sep 5, 2026
94021ec
feat(daemon): add named model swap profiles
Sep 10, 2026
14f344e
feat(daemon): wait for profile readiness
Sep 10, 2026
1f80150
test(daemon): cover profile readiness timeout
Sep 10, 2026
c980106
feat(daemon): add shutdown client command
Sep 10, 2026
ccc6295
docs: anonymize AMD host names and deployment paths
Sep 10, 2026
f88da87
fix(swap): enforce readiness and document direct routing integration
Sep 10, 2026
6707cb5
fix(bench): derive operator paths and guard public document privacy
Sep 10, 2026
0e1364e
fix(amd): load dense Qwen projections using per-tensor GGUF types
Sep 10, 2026
63ecac0
docs: normalize anonymous hardware label and sanitize JSON evidence i…
Sep 10, 2026
94b034a
docs: record extended live swap qualification and model checksums
Sep 10, 2026
492a52c
test(swap): qualify concurrent routing and idle eviction with private…
Sep 10, 2026
de23ad6
docs: anonymize publication metadata and require explicit benchmark h…
Sep 10, 2026
899d571
fix(swap): recover previous launch after replacement spawn failure
Sep 10, 2026
accf7f3
fix(swap): recover failed readiness without overriding newer lifecycl…
Sep 10, 2026
4c35cdb
test(swap): add strict streaming disconnect qualification gate
Sep 10, 2026
f9b0453
test(swap): exercise real Linux process rollback and worker cleanup
Sep 10, 2026
64dcc68
test(swap): assert termination signals and document Linux recovery ev…
Sep 10, 2026
99bdea1
docs(swap): record combined branch validation and remaining completio…
Sep 10, 2026
64ab64f
test(swap): qualify live cancellation and real model failure recovery
Sep 10, 2026
c0534c6
docs: record real cancellation and model failure recovery results
Sep 10, 2026
ae566f4
docs(swap): establish source-backed native parity matrix
Sep 10, 2026
6ca47ff
feat(swap): validate native routing policy configuration
Sep 10, 2026
a392af9
feat(swap): add native inference routing admission
Sep 10, 2026
24849c6
feat(swap): evict idle routed engines
Sep 10, 2026
901c0b9
test(swap): exercise invalid profile group validation
Sep 10, 2026
2e4316c
feat(swap): expose router admission metrics
Sep 10, 2026
ae7ccdd
feat(swap): add guarded upstream passthrough
Sep 10, 2026
2865ef0
feat(swap): reload validated routing catalogs
Sep 10, 2026
0d0cea5
feat(swap): enforce single-slot persistent residency
Sep 10, 2026
1b9c59a
feat(swap): cancel routed inflight requests
Sep 10, 2026
76c3288
feat(swap): report configured and resident profiles
Sep 10, 2026
667277c
docs(swap): distinguish native routing evidence
Sep 10, 2026
596cfae
test(swap): exercise real loopback SSE proxying
Sep 10, 2026
7124501
feat(swap): record native proxy timing signals
Sep 10, 2026
8551430
feat(swap): configure native upstream timeout
Sep 10, 2026
66e50cd
feat(swap): add safe profile request filters
Sep 10, 2026
d5590f4
test(swap): cover native router with real child
Sep 10, 2026
a440057
fix(swap): protect router management with API keys
Sep 10, 2026
80bb5dd
docs(swap): record current daemon regression gate
Sep 10, 2026
76f531d
docs(swap): add native qualification matrix
Sep 10, 2026
fffde24
feat(swap): add private router event stream
Sep 14, 2026
7007dbc
feat(swap): allocate dynamic routed ports
Sep 14, 2026
56afc86
feat(swap): add native management load
Sep 14, 2026
e5d0a41
feat(swap): expose native model list and readiness
Sep 14, 2026
32d56c7
fix(swap): keep concrete paths out of router logs
Sep 14, 2026
10bb1b6
docs(swap): inventory pinned reference surfaces
Sep 14, 2026
4729992
fix(swap): reject unsupported group coexistence
Sep 14, 2026
0dabbd0
feat(swap): add private local management UI
Sep 14, 2026
52aebcf
feat(swap): safely watch catalog changes
Sep 14, 2026
b6ac3ee
feat(swap): expose router transfer timing
Sep 14, 2026
1ee4499
test(swap): cover every routed text endpoint
Sep 14, 2026
44d8354
feat(swap): add native routing benchmark gate
Sep 14, 2026
c45a5d0
fix(swap): restrict maintenance benchmark to Linux
Sep 14, 2026
3cd2082
test(swap): validate native benchmark observations
Sep 14, 2026
b238a7f
feat(swap): retain benchmark metric snapshots
Sep 14, 2026
af25b64
test(swap): preserve routed upstream errors
Sep 14, 2026
a75a6aa
test(swap): exercise dynamic ports with real children
Sep 14, 2026
67b0f63
fix(swap): freeze active routing policy on reload
Sep 14, 2026
984bba9
test(swap): cover active group policy reload conflict
Sep 14, 2026
f572b9c
fix(swap): keep router credentials out of upstream
Sep 14, 2026
de1885a
test(swap): verify auth stripping over loopback
Sep 14, 2026
cb1710d
fix(swap): preserve engine response headers
Sep 14, 2026
1d8af20
test(swap): rotate router keys through catalog reload
Sep 14, 2026
5cd63d3
docs(swap): separate current and historical evidence
Sep 14, 2026
2d0390c
test(swap): verify benchmark scenario state
Sep 14, 2026
4e8b7b0
feat(swap): capture private benchmark hardware snapshots
Sep 14, 2026
7d9465e
fix(swap): validate native benchmark catalog
Sep 14, 2026
079bedd
test(swap): require benchmark process observations
Sep 14, 2026
f2a9c21
test(swap): verify benchmark listener cleanup
Sep 14, 2026
5ce51c0
docs(swap): retain direct benchmark lifecycle evidence
Sep 14, 2026
64af6be
docs(swap): record current daemon verification
Sep 14, 2026
9d795ae
fix(swap): verify resident identity in readiness
Sep 14, 2026
d9dc7f7
test(swap): reject stale args and port in readiness
Sep 14, 2026
5b31904
fix(swap): expose stale resident identity
Sep 14, 2026
644482b
fix(swap): report stale children as nonresident
Sep 14, 2026
6941425
feat(swap): export resident identity metric
Sep 14, 2026
b01e77e
test(swap): require concrete benchmark identity
Sep 14, 2026
aa1bf63
feat(swap): record usage-derived benchmark throughput
Sep 14, 2026
3e4fbad
feat(swap): expose benchmark decode interval
Sep 14, 2026
a6d5244
fix(swap): exclude cancelled streams from completions
Sep 14, 2026
d01ba57
feat(swap): qualify native router cancellation
Sep 14, 2026
92a3987
feat(swap): qualify same-model concurrency
Sep 14, 2026
235d3a2
feat(swap): qualify native TTL eviction
Sep 14, 2026
5b6eda1
feat(swap): qualify active catalog reload conflict
Sep 14, 2026
53a96ce
feat(swap): qualify failed-switch rollback
Sep 14, 2026
4dbc56b
test(swap): require rollback accounting evidence
Sep 14, 2026
c62e3a5
fix(swap): bind exact re-adopted residency
Sep 14, 2026
e9901c0
test(swap): cover real child router re-adoption
Sep 14, 2026
4961590
feat(swap): qualify daemon re-adoption
Sep 14, 2026
9d0e9d4
docs(swap): refresh draft PR evidence
Sep 14, 2026
0033721
docs(swap): keep PR evidence revision-stable
Sep 14, 2026
37df2bb
feat(swap): qualify persistent capacity protection
Sep 14, 2026
1ac3053
test(swap): prove unload one and all semantics
Sep 14, 2026
b3d5c50
docs(swap): record current daemon suite
Sep 14, 2026
bd2b630
feat(swap): qualify conflicting request drain
Sep 14, 2026
5944629
docs(swap): align parity classifications with ownership
Sep 14, 2026
b0fe4ea
fix(swap): filter hop-by-hop response headers
Sep 14, 2026
e1370d3
fix(swap): stabilize unknown model errors
Sep 14, 2026
ca5cfaf
docs(swap): refresh full suite evidence
Sep 14, 2026
05cb116
fix(swap): reserve request IDs before admission
Sep 14, 2026
e494236
fix(swap): cancel abandoned admission waiters
Sep 14, 2026
82be471
test(swap): classify legacy generate routing
Sep 14, 2026
12c5bb6
fix(swap): cancel requests across owned phases
Sep 14, 2026
e990b5c
docs(swap): align research with native ownership
Sep 14, 2026
cc14820
fix(swap): linearize router readiness probes
Sep 14, 2026
94c12f9
fix(swap): serialize manual and routed lifecycle
Sep 14, 2026
1af92a7
fix(swap): retain manual ownership after disconnect
Sep 14, 2026
96d8e60
fix(swap): finish manual transactions after disconnect
Sep 14, 2026
c4667b1
fix(swap): quiesce routing before daemon shutdown
Sep 14, 2026
68caf9e
fix(swap): coordinate daemon exit with routing
Sep 14, 2026
5b6ab25
fix(swap): make catalog binding atomic with admission
Sep 14, 2026
d460906
test(swap): qualify authenticated control plane
Sep 14, 2026
e19b99d
feat(swap): add alternate model aliases
Sep 14, 2026
2c51f8d
feat(swap): add browser CORS compatibility
Sep 14, 2026
4626450
feat(swap): support pinned API key forms
Sep 14, 2026
c5dee9c
feat(swap): enforce concurrency admission limits
Sep 14, 2026
744eb0c
feat(swap): expose exact model load status
Sep 14, 2026
2e720ef
fix(swap): align public models alias
Sep 14, 2026
0933243
feat(swap): support namespaced model ids
Sep 14, 2026
e376fa6
docs(swap): classify streaming load feedback gap
Sep 14, 2026
c1b1004
feat(swap): stream cold model loading state
Sep 14, 2026
f55dec7
test(swap): gate cold loading with real child
Sep 14, 2026
51c1869
docs(swap): refresh current PR audit
Sep 14, 2026
a56ccdc
feat(swap): preserve stateless response routes
Sep 14, 2026
fdfce8b
ci(swap): run daemon suite on Linux
Sep 14, 2026
0b24bbf
ci(swap): expose bounded Linux failures
Sep 14, 2026
b25b2cb
test(swap): fix Linux SSE fixture
Sep 14, 2026
e906b73
test(swap): emit real SSE newlines on Linux
Sep 15, 2026
5ee1e26
test(swap): tolerate vanished Linux workers
Sep 15, 2026
098d758
docs(swap): record hosted Linux process evidence
Sep 15, 2026
22cbd39
ci(swap): report clean Linux totals
Sep 15, 2026
bf70a04
fix(swap): gate maintenance by exact host
Sep 15, 2026
4615daa
docs(swap): record maintenance host gate evidence
Sep 15, 2026
261d80f
fix(daemon): make AMD memory evidence fail closed
Sep 15, 2026
8930738
docs(swap): record AMD observability evidence
Sep 15, 2026
89d026c
Add safe model capability metadata
Sep 15, 2026
bf4a584
Record capability metadata verification
Sep 15, 2026
70fe9f4
Add safe request parameter filters
Sep 15, 2026
2b35abd
Record request filter verification
Sep 15, 2026
cbf00d6
feat: add native warm and pin selectors
Sep 15, 2026
6ba35b0
docs: record selector verification
Sep 15, 2026
3b257bd
feat: add runtime routing profiles
Sep 15, 2026
efe605e
docs: record runtime profile evidence
Sep 15, 2026
c0833f4
feat: add safe readiness and proxy targets
Sep 15, 2026
743361b
docs: record readiness target evidence
Sep 15, 2026
2c90c60
feat(swap): support upstream model name overrides
Sep 15, 2026
8f71070
docs(swap): record upstream model rewrite evidence
Sep 15, 2026
07abf68
feat(swap): expose safe model listing metadata
Sep 15, 2026
08d807b
docs(swap): record model metadata parity evidence
Sep 15, 2026
53b1c6c
feat(swap): support per-profile upstream timeouts
Sep 15, 2026
da02637
docs(swap): record profile timeout evidence
Sep 15, 2026
a3fc0dd
feat(swap): preload a model through native startup
Sep 15, 2026
17fe93c
docs(swap): record startup preload evidence
Sep 15, 2026
5a98b29
Add pinned source inventory and safe upstream guard
Sep 15, 2026
4b81267
Record source inventory and upstream guard evidence
Sep 15, 2026
38c2457
Add bounded activity and opt-in captures
Sep 15, 2026
b2c80e8
Record bounded activity and capture evidence
Sep 15, 2026
493aecd
feat(swap): persist activity and add session-aware UI
Sep 15, 2026
df13574
docs(swap): record durable activity CI evidence
Sep 15, 2026
174bda1
feat(swap): add bounded periodic performance history
Sep 15, 2026
da4b8df
docs(swap): record performance history evidence
Sep 15, 2026
c5d130b
docs(swap): record current combined-tree CPU evidence
Sep 15, 2026
39c3aaa
test(swap): gate live periodic performance evidence
Sep 15, 2026
a5846c0
docs(swap): refresh final CPU qualification evidence
Sep 15, 2026
0c356c1
docs: explain FreeToken swap code line by line
Sep 15, 2026
150c88e
LAN-215 private combined qualification tree
Sep 19, 2026
56e0232
feat(daemon): qualify native model swapping on AMD
dbourdea Sep 24, 2026
53bb9b9
docs(swap): record final AMD qualification and startup
dbourdea Sep 24, 2026
117c8d6
style: normalize final newlines before release
dbourdea Sep 30, 2026
cb394d0
release: prepare FreeToken 0.2.0
dbourdea Sep 30, 2026
48dcf6a
docs: remove private host identifiers before release
dbourdea Sep 30, 2026
36de0a3
fix: close final AMD release review findings
dbourdea Sep 30, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 1 addition & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
*.pdf binary
93 changes: 93 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_desktop.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,93 @@
name: Bug report (Desktop app)
description: Something does not work in the FreeToken Desktop app.
labels: ["bug", "Desktop"]
body:
- type: markdown
attributes:
value: |
Before opening an issue, please read the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84) and the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79). Most install and runtime problems are answered in the FAQ. Reports missing the information below may be closed until it is provided; see [CONTRIBUTING.md](https://github.com/FlashML-org/FreeToken/blob/main/CONTRIBUTING.md#reporting-issues).
- type: checkboxes
id: checks
attributes:
label: Before you start
options:
- label: I have read the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84) and my problem is not answered there.
required: true
- label: I have read the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79) and this is not already planned there.
required: true
- label: I have searched [existing issues](https://github.com/FlashML-org/FreeToken/issues?q=is%3Aissue) and found no duplicate.
required: true
- label: I have restarted the Desktop app to pick up the latest update and the problem still happens.
required: true
- type: textarea
id: description
attributes:
label: What happened
description: What you did, what you expected, and what happened instead.
validations:
required: true
- type: input
id: version
attributes:
label: Desktop app version
description: Shown in the app's settings / about page.
validations:
required: true
- type: dropdown
id: os
attributes:
label: OS
options:
- Windows 11
- Windows 10
- Ubuntu
- Debian
- Fedora
- Arch Linux
- Other Linux
validations:
required: true
- type: input
id: os_detail
attributes:
label: OS details
description: Distribution version (e.g. Ubuntu 24.04), kernel, desktop environment, or anything unusual about the system.
- type: input
id: gpu
attributes:
label: GPU and driver
description: "GPU model, memory, driver/runtime version, and architecture from `nvidia-smi` or `rocminfo`. Mention other GPUs in the machine and whether the run used CUDA or ROCm/HIP."
placeholder: Radeon 8060S gfx1151, ROCm 10.x; or RTX 4060 Laptop 8GB, driver 580.xx
validations:
required: true
- type: input
id: cpu
attributes:
label: CPU and system RAM
placeholder: i9-13900H, 32GB
validations:
required: true
- type: input
id: model
attributes:
label: Checkpoint
description: The exact Hugging Face or ModelScope ID, not just the model name.
placeholder: Qwen/Qwen3.6-35B-A3B-FP8
validations:
required: true
- type: textarea
id: settings
attributes:
label: Model settings
description: The settings used when loading the model (context length, backend, any changed defaults).
- type: textarea
id: log
attributes:
label: Engine log
description: "**Logs → Server status → Copy** in the app, pasted as text, not a screenshot."
render: text
- type: textarea
id: extra
attributes:
label: Anything else
description: Proxies, unusual setups, or anything that may matter.
105 changes: 105 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_engine.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
name: Bug report (Engine)
description: Something does not work with the FreeToken engine (ft command line, pip wheel, or source build).
labels: ["bug"]
body:
- type: markdown
attributes:
value: |
Before opening an issue, please read the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84) and the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79). Most install and runtime problems are answered in the FAQ. Reports missing the information below may be closed until it is provided; see [CONTRIBUTING.md](https://github.com/FlashML-org/FreeToken/blob/main/CONTRIBUTING.md#reporting-issues).
- type: checkboxes
id: checks
attributes:
label: Before you start
options:
- label: I have read the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84) and my problem is not answered there.
required: true
- label: I have read the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79) and this is not already planned there.
required: true
- label: I have searched [existing issues](https://github.com/FlashML-org/FreeToken/issues?q=is%3Aissue) and found no duplicate.
required: true
- label: I am on the latest release, or on a freshly rebuilt `main` when building from source.
required: true
- type: textarea
id: description
attributes:
label: What happened
description: What you did, what you expected, and what happened instead.
validations:
required: true
- type: dropdown
id: install
attributes:
label: How did you install FreeToken
options:
- pip / uv wheel
- Built from source
validations:
required: true
- type: input
id: version
attributes:
label: FreeToken version
description: "`ft --version`, or `git rev-parse --short HEAD` when building from source."
validations:
required: true
- type: dropdown
id: os
attributes:
label: OS
options:
- Windows 11
- Windows 10
- WSL2 on Windows 11
- WSL2 on Windows 10
- Ubuntu
- Debian
- Fedora
- Arch Linux
- Other Linux
validations:
required: true
- type: input
id: os_detail
attributes:
label: OS details
description: Distribution version (e.g. Ubuntu 24.04), kernel, WSL distro, Python version, or anything unusual about the system.
- type: input
id: gpu
attributes:
label: GPU and driver
description: "GPU model, memory, driver/runtime version, and architecture from `nvidia-smi` or `rocminfo`. Mention other GPUs in the machine and whether the run used CUDA or ROCm/HIP."
placeholder: Radeon 8060S gfx1151, ROCm 10.x; or RTX 4060 Laptop 8GB, driver 580.xx
validations:
required: true
- type: input
id: cpu
attributes:
label: CPU and system RAM
placeholder: i9-13900H, 32GB
validations:
required: true
- type: input
id: model
attributes:
label: Checkpoint
description: The exact Hugging Face or ModelScope ID, not just the model name.
placeholder: Qwen/Qwen3.6-35B-A3B-FP8
validations:
required: true
- type: textarea
id: command
attributes:
label: Command
description: The exact command you ran.
render: shell
- type: textarea
id: log
attributes:
label: Full log
description: The full log as text, not a screenshot of the last line.
render: text
- type: textarea
id: extra
attributes:
label: Anything else
description: Proxies, unusual setups, or anything that may matter.
17 changes: 17 additions & 0 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
blank_issues_enabled: false
contact_links:
- name: FAQ (read first)
url: https://github.com/FlashML-org/FreeToken/issues/84
about: Most install and runtime problems are already answered here.
- name: Roadmap (read first)
url: https://github.com/FlashML-org/FreeToken/issues/79
about: What we are working on next. Please do not open a new issue for something already on the Roadmap.
- name: Usage questions (Discord)
url: https://discord.gg/MsA277cJzZ
about: Ask on the Community Discord instead of opening an issue.
- name: Usage questions (WeChat, CN)
url: https://github.com/FlashML-org/FreeToken/blob/main/assets/freetoken-wechatgroup.png
about: Scan the QR code to join the Community WeChat group.
- name: Development discussion
url: https://join.slack.com/t/flashml/shared_invite/zt-3zpdh5j10-9dwTXrgLiqpVxizhA9KVbA
about: Join the Developer Slack to discuss Roadmap items before starting work.
46 changes: 46 additions & 0 deletions .github/ISSUE_TEMPLATE/feature_request.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
name: Feature request
description: Suggest a feature or improvement. For a model or checkpoint that does not load, use "Support Model Checkpoint" instead.
labels: ["feature"]
body:
- type: markdown
attributes:
value: |
Before opening an issue, please check the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79) and the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84). If your request is already on the Roadmap, please do not open a new issue for it. Features not on the Roadmap should start as an issue, not a PR; see [CONTRIBUTING.md](https://github.com/FlashML-org/FreeToken/blob/main/CONTRIBUTING.md).
- type: checkboxes
id: checks
attributes:
label: Before you start
options:
- label: I have read the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79) and this is not already planned there.
required: true
- label: I have read the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84).
required: true
- label: I have searched [existing issues](https://github.com/FlashML-org/FreeToken/issues?q=is%3Aissue) and found no duplicate.
required: true
- type: dropdown
id: target
attributes:
label: Applies to
options:
- Desktop app
- Engine
- Both
validations:
required: true
- type: textarea
id: problem
attributes:
label: What problem does this solve
description: The use case, and why current FreeToken does not cover it.
validations:
required: true
- type: textarea
id: proposal
attributes:
label: Proposed solution
validations:
required: true
- type: textarea
id: alternatives
attributes:
label: Alternatives considered
64 changes: 64 additions & 0 deletions .github/ISSUE_TEMPLATE/model_checkpoint.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
name: Support Model Checkpoint
description: A checkpoint FreeToken cannot load, whether a new model architecture or an unsupported checkpoint or quantization of a supported one.
labels: ["new-model"]
body:
- type: markdown
attributes:
value: |
Before opening an issue, please check the [supported models](https://github.com/FlashML-org/FreeToken/blob/main/docs/models.md), the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79) and the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84). A checkpoint listed there that fails to load is a bug: use a Bug report instead. Other checkpoints of a supported architecture usually work without changes; try them first. If the architecture is supported but a specific unlisted checkpoint or quantization fails to load, this is the right template.
- type: checkboxes
id: checks
attributes:
label: Before you start
options:
- label: I have checked the [supported models](https://github.com/FlashML-org/FreeToken/blob/main/docs/models.md) and this checkpoint is not listed there. A listed checkpoint that fails is a bug; use a Bug report instead.
required: true
- label: I have read the [Roadmap](https://github.com/FlashML-org/FreeToken/issues/79) and this model is not already planned there.
required: true
- label: I have read the [FAQ](https://github.com/FlashML-org/FreeToken/issues/84).
required: true
- label: I have searched [existing issues](https://github.com/FlashML-org/FreeToken/issues?q=is%3Aissue) and found no duplicate.
required: true
- type: input
id: link
attributes:
label: Hugging Face link
description: The exact checkpoint you want to run, not just the model family.
placeholder: https://huggingface.co/Qwen/Qwen3.6-35B-A3B-FP8
validations:
required: true
- type: dropdown
id: arch
attributes:
label: Is the model architecture already supported
description: Check the architecture, not the checkpoint, against the [supported models](https://github.com/FlashML-org/FreeToken/blob/main/docs/models.md) table.
options:
- Yes, but this checkpoint or quantization does not load
- No, this is a new model architecture
- Not sure
validations:
required: true
- type: dropdown
id: quant
attributes:
label: Is the quantization already supported
description: FP8, NVFP4, MXFP4, and qualified GGUF variants are supported; name the exact format that fails.
options:
- Not quantized
- Yes, but this checkpoint's weight format does not load
- No, a new quantization
- GGUF, but this architecture or quantization does not load
- Not sure
validations:
required: true
- type: textarea
id: log
attributes:
label: What happens when you load it
description: The error or log from trying to load the checkpoint, as text. Leave empty if you have not tried.
render: text
- type: textarea
id: extra
attributes:
label: Anything else
description: Links to other engines that support it, or anything that may matter.
14 changes: 14 additions & 0 deletions .github/issue-labeler.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
windows:
- '### OS\s+Windows 1[01]'
WSL:
- '### OS\s+WSL2'
linux:
- '### OS\s+(Ubuntu|Debian|Fedora|Arch Linux|Other Linux)'
amd:
- '### GPU and driver\s+[^\n]*(AMD|Radeon|ROCm)'
Desktop:
- '### Applies to\s+(Desktop app|Both)'
gguf:
- '### Is the quantization already supported\s+GGUF'
quant:
- '### Is the quantization already supported\s+No,'
Loading
Loading