Function Calling Harness with Qwen, turning 6.75% to 100%…
0 reactions
Function Calling Harness with Qwen, turning 6.75% to 100%
I was personally invited by the Qwen team to speak at Qwen Meetup Korea, and got to present locally here in Korea yesterday — pretty honored to have been reached out to directly.
The talk was about how I got function calling to work reliably on deeply recursive union types — the stuff the industry generally says doesn't work. With `qwen3-coder-next`, first-try success rate was 6.75%. And the entire Qwen 3.5 model family was hitting 0% on union types due to a consistent double-stringify bug. Both ended up at 100%.
Slides are also available here: https://autobe.dev/seminars/20260326-qwen-meetup-korea.pptx — speaker notes are written inside as slide notes if you'd like the full narrative behind each slide.
## TL;DR
1. **AutoBe** — AI backend auto-generation agent. Not text code, but AST data via function calling. 4 AST types + 4-tier compiler validation + self-healing loops.
2. **Typia** — The infrastructure that turns 0% into 100%. A single type automates schema, parser, validator, and feedback generator. Lenient JSON parsing + type coercion + precise validation feedback.
3. **In Praise of Function Calling** — Types eliminate ambiguity. Schemas constrain through absence, not prohibition. Model-neutral, mechanically verifiable, deterministically convergent. Applicable to all engineering domains with validators.
4. **Qwen** — Small models are the best QA engineers. They expose system vulnerabilities large models silently paper over.
5. **6.75% is not failure — it's the first input to the loop.** If you can verify, you converge.
## Repositories
- https://github.com/wrtnlabs/autobe
- https://github.com/samchon/typia
#dev #programming #js #technology
I was personally invited by the Qwen team to speak at Qwen Meetup Korea, and got to present locally here in Korea yesterday — pretty honored to have been reached out to directly.
The talk was about how I got function calling to work reliably on deeply recursive union types — the stuff the industry generally says doesn't work. With `qwen3-coder-next`, first-try success rate was 6.75%. And the entire Qwen 3.5 model family was hitting 0% on union types due to a consistent double-stringify bug. Both ended up at 100%.
Slides are also available here: https://autobe.dev/seminars/20260326-qwen-meetup-korea.pptx — speaker notes are written inside as slide notes if you'd like the full narrative behind each slide.
## TL;DR
1. **AutoBe** — AI backend auto-generation agent. Not text code, but AST data via function calling. 4 AST types + 4-tier compiler validation + self-healing loops.
2. **Typia** — The infrastructure that turns 0% into 100%. A single type automates schema, parser, validator, and feedback generator. Lenient JSON parsing + type coercion + precise validation feedback.
3. **In Praise of Function Calling** — Types eliminate ambiguity. Schemas constrain through absence, not prohibition. Model-neutral, mechanically verifiable, deterministically convergent. Applicable to all engineering domains with validators.
4. **Qwen** — Small models are the best QA engineers. They expose system vulnerabilities large models silently paper over.
5. **6.75% is not failure — it's the first input to the loop.** If you can verify, you converge.
## Repositories
- https://github.com/wrtnlabs/autobe
- https://github.com/samchon/typia
#dev #programming #js #technology
| 0 mlx | |
| 0 | |
| 0 |