FRAUDSkill: Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection

Chengxian Hu, Zhiming Ma, Mingjun Pan, Yifan Wang, Shun Zhang, Qifan Wang, Zhilei Zhao, Yijin Zhou and 4 others

People's Public Security University of China · JD Technology · MetaAI · University of Science and Technology of China · Northeastern University · Peking University, Shenzhen

Published September 16, 2026 · on the feed September 21, 2026 · ▲ 6 · arXiv 2609.18766

Speech & audioSafety, alignment & security No code arXiv ↗Hugging Face ↗

The abstract

Large audio-language models have shown promise for anti-fraud detection by directly processing speech and reasoning over fraud-related evidence. Their deployment, however, requires predictions to follow a predefined label space and a structured decision protocol consisting of service-scenario identification, fraud detection, and conditional fraud-type classification. Existing fine-tuning and prompt-based approaches typically encode task knowledge, constraints, and decision rules into model parameters or manually maintained prompts, making them difficult to adapt as fraud patterns and labeling policies evolve. To this end, we propose FRAUDSkill, a structured frozen-weight adaptation framework that leaves the underlying audio-language model unchanged while optimizing an external layer of skill programs, route-specific policies, and decision rules. We further combine structured output control with validation-guided multi-path inference to ensure protocol-compliant predictions. On the TeleAntiFraud benchmark, FRAUDSkill achieves 73.50% Macro-F1, outperforming the shared frozen-model baseline by 31.96% while reducing invalid outputs to 1.94%. Extensive experiments demonstrate that external skill optimization provides an effective and adaptable solution for structured audio anti-fraud detection without modifying the underlying model. The source code is available at https://anonymous.4open.science/r/FRAUDSKILL-114514.

The Brief

2:25

A short podcast summary of the paper. Written and voiced by AI.

Transcript

FRAUDSkill. Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection. By Chengxian Hu and eleven others, from the People's Public Security University of China, J D Technology, and four other institutions. Published on the sixteenth of September. No code repository is linked to it.

Large audio-language models show promise for anti-fraud detection, processing speech directly and reasoning over evidence of fraud. Deploying them brings requirements of its own. Predictions have to stay inside a predefined label space and follow a structured decision protocol: identify the service scenario, detect fraud, and, only when fraud is found, classify its type. Existing fine-tuning and prompt-based approaches tend to encode task knowledge, constraints, and decision rules into model parameters or into prompts maintained by hand. Either way, they are hard to adapt as fraud patterns and labeling policies change.

FRAUDSkill keeps the audio-language model frozen and unchanged. What gets optimized instead is an external layer: skill programs, policies specific to each route, and decision rules. Task knowledge moves out of the weights and into something that can be revised. When fraud patterns or labeling policies change, it is that external layer that gets updated, not the model beneath it. The authors call this structured frozen-weight adaptation: adaptation happens, but the weights stay fixed.

Two further pieces keep outputs inside the protocol. Structured output control governs the form of what the model returns, and it is combined with multi-path inference guided by validation. Together they are there to ensure that predictions comply with the protocol, meaning that each prediction falls in the predefined label space and follows the three-step order of scenario, fraud, and fraud type. An answer outside the label space counts as an invalid output, which is why the rate of invalid outputs is reported next to accuracy.

On the TeleAntiFraud benchmark, FRAUDSkill reaches seventy-three point five percent macro-F1. That outperforms the shared frozen-model baseline by thirty- one point nine six percent, while invalid outputs fall to one point nine four percent. Extensive experiments support external skill optimization as an effective and adaptable approach to structured audio anti-fraud detection.

The model is left exactly as it was. Everything that encodes the task, and everything likely to change as fraud evolves, lives outside it, where it can be optimized and replaced without touching the weights.

Paper Quest · 7 chapters · about 40 min

Play this paper

Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.

Chapter 1 🧩 · The problem

Fraud changes faster than models can be retrained. That is the wall here.

You deploy an audio-language model to catch phone fraud. It must name the service scenario, decide whether the call is fraud, and only then name the fraud type.

The road ahead

  1. 1 · The problem ~7 min A phone-fraud detector must give answers from a fixed label list, in a fixed order, while fraud and labeling rules keep changing.
  2. 2 · What came before ~3 min
  3. 3 · The key idea ~8 min Freeze the audio-language model and put the task knowledge in an editable outside layer, then force its answers onto official labels and combine several programs.
  4. 4 · Choose your own research ~3 min
  5. 5 · Build the method ~8 min Freeze the model, optimize the outside layer offline, then run each call through scenario, fraud, and fraud type in that order.
  6. 6 · The experiment ~6 min You’ll guess: On the TeleAntiFraud benchmark, what share of FRAUDSkill's outputs were invalid: missing, outside the label space, or breaking the routing order?
  7. 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Join free to play the whole quest ›

Free, with Google or an email address. Your stars and progress are kept.

KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.