Consider evaluating identifier naming in a future version of the benchmark

[0xdevalias]

The following idea / note came from discussion on j4k0xb/webcrack#189:

Afaik the evaluation metrics don't consider renamed identifiers so humanify would also have a pretty similar or the same score.

Originally posted by @j4k0xb in j4k0xb/webcrack#189 (comment)

I'm not sure of how to implement a metric for it, but it would be interesting if a future version of the benchmark was able to take into account variable / identifier naming; in a way that it could help evaluate the usefulness of tools that aim to restore meaningful variable names to de-minified / de-obfuscated code; such that it would allow for tools like humanify (which adds identifier renaming on top of webcrack's general deobfuscation) to be compared / ranked.

See Also

• Are there any similar benchmarks / leaderboards for JS unbundling / unminification? #3
• Include LLM evaluation costs in the leaderboard jsdeobf/jsdeobf.github.io#9
• Explore / benchmark humanify against "JsDeObsBench: Measuring and Benchmarking LLMs for JavaScript Deobfuscation" jehna/humanify#539
• Deobfuscating / Unminifying Obfuscated Web App / JavaScript Code (0xdevalias' gist)

[0xdevalias]

I also just put out a post on Twitter and crossposted on BlueSky to see if anyone else knew of existing ones:

• https://x.com/_devalias/status/1962319854691860586
• https://bsky.app/profile/devalias.net/post/3lxqfsztkrs2x

Also, interested if anyone knows of research or benchmarks for assessing/scoring the quality of variable/function/identifier names? Goal: to rank/benchmark restored names after reversing minified code.

Related: #2