PrivBench: A Holistic and Modular Benchmarking Platform for Evaluating Text-to-Text Privatization
PrivBench gives text-privatization systems a shared, modular evaluation setup with live public ranking.
The paper says current evaluations for text-to-text privatization use scattered metrics, making systems hard to compare. PrivBench organizes evaluation around defined desiderata grouped into modules, with room for later extensions and new benchmark versions. It is aimed at researchers and practitioners and is free, openly accessible, and tied to real-time evaluation through a leaderboard. ArXiv · AI/CL/LG's note
The paper says current evaluations for text-to-text privatization use scattered metrics, making systems hard to compare. PrivBench organizes evaluation around defined desiderata grouped into modules, with room for later extensions and new benchmark versions. It is aimed at researchers and practitioners and is free, openly accessible, and tied to real-time evaluation through a leaderboard. ArXiv · AI/CL/LG's note
score 4