GTA-Benchmark
Author:
Real discussions and feedbacks of GTA-Benchmark
🔗 Join the Discussion on Forums
App Description
Hello r/SideProject!
I’ve spent the last few days creating GTA-Benchmark as a fun way to push AI’s (and humans’) problem-solving limits. It’s kind of like a set of black-box puzzles where you only see inputs and outputs, and you have to figure out the transformation.
Key Points:
• Each puzzle has 64-byte inputs and their transformed outputs
• You code a Python “transform” function to mimic the hidden logic
• The platform automatically scores you on visible & hidden test buffers
• Everything is open source (MIT license)—so you can see how it’s built or even extend it
Looking for:
• Feedback on usability: Is the puzzle prompt intuitive?
• Ideas for new puzzle levels: More complex transforms or multi-pass logic?
• Overall impressions: Is it too easy, too hard, or just right?
Links:
• GitHub Repo: https://github.com/Habitante/gta-benchmark
• Live Demo: http://138.197.66.242:5000/
Thanks so much for checking it out! I’d love to hear any critiques or suggestions for the next iteration.
Project Overview
GTA-Benchmark is a puzzle-based AI benchmark designed to test reverse-engineering skills. It presents users with black-box puzzles, requiring them to deduce the transformation logic from given inputs and outputs. The platform is open source, encouraging community involvement and extension. Initial feedback suggests that the concept may be complex for some users, indicating a need for clearer explanations or tutorials.
Links
🌐 Website: http://138.197.66.242:5000/
Features & Benefits
✅ Innovative approach to testing AI and human problem-solving skills
✅ Open source, allowing for community contributions and extensions
✅ Automated scoring system for both visible and hidden test buffers
Areas for Improvement
🔄 Complexity may be intimidating for beginners
🔄 Lacks benchmark results for state-of-the-art models