Skip to content

Feat/robust code validator#726

Open
devhemanthac-commits wants to merge 3 commits into
huggingface:mainfrom
devhemanthac-commits:feat/robust-code-validator
Open

Feat/robust code validator#726
devhemanthac-commits wants to merge 3 commits into
huggingface:mainfrom
devhemanthac-commits:feat/robust-code-validator

Conversation

@devhemanthac-commits

Copy link
Copy Markdown

No description provided.

- Create SharedTrainingConfig mixin containing common training options
- GRPOConfig and SFTConfig now inherit from SharedTrainingConfig
- Eliminates duplicate field definitions between the two config classes
- Improves maintainability and reduces risk of config drift

Resolves TODO at line 123 in configs.py
- Add CF_CACHE_SIZE environment variable to configure LRU cache size
- Default to 32 to maintain backward compatibility
- Users can now tune cache for different workloads: export CF_CACHE_SIZE=64
- Improves performance tuning flexibility for competitive programming evaluation

Resolves TODO at line 58 in cf_scoring.py
- Add compare_outputs() function for flexible output validation
- Support numeric comparison with configurable tolerance (default: 1e-6)
- Properly validate line counts instead of silently ignoring mismatches
- Fall back to string comparison for non-numeric outputs
- Handle empty lines and whitespace normalization correctly
- Improves reward signal accuracy for code evaluation

Resolves TODO at line 552 in rewards.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants