31031804ba
2 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
| 360f39325b |
feat: Add Memory Leak Hunter test & fix critical ModuleLoader leaks
**Test Suite Completion - Scenario 5** Add comprehensive memory leak detection test for hot-reload system with 200 reload cycles. **New Test: test_05_memory_leak** - 200 hot-reload cycles without recompilation - Memory monitoring every 5 seconds (RSS, temp files, .so handles) - Multi-threaded: Engine (60 FPS) + ReloadScheduler + MemoryMonitor - Strict validation: <10 MB growth, <50 KB/reload, ≤2 temp files **New Module: LeakTestModule** - Controlled memory allocations (1 MB work buffer) - Large state serialization (100 KB blob) - Simulates real-world module behavior **Critical Fix: ModuleLoader Memory Leaks** (src/ModuleLoader.cpp:34-39) - Auto-unload previous library before loading new one - Prevents library handle leaks (+200 .so mappings eliminated) - Prevents temp file accumulation (778 files → 1-2 files) - Memory leak reduced by 97%: 36.5 MB → 1.9 MB **Test Results - Before Fix:** - Memory growth: 36.5 MB ❌ - Per reload: 187.1 KB ❌ - Temp files: 778 ❌ - Mapped .so: +200 ❌ **Test Results - After Fix:** - Memory growth: 1.9 MB ✅ - Per reload: 9.7 KB ✅ - Temp files: 1-2 ✅ - Mapped .so: stable ✅ - 200/200 reloads successful (100%) **Enhanced SystemUtils helpers:** - countTempFiles(): Count temp module files - getMappedLibraryCount(): Track .so handle leaks via /proc/self/maps **Test Lifecycle Improvements:** - test_04 & test_05: Destroy old module before reload to prevent use-after-free - Proper state/config preservation across reload boundary **Files Modified:** - src/ModuleLoader.cpp: Auto-unload on load() - tests/integration/test_05_memory_leak.cpp: NEW - 200 cycle leak detector - tests/modules/LeakTestModule.cpp: NEW - Test module with allocations - tests/helpers/SystemUtils.{h,cpp}: Memory monitoring functions - tests/integration/test_04_race_condition.cpp: Fixed module lifecycle - tests/CMakeLists.txt: Added test_05 and LeakTestModule 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> |
|||
| d8c5f93429 |
feat: Add comprehensive hot-reload test suite with 3 integration scenarios
This commit implements a complete test infrastructure for validating hot-reload stability and robustness across multiple scenarios. ## New Test Infrastructure ### Test Helpers (tests/helpers/) - TestMetrics: FPS, memory, reload time tracking with statistics - TestReporter: Assertion tracking and formatted test reports - SystemUtils: Memory usage monitoring via /proc/self/status - TestAssertions: Macro-based assertion framework ### Test Modules - TankModule: Realistic module with 50 tanks for production testing - ChaosModule: Crash-injection module for robustness validation - StressModule: Lightweight module for long-duration stability tests ## Integration Test Scenarios ### Scenario 1: Production Hot-Reload (test_01_production_hotreload.cpp) ✅ PASSED - End-to-end hot-reload validation - 30 seconds simulation (1800 frames @ 60 FPS) - TankModule with 50 tanks, realistic state - Source modification (v1.0 → v2.0), recompilation, reload - State preservation: positions, velocities, frameCount - Metrics: ~163ms reload time, 0.88MB memory growth ### Scenario 2: Chaos Monkey (test_02_chaos_monkey.cpp) ✅ PASSED - Extreme robustness testing - 150+ random crashes per run (5% crash probability per frame) - 5 crash types: runtime_error, logic_error, out_of_range, domain_error, state corruption - 100% recovery rate via automatic hot-reload - Corrupted state detection and rejection - Random seed for unpredictable crash patterns - Proof of real reload: temporary files in /tmp/grove_module_*.so ### Scenario 3: Stress Test (test_03_stress_test.cpp) ✅ PASSED - Long-duration stability validation - 10 minutes simulation (36000 frames @ 60 FPS) - 120 hot-reloads (every 5 seconds) - 100% reload success rate (120/120) - Memory growth: 2 MB (threshold: 50 MB) - Avg reload time: 160ms (threshold: 500ms) - No memory leaks, no file descriptor leaks ## Core Engine Enhancements ### ModuleLoader (src/ModuleLoader.cpp) - Temporary file copy to /tmp/ for Linux dlopen cache bypass - Robust reload() method: getState() → unload() → load() → setState() - Automatic cleanup of temporary files - Comprehensive error handling and logging ### DebugEngine (src/DebugEngine.cpp) - Automatic recovery in processModuleSystems() - Exception catching → logging → module reload → continue - Module state dump utilities for debugging ### SequentialModuleSystem (src/SequentialModuleSystem.cpp) - extractModule() for safe module extraction - registerModule() for module re-registration - Enhanced processModules() with error handling ## Build System - CMake configuration for test infrastructure - Shared library compilation for test modules (.so) - CTest integration for all scenarios - PIC flag management for spdlog compatibility ## Documentation (planTI/) - Complete test architecture documentation - Detailed scenario specifications with success criteria - Global test plan and validation thresholds ## Validation Results All 3 integration scenarios pass successfully: - Production hot-reload: State preservation validated - Chaos Monkey: 100% recovery from 150+ crashes - Stress Test: Stable over 120 reloads, minimal memory growth 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> |