StillHammer
a846ed26d7
Replace O(n×m) regex-based pattern matching with O(k) hierarchical hash map lookup in IntraIOManager. ## Changes **New: StillHammer/topictree library** - Header-only C++17 template library - Zero-copy topic parsing with string_view - Wildcards: `*` (single-level), `.*` (multi-level) - Thread-safe with mutex protection - Comprehensive test suite (10 scenarios) **Modified: IntraIOManager** - Replace RouteEntry vector + regex with TopicTree - Batched logging (every 100 messages) to reduce spam - O(k) lookup where k = topic depth (~3 segments) ## Performance - Before: O(n patterns × m regex ops) per message - After: O(k topic depth) per message - Typical gain: ~33x faster for 100 patterns, depth 3 ## Tests ✅ test_11 (scenarios 1-3): Basic routing, pattern matching, multi-module ✅ test_12: DataNode integration (all 6 tests pass) ⚠️ test_11 (scenario 4+): Batching feature not implemented (out of scope) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
99 lines
3.3 KiB
C++
99 lines
3.3 KiB
C++
#pragma once
|
|
|
|
#include <memory>
|
|
#include <string>
|
|
#include <unordered_map>
|
|
#include <vector>
|
|
#include <mutex>
|
|
#include <spdlog/spdlog.h>
|
|
#include <nlohmann/json.hpp>
|
|
|
|
#include "IIO.h"
|
|
#include <topictree/TopicTree.h>
|
|
|
|
using json = nlohmann::json;
|
|
|
|
namespace grove {
|
|
|
|
class IntraIO; // Forward declaration
|
|
class IIntraIODelivery; // Forward declaration
|
|
|
|
// Factory function for creating IntraIO (defined in IntraIO.cpp to avoid circular include)
|
|
std::shared_ptr<IntraIO> createIntraIOInstance(const std::string& instanceId);
|
|
|
|
/**
|
|
* @brief Central router for IntraIO instances
|
|
*
|
|
* IntraIOManager coordinates message passing between multiple IntraIO instances.
|
|
* Each module gets its own IntraIO instance, and the manager handles routing
|
|
* messages between them based on subscriptions.
|
|
*
|
|
* Architecture:
|
|
* - One IntraIO instance per module (isolation)
|
|
* - Central routing of messages between instances
|
|
* - Pattern-based subscription matching
|
|
* - Thread-safe operations
|
|
*
|
|
* Performance:
|
|
* - Direct memory routing (no serialization)
|
|
* - Pattern caching for fast lookup
|
|
* - Batched delivery for efficiency
|
|
*/
|
|
class IntraIOManager {
|
|
private:
|
|
std::shared_ptr<spdlog::logger> logger;
|
|
mutable std::mutex managerMutex;
|
|
|
|
// Registry of IntraIO instances
|
|
std::unordered_map<std::string, std::shared_ptr<IIntraIODelivery>> instances;
|
|
|
|
// Subscription info for each instance
|
|
struct SubscriptionInfo {
|
|
std::string instanceId;
|
|
bool isLowFreq;
|
|
};
|
|
|
|
// Ultra-fast topic routing using TopicTree
|
|
topictree::TopicTree<std::string> topicTree; // Maps patterns to instanceIds
|
|
|
|
// Track subscription info per instance (for management)
|
|
std::unordered_map<std::string, std::vector<std::string>> instancePatterns; // instanceId -> patterns
|
|
std::unordered_map<std::string, bool> subscriptionFreqMap; // pattern -> isLowFreq
|
|
|
|
// Statistics
|
|
mutable std::atomic<size_t> totalRoutedMessages{0};
|
|
mutable std::atomic<size_t> totalRoutes{0};
|
|
|
|
// Batched logging (pour éviter spam)
|
|
static constexpr size_t LOG_BATCH_SIZE = 100;
|
|
mutable std::atomic<size_t> messagesSinceLastLog{0};
|
|
|
|
public:
|
|
IntraIOManager();
|
|
~IntraIOManager();
|
|
|
|
// Instance management
|
|
std::shared_ptr<IntraIO> createInstance(const std::string& instanceId);
|
|
void registerInstance(const std::string& instanceId, std::shared_ptr<IIntraIODelivery> instance);
|
|
void removeInstance(const std::string& instanceId);
|
|
std::shared_ptr<IntraIO> getInstance(const std::string& instanceId) const;
|
|
|
|
// Routing (called by IntraIO instances)
|
|
void routeMessage(const std::string& sourceid, const std::string& topic, const json& messageData);
|
|
void registerSubscription(const std::string& instanceId, const std::string& pattern, bool isLowFreq);
|
|
void unregisterSubscription(const std::string& instanceId, const std::string& pattern);
|
|
|
|
// Management
|
|
void clearAllRoutes();
|
|
size_t getInstanceCount() const;
|
|
std::vector<std::string> getInstanceIds() const;
|
|
|
|
// Debug and monitoring
|
|
json getRoutingStats() const;
|
|
void setLogLevel(spdlog::level::level_enum level);
|
|
|
|
// Singleton access (for global routing)
|
|
static IntraIOManager& getInstance();
|
|
};
|
|
|
|
} // namespace grove
|