HEROS-RL
Critic-free GRPO for zero-downtime PostgreSQL migrations: deterministic format, SQL safety, and forge rewards; 500-case dataset.
itsoumya-d · applied AI systems
Ten systems spanning RL policy optimization, agent security, retrieval, kernel optimization, post-quantum transport, routing, and governance. Evidence links to source, green CI, and local benchmarks; claims that need unavailable GPUs or credentials are marked pending.
Critic-free GRPO for zero-downtime PostgreSQL migrations: deterministic format, SQL safety, and forge rewards; 500-case dataset.
Actor/evaluator/self-reflection loop with AST-tested code repair and training-free GRPO verbal priors.
Local-to-global hierarchical GraphRAG over code repositories, with community reports and a flat-RAG baseline.
Inline MCP security proxy for OWASP ASI01–ASI10, HMAC human approvals, and Merkle audit receipts.
Calibrated Bradley–Terry routing with semantic cache and OpenAI/Anthropic-compatible streaming.
NEON and WGSL transformer kernels across three optimization iterations with a memory roofline.
Browser-local ONNX inference, INT8 Matryoshka retrieval, and gamma=5 speculative decoding.
Post-quantum WebRTC transport: FIPS 203 ML-KEM-768 + P-256 hybrid handshake and encrypted data mesh.
Reference-driven compiler for five SaaS surfaces with accessibility-invariant source tests.
PLLB governance studio: human-approved natural-language policies and per-step Merkle receipts.