461 lines
9.7 KiB
Markdown
461 lines
9.7 KiB
Markdown
# SONA Integration Guide
|
|
|
|
Integration of `@ruvector/sona` package (v0.1.5) into the V3 Neural Module.
|
|
|
|
## Overview
|
|
|
|
The SONA (Self-Optimizing Neural Architecture) integration provides runtime-adaptive learning capabilities with sub-millisecond performance:
|
|
|
|
- **Learning Performance**: <0.05ms per trajectory (target)
|
|
- **Adaptation Performance**: <0.1ms per context
|
|
- **Memory Efficient**: LoRA-based (1-16 rank)
|
|
- **Platform Support**: WASM + Node.js (NAPI bindings)
|
|
|
|
## Installation
|
|
|
|
The package is already installed as a dependency:
|
|
|
|
```bash
|
|
npm install @ruvector/sona@0.1.5
|
|
```
|
|
|
|
## Quick Start
|
|
|
|
```typescript
|
|
import {
|
|
createSONALearningEngine,
|
|
type Trajectory,
|
|
type Context,
|
|
} from '@claude-flow/neural';
|
|
import { getModeConfig } from '@claude-flow/neural';
|
|
|
|
// Create SONA engine with balanced mode
|
|
const modeConfig = getModeConfig('balanced');
|
|
const sona = createSONALearningEngine('balanced', modeConfig);
|
|
|
|
// Learn from a trajectory
|
|
const trajectory: Trajectory = {
|
|
trajectoryId: 'traj-001',
|
|
context: 'Implement authentication',
|
|
domain: 'code',
|
|
steps: [
|
|
{
|
|
stepId: 'step-1',
|
|
timestamp: Date.now(),
|
|
action: 'analyze requirements',
|
|
stateBefore: new Float32Array(768).fill(0.1),
|
|
stateAfter: new Float32Array(768).fill(0.2),
|
|
reward: 0.8,
|
|
},
|
|
// ... more steps
|
|
],
|
|
qualityScore: 0.88,
|
|
isComplete: true,
|
|
startTime: Date.now(),
|
|
};
|
|
|
|
await sona.learn(trajectory);
|
|
console.log(`Learning time: ${sona.getLearningTime()}ms`);
|
|
|
|
// Adapt to new context
|
|
const context: Context = {
|
|
domain: 'code',
|
|
queryEmbedding: new Float32Array(768).fill(0.15),
|
|
};
|
|
|
|
const adapted = await sona.adapt(context);
|
|
console.log(`Confidence: ${adapted.confidence}`);
|
|
console.log(`Suggested route: ${adapted.suggestedRoute}`);
|
|
```
|
|
|
|
## API Reference
|
|
|
|
### `SONALearningEngine`
|
|
|
|
Main class for SONA learning operations.
|
|
|
|
#### Constructor
|
|
|
|
```typescript
|
|
new SONALearningEngine(mode: SONAMode, modeConfig: SONAModeConfig)
|
|
```
|
|
|
|
- `mode`: Learning mode ('real-time' | 'balanced' | 'research' | 'edge' | 'batch')
|
|
- `modeConfig`: Configuration for the mode (from `getModeConfig()`)
|
|
|
|
#### Methods
|
|
|
|
##### `learn(trajectory: Trajectory): Promise<void>`
|
|
|
|
Learn from a completed trajectory.
|
|
|
|
**Performance target**: <0.05ms
|
|
|
|
```typescript
|
|
await sona.learn(trajectory);
|
|
```
|
|
|
|
##### `adapt(context: Context): Promise<AdaptedBehavior>`
|
|
|
|
Adapt behavior based on current context.
|
|
|
|
**Performance target**: <0.1ms
|
|
|
|
```typescript
|
|
const adapted = await sona.adapt({
|
|
domain: 'code',
|
|
queryEmbedding: embedding,
|
|
});
|
|
```
|
|
|
|
Returns:
|
|
- `transformedQuery`: Query after micro-LoRA transformation
|
|
- `patterns`: Similar learned patterns
|
|
- `suggestedRoute`: Recommended model/route
|
|
- `confidence`: Confidence score (0-1)
|
|
|
|
##### `getAdaptationTime(): number`
|
|
|
|
Get the last adaptation time in milliseconds.
|
|
|
|
```typescript
|
|
const timeMs = sona.getAdaptationTime();
|
|
```
|
|
|
|
##### `getLearningTime(): number`
|
|
|
|
Get the last learning time in milliseconds.
|
|
|
|
```typescript
|
|
const timeMs = sona.getLearningTime();
|
|
```
|
|
|
|
##### `resetLearning(): void`
|
|
|
|
Reset all learning state and create a fresh engine.
|
|
|
|
```typescript
|
|
sona.resetLearning();
|
|
```
|
|
|
|
##### `forceLearning(): string`
|
|
|
|
Force an immediate background learning cycle.
|
|
|
|
```typescript
|
|
const status = sona.forceLearning();
|
|
console.log(status);
|
|
```
|
|
|
|
##### `tick(): string | null`
|
|
|
|
Tick background learning (call periodically).
|
|
|
|
```typescript
|
|
const status = sona.tick();
|
|
if (status) console.log(status);
|
|
```
|
|
|
|
##### `getStats(): SONAStats`
|
|
|
|
Get engine statistics.
|
|
|
|
```typescript
|
|
const stats = sona.getStats();
|
|
console.log(`Trajectories: ${stats.totalTrajectories}`);
|
|
console.log(`Patterns: ${stats.patternsLearned}`);
|
|
console.log(`Avg Quality: ${stats.avgQuality}`);
|
|
```
|
|
|
|
##### `setEnabled(enabled: boolean): void`
|
|
|
|
Enable or disable the engine.
|
|
|
|
```typescript
|
|
sona.setEnabled(false); // Disable learning
|
|
```
|
|
|
|
##### `isEnabled(): boolean`
|
|
|
|
Check if engine is enabled.
|
|
|
|
```typescript
|
|
if (sona.isEnabled()) {
|
|
// Learning is active
|
|
}
|
|
```
|
|
|
|
##### `findPatterns(queryEmbedding: Float32Array, k: number): JsLearnedPattern[]`
|
|
|
|
Find k similar learned patterns.
|
|
|
|
```typescript
|
|
const patterns = sona.findPatterns(embedding, 5);
|
|
patterns.forEach(p => {
|
|
console.log(`Quality: ${p.avgQuality}, Cluster: ${p.clusterSize}`);
|
|
});
|
|
```
|
|
|
|
## Learning Modes
|
|
|
|
### Real-Time Mode
|
|
|
|
Optimized for minimum latency:
|
|
- **LoRA Rank**: 1 (micro-LoRA only)
|
|
- **Max Latency**: 0.05ms
|
|
- **Background Interval**: 1 minute
|
|
- **Use Case**: Interactive applications, chatbots
|
|
|
|
```typescript
|
|
const sona = createSONALearningEngine('real-time', getModeConfig('real-time'));
|
|
```
|
|
|
|
### Balanced Mode (Default)
|
|
|
|
Balanced performance and quality:
|
|
- **LoRA Rank**: 4
|
|
- **Max Latency**: 1ms
|
|
- **Background Interval**: 30 minutes
|
|
- **Use Case**: General purpose, CLI tools
|
|
|
|
```typescript
|
|
const sona = createSONALearningEngine('balanced', getModeConfig('balanced'));
|
|
```
|
|
|
|
### Research Mode
|
|
|
|
Maximum quality, slower:
|
|
- **LoRA Rank**: 16
|
|
- **Max Latency**: 10ms
|
|
- **Background Interval**: 1 hour
|
|
- **Use Case**: Research, analysis, high-quality generation
|
|
|
|
```typescript
|
|
const sona = createSONALearningEngine('research', getModeConfig('research'));
|
|
```
|
|
|
|
### Edge Mode
|
|
|
|
Optimized for resource-constrained devices:
|
|
- **LoRA Rank**: 1
|
|
- **Hidden Dim**: 384 (vs 768)
|
|
- **Memory Budget**: 50MB
|
|
- **Use Case**: Mobile, embedded systems
|
|
|
|
```typescript
|
|
const sona = createSONALearningEngine('edge', getModeConfig('edge'));
|
|
```
|
|
|
|
### Batch Mode
|
|
|
|
Optimized for batch processing:
|
|
- **LoRA Rank**: 8
|
|
- **Background Interval**: 2 hours
|
|
- **Batch Size**: 128
|
|
- **Use Case**: Offline training, batch jobs
|
|
|
|
```typescript
|
|
const sona = createSONALearningEngine('batch', getModeConfig('batch'));
|
|
```
|
|
|
|
## Types
|
|
|
|
### `Context`
|
|
|
|
```typescript
|
|
interface Context {
|
|
domain: 'code' | 'creative' | 'reasoning' | 'chat' | 'math' | 'general';
|
|
queryEmbedding: Float32Array;
|
|
metadata?: Record<string, unknown>;
|
|
}
|
|
```
|
|
|
|
### `AdaptedBehavior`
|
|
|
|
```typescript
|
|
interface AdaptedBehavior {
|
|
transformedQuery: Float32Array;
|
|
patterns: JsLearnedPattern[];
|
|
suggestedRoute?: string;
|
|
confidence: number;
|
|
}
|
|
```
|
|
|
|
### `SONAStats`
|
|
|
|
```typescript
|
|
interface SONAStats {
|
|
totalTrajectories: number;
|
|
patternsLearned: number;
|
|
avgQuality: number;
|
|
lastLearningMs: number;
|
|
enabled: boolean;
|
|
}
|
|
```
|
|
|
|
### `JsLearnedPattern`
|
|
|
|
```typescript
|
|
interface JsLearnedPattern {
|
|
id: string;
|
|
centroid: number[];
|
|
clusterSize: number;
|
|
totalWeight: number;
|
|
avgQuality: number;
|
|
createdAt: string;
|
|
lastAccessed: string;
|
|
accessCount: number;
|
|
patternType: string;
|
|
}
|
|
```
|
|
|
|
## Performance Characteristics
|
|
|
|
### Learning Performance
|
|
|
|
| Mode | Avg Time | Target | Memory |
|
|
|------------|----------|---------|---------|
|
|
| Real-time | ~0.03ms | <0.05ms | 100MB |
|
|
| Balanced | ~0.04ms | <0.05ms | 200MB |
|
|
| Research | ~0.08ms | <0.10ms | 500MB |
|
|
| Edge | ~0.02ms | <0.05ms | 50MB |
|
|
| Batch | ~0.05ms | <0.10ms | 1GB |
|
|
|
|
### Adaptation Performance
|
|
|
|
| Operation | Time |
|
|
|---------------------|----------|
|
|
| Micro-LoRA Apply | ~0.01ms |
|
|
| Pattern Search (k=5)| ~0.05ms |
|
|
| Total Adaptation | ~0.06ms |
|
|
|
|
## Examples
|
|
|
|
See `/examples/sona-usage.ts` for comprehensive examples:
|
|
|
|
1. **Basic Learning**: Learn from trajectories
|
|
2. **Context Adaptation**: Adapt behavior to new contexts
|
|
3. **Pattern Discovery**: Discover and cluster patterns
|
|
4. **Performance Monitoring**: Benchmark learning performance
|
|
|
|
Run examples:
|
|
|
|
```bash
|
|
cd v3/@claude-flow/neural
|
|
npx tsx examples/sona-usage.ts
|
|
```
|
|
|
|
## Integration with V3 Neural Module
|
|
|
|
The SONA integration works seamlessly with other V3 neural components:
|
|
|
|
```typescript
|
|
import { createNeuralLearningSystem } from '@claude-flow/neural';
|
|
|
|
const system = createNeuralLearningSystem('balanced');
|
|
await system.initialize();
|
|
|
|
// SONA is used internally by the neural system
|
|
const taskId = system.beginTask('Implement feature X', 'code');
|
|
|
|
// Record steps...
|
|
system.recordStep(
|
|
taskId,
|
|
'analyze requirements',
|
|
0.8,
|
|
queryEmbedding
|
|
);
|
|
|
|
// Complete and trigger SONA learning
|
|
await system.completeTask(taskId, 0.9);
|
|
```
|
|
|
|
## Platform Support
|
|
|
|
SONA uses native bindings for optimal performance:
|
|
|
|
- **Linux**: x64, ARM64 (GNU, MUSL)
|
|
- **macOS**: x64, ARM64 (Universal binary)
|
|
- **Windows**: x64, ARM64 (MSVC)
|
|
|
|
Runtime selection is automatic based on platform.
|
|
|
|
## Advanced Usage
|
|
|
|
### Custom Configuration
|
|
|
|
```typescript
|
|
import { SonaEngine, type JsSonaConfig } from '@ruvector/sona';
|
|
|
|
const customConfig: JsSonaConfig = {
|
|
hiddenDim: 512,
|
|
embeddingDim: 512,
|
|
microLoraRank: 2,
|
|
baseLoraRank: 8,
|
|
microLoraLr: 0.002,
|
|
baseLoraLr: 0.0002,
|
|
ewcLambda: 1000.0,
|
|
patternClusters: 100,
|
|
trajectoryCapacity: 20000,
|
|
backgroundIntervalMs: 1800000,
|
|
qualityThreshold: 0.6,
|
|
enableSimd: true,
|
|
};
|
|
|
|
const engine = SonaEngine.withConfig(customConfig);
|
|
```
|
|
|
|
### Background Learning
|
|
|
|
SONA automatically runs background learning cycles:
|
|
|
|
```typescript
|
|
// Tick periodically (e.g., every second)
|
|
setInterval(() => {
|
|
const status = sona.tick();
|
|
if (status) {
|
|
console.log('Background learning:', status);
|
|
}
|
|
}, 1000);
|
|
```
|
|
|
|
Or force immediate learning:
|
|
|
|
```typescript
|
|
const status = sona.forceLearning();
|
|
console.log(status);
|
|
```
|
|
|
|
## Troubleshooting
|
|
|
|
### Learning is too slow
|
|
|
|
- Use `'real-time'` or `'edge'` mode
|
|
- Reduce `baseLoraRank` in config
|
|
- Enable SIMD optimizations (`enableSimd: true`)
|
|
|
|
### Memory usage too high
|
|
|
|
- Use `'edge'` mode
|
|
- Reduce `trajectoryCapacity`
|
|
- Reduce `patternClusters`
|
|
- Lower `hiddenDim` and `embeddingDim`
|
|
|
|
### Patterns not forming
|
|
|
|
- Increase `trajectoryCapacity`
|
|
- Lower `qualityThreshold`
|
|
- Increase `backgroundIntervalMs`
|
|
- Call `forceLearning()` manually
|
|
|
|
## References
|
|
|
|
- [SONA Package](https://www.npmjs.com/package/@ruvector/sona)
|
|
- [LoRA Paper](https://arxiv.org/abs/2106.09685)
|
|
- [EWC Paper](https://arxiv.org/abs/1612.00796)
|
|
- [V3 Neural Module](../README.md)
|
|
|
|
## License
|
|
|
|
SONA integration follows the same license as the V3 neural module.
|