Helix Serializer
The Helix Serializer is the universal format translator of the RedQueen pipeline. It accepts any data format and normalizes it into the canonical RedQueen envelope format that all downstream agents expect. The Serializer uses a multi-pass detection algorithm: magic bytes, structural analysis, then content-based heuristics.
Capabilities
- JSON, Avro, CSV, Protobuf, Parquet, raw bytes
- Auto-format detection via magic bytes
- Nested structure flattening
- Mixed-type handling
- Malformed data recovery
- Preliminary schema inference
Configuration
helix-serializer.yaml
agent: helix-serializer
version: "1.0"
format_detection:
mode: auto
csv_delimiter: auto
encoding: utf-8
output:
canonical_format: redqueen-envelope-v1 Example
helix-serializer-example.ts
const result = await mcp.call('helix_serializer_normalize', {
payload: btoa(csvData),
hint_format: 'csv',
stream_uuid: streamUUID,
});
console.log(result.detected_format); // "csv"
console.log(result.row_count); // 50000 Pricing
$0.000005 USDC/row