Agent Squad Chat Storage Benchmark Report

Corrected local agent_squad_workload.py runs · Aerospike Agent Squad adapter vs DynamoDB Local · 2026-09-18
216,000scheduled calls
216,000successful calls
100 + 500 QPSoffered per function
0operational failures
Every scheduled call completed successfully on both backends. The benchmark runner now clamps early-completion response samples to zero rather than dropping them. Aerospike kept response p99 below 5.6 ms at 100 QPS and below 4.4 ms at 500 QPS across all scenarios.

Method and environment

Both runs used identical dimensions: 256-byte payloads, 10-message retained histories, four agents per session, a 1,024-key read pool, 256 maximum in-flight operations, one-second warmup, 30 seconds per function, and deterministic seed 20260915. Each backend/function pair received 3,000 calls at 100 QPS and 15,000 calls at 500 QPS. Response latency includes scheduler queueing; service latency measures execution only.

BackendDeploymentAdapter path100 QPS500 QPSFailures
AerospikeLocal Docker, Community Edition 8.1.2.5Atomic server-side append and trim18,000 / 18,00090,000 / 90,0000
DynamoDBLocal Docker, DynamoDB Local 2.6.1Whole-conversation read-modify-write18,000 / 18,00090,000 / 90,0000
Scope: This is a local, non-publishable integration comparison. DynamoDB Local does not reproduce managed networking, partitioning, durability, adaptive capacity, throttling, consumed capacity, or service-side latency. These results characterize local adapter behavior on this host, not production database capacity.

100 QPS

Service latency (ms)

ScenarioBackendp50p90p95p99p99.9Calls
Append oneAerospike2.6213.0473.2113.6044.1293,000
Append oneDynamoDB3.5064.0634.2604.7195.9643,000
Append pairAerospike2.6213.1133.2773.6704.6533,000
Append pairDynamoDB3.6704.1944.3914.7845.9643,000
ContendedAerospike1.6712.1952.3922.8513.4413,000
ContendedDynamoDB4.2604.9155.0465.5717.0123,000
FetchAerospike1.0811.3931.4911.6382.0153,000
FetchDynamoDB2.3922.9493.0803.4414.0303,000
Fetch allAerospike2.0322.4902.5892.8183.3753,000
Fetch allDynamoDB3.4084.0634.1944.5886.2913,000
MixedAerospike2.1303.3103.6044.2604.7843,000
MixedDynamoDB2.8514.2604.4565.0466.2263,000

Response latency (ms)

ScenarioBackendp50p90p95p99p99.9Calls
Append oneAerospike3.3754.0964.3254.8506.0293,000
Append oneDynamoDB7.6688.9139.1759.96111.0103,000
Append pairAerospike3.3754.1624.3914.9156.6853,000
Append pairDynamoDB7.9309.0449.43710.22414.8113,000
ContendedAerospike2.4903.6703.8994.4565.3083,000
ContendedDynamoDB9.04410.35510.61711.53412.5833,000
FetchAerospike2.0972.9163.1133.4084.1293,000
FetchDynamoDB5.4396.7507.0787.7338.5203,000
Fetch allAerospike2.9163.9324.2604.8505.3083,000
Fetch allDynamoDB7.3408.6519.0449.83011.2723,000
MixedAerospike2.8184.4564.7845.5716.1603,000
MixedDynamoDB6.7508.9139.43710.35511.5343,000

500 QPS

Service latency (ms)

ScenarioBackendp50p90p95p99p99.9Calls
Append oneAerospike1.6381.9992.1302.8188.25815,000
Append oneDynamoDB1.7042.7202.8843.2444.32515,000
Append pairAerospike1.7202.0812.1952.9829.83015,000
Append pairDynamoDB1.7202.7852.9823.3754.26015,000
ContendedAerospike1.0651.3931.5071.9175.04615,000
ContendedDynamoDB2.1953.5063.7684.2605.50515,000
FetchAerospike0.6060.7700.8361.0401.63815,000
FetchDynamoDB1.4091.7531.9012.2282.91615,000
Fetch allAerospike1.1801.6551.8192.22831.19515,000
Fetch allDynamoDB1.7202.6212.8513.2115.17715,000
MixedAerospike1.5732.2612.4252.9164.26015,000
MixedDynamoDB1.6712.7532.9493.2774.19415,000

Response latency (ms)

ScenarioBackendp50p90p95p99p99.9Calls
Append oneAerospike1.7372.3922.5893.34220.18515,000
Append oneDynamoDB67.109169.869188.744211.812224.39515,000
Append pairAerospike1.9822.9493.1783.89924.37915,000
Append pairDynamoDB85.983205.521232.784285.213301.99015,000
ContendedAerospike1.3112.1302.4253.14620.44715,000
ContendedDynamoDB3,355.4436,106.9076,308.2336,710.8866,710.88615,000
FetchAerospike0.9671.5241.6882.3923.01515,000
FetchDynamoDB4.7198.1269.17513.36924.90415,000
Fetch allAerospike1.4752.6873.1783.86731.71915,000
Fetch allDynamoDB84.935171.966197.132228.590247.46415,000
MixedAerospike1.7372.9823.4414.32513.36915,000
MixedDynamoDB24.37992.275108.003126.878146.80115,000

Interpretation

Sources: benchmarks/agent_squad_workload_2026-09-18_100qps.json and benchmarks/agent_squad_workload_2026-09-18_500qps.json. Agent Squad 1.1.3, agent-squad-aerospike 0.0.1, ai-ecosystem-benchmark 0.0.6. Values are milliseconds reported by the corrected benchmark runner.