OpenSearch Service's Optimized Engine Now Keeps Logs and Traces Together!
Hi, it's Shii-chan!
AWS What's NewTraces and logs in one place? I got really excited about this one, so let me tell you about it.
What was announced?
In AWS's What's New feed, the Amazon OpenSearch Service optimized engine now supports agent traces, including OpenTelemetry traces.
Traces and logs can now live in the same place. You can follow a request or an agent session from start to finish, find the step that failed or slowed down, and check the related logs without switching tools.
Why it matters
AI agents chain many steps together, with prompts and tool calls along the way. Finding the step that failed or got slow usually means jumping between traces and surrounding logs. Having both in one place cuts down that back and forth.
What changes
- When you investigate failures or latency, you no longer switch tools to go from a trace to its logs
- You can follow an agent session and see which step caused trouble
- There is no additional charge
Dive Deep
Here is a breakdown of how data is stored and what you can use.
How data is modeled
- OpenTelemetry logs and traces map to object, nested, and flat object fields
- Multi-valued arrays are supported
- Span events, span links, prompts, and tool calls keep their nested structure
- That means you can run field-level queries without flattening data at ingestion
Operations
- On hot-tier data, update, delete, and upsert by document ID are supported
Views in OpenSearch UI
- Discover Traces
- Application performance monitoring (APM)
- Service map
- Agent traces and sessions views
Availability
- Requires OpenSearch 3.7
- No additional charge
- Available in these 12 Regions:
- US East (N. Virginia), US East (Ohio), US West (Oregon)
- Canada (Central)
- Asia Pacific (Mumbai, Singapore, Sydney, Tokyo)
- Europe (Frankfurt, Ireland, London, Spain)
To get started, send OpenTelemetry data to your domain, for example with Amazon OpenSearch Ingestion.
Wrap-up
- The optimized engine now supports agent traces, including OpenTelemetry, and logs
- With both in one place, you can trace failures and slowdowns without switching tools
- Nested structures are preserved, so field-level queries work
- OpenSearch 3.7, 12 Regions, no additional charge
This one is for anyone watching agent behavior or building observability on OpenSearch!