We’re excited to announce that you can now use honeytail and rdslogs to send your Postgres query logs to Honeycomb. Honeycomb helps you answer the following questions (and more) about your database workload:
“What does the overall distribution of query latency look like?”
“Which queries are responsible for the spikes in query volume that we’re seeing?”
“How did our query workload change after the latest deploy?”
What real observability gets you
Overall database statistics such as blks_read and blks_hit are useful for general tuning, but don’t tell you much about the actual queries your application is running, or how those queries are performing. Query summaries from pg_stat_statements give you an overview of your database’s query workload, but won’t tell you how that workload is changing over time. Importantly, they also don’t tell you anything about individual queries. If instead of a single bad query, you have a single bad user who’s causing excess query volume, how will you tell?
In order to account for database resources not just by query type, but by individual user, you need to retain information about individual raw queries. But amassing a giant query log file isn’t enough if you can’t easily break it down to find what you’re looking for:
- Which query families are most common?
- Are queries uniformly slow, or are there latency outliers?
- Is one client sending too much traffic?
- How is our workload changing over time?
The Honeycomb integrations collect raw queries as well as normalized versions of queries, making it easy to identify both overall patterns and individual outliers.
Give it a try
If you’re running Postgres yourself, honeytail will consume your query logs and ship them off to Honeycomb. If you’re using Amazon RDS, rdslogs automates the process of downloading your log files from AWS, parsing their contents, and sending extracted events to Honeycomb. You can get started right away:
wget -q -O rdslogs https://www.honeycomb.io/download/rdslogs/1.53 echo 'eb877392fa12fc1e2ae6735a3f6d726e140502a3228fdce66f45472adb7a9227 rdslogs' | sha256sum -c && chmod 755 ./rdslogs rdslogs -i YOUR_RDS_INSTANCE_IDENTIFIER --writekey=YOUR_HONEYCOMB_WRITE_KEY --output=honeycomb --dataset='RDS PostgreSQL' --dbtype=postgresql
Check out the docs to get started, and don’t hesitate to get in touch if you have questions!
