Software Engineering   Operations   Incident Response   Debugging  

Incident Report: The Missing Trigger Notification Emails

On November 18, between 00:50 and 00:56 UTC, an update was deployed that improved Honeycomb’s business intelligence (BI) telemetry available from our production operations environment....

Metrics   HoneyBytes  

HoneyByte: Using Application Metrics With Prometheus Clients

Have you ever deep dived into the sea of your tracing data, but wanted additional context around your underlying system? For instance, it may be...

Service Level Objectives   Sampling   Ask Miss O11y  

Ask Miss O11y: Load Testing With Fidelity

Dear Miss O11y, My developers and I can't agree about what the right approach is for running load tests in production. Should we even be...

Tracing  

Tracing Makes Concurrency Bugs Easy to Spot

Today, I found a concurrency bug before I noticed it. Like, it was subtle, and so I wasn’t quite sure I saw it—maybe I hadn’t...

Tracing   Best Practices   Ask Miss O11y  

Ask Miss O11y: Tracing Is for Async, Too

I have a good sense of how to use traces to understand my system’s behavior within request/response cycles. What about multi-request processes? What about async...

Events  

Hone Your Observability Skills at Honeycomb Developer Week

Is the lack of time holding you back from sharpening your observability (o11y) skills? Maybe you’ve dipped your toes into o11y, but you’re not sure...

Technical Deep Dives  

Scaling Kafka at Honeycomb

When you send telemetry into Honeycomb, our infrastructure needs to buffer your data before processing it in our "retriever" columnar storage database. For the entirety...

Instrumentation   Best Practices   Ask Miss O11y  

Ask Miss O11y: Mapping Out Your Observability Journey

Dear Miss O11y: It feels so overwhelming to get started with observability. I want to use Honeycomb, but it feels like I can't justify spending...

Teams & Collaboration   Best Practices   Ask Miss O11y  

Ask Miss O11y: I Don't Want to Be On Call Anymore. Am I a Monster?

“Can a subject matter expert ever step down?” Have you written anything about how to solve the ‘nobody wants to be on-call as a subject matter expert...

Software Engineering   Debugging  

Incident Resolution: Do You Remember, the Twenty Fires of September?

From September to early October, Honeycomb declared five public incidents. Internally, the whole month was part of a broader operational burden, where over 20 different...

Software Engineering   Debugging  

Game Launches Should Be Exciting for Your Players, Not for Your LiveOps Team

This blog was co-authored by Amy Davis.  The moment of launching something new at a game studio (titles, experiences, features, subscriptions) is a blockbuster moment...

Teams & Collaboration   Culture  

Cut Out Time Estimates on Roadmaps: Get Into a Product Delivery Rhythm

All of the business of software, but especially the delivery of product capabilities, is inextricably bound up in questions about time. What’s the estimate? If...

1 27 28 29 30 31 51