Analysis: Do people reply to emails slower on Friday afternoons? (draft v7)
Ticket DS-4471, opened as "quick question". Time spent: 3 weeks. Status: Inconclusive (high confidence).
TL;DR
Directionally, possibly, after adjustment, in some mailboxes: unadjusted hazard ratio for replying to a Friday-afternoon email is 0.31 (95% CI 0.29–0.33). Once the weekend is controlled for, the effect is p = 0.051. The weekend may be the effect.
Background
On Monday, Susan suggested that people reply more slowly on Friday afternoons because they have gone home. Anecdote is not evidence. This analysis corrects for Susan.
Data
61,204 threads from email_latency_final_v2_FIXED.csv, January 2024 to June 2026. The join on thread_id fanned out to 212,880 rows because of reply-all. 9,114 "replies" came 0.3 s after receipt and were out-of-office autoreplies, the only fast responders in the building. Timestamps were stored in server UTC, so 16:00 Friday in Sydney was being counted as Friday morning in London. A manual followed_up_on field contained "next Tues" 211 times and "lol" once.
Humans should not be allowed to enter data. They should not be allowed to generate it either, but here we are.
EDA
| Slot |
n |
Median latency (h) |
IQR (h) |
| Fri 13:00–17:00 |
6,388 |
41.2 |
1.8–65.0 |
| Mon–Thu 13:00–17:00 |
27,915 |
2.7 |
0.6–9.4 |
Friday PM reply latency (h)
0–4 ████████████
4–24 ████
24–48 ██
48–72 ████████████████████ <- mode: 64 h
72+ ███
There is a mode at 64 hours, which is Monday at 09:00. Nobody predicted this.
Methods
- Difference in medians. It compares two numbers, which is the level at which this question was asked.
- Welch t-test on log latency. It allows the two groups to have different variances (heteroscedasticity), but I wouldn't expect you to follow that.
- OLS of log latency on day × hour dummies with sender fixed effects. Every sender is treated as a sensor with its own calibration error.
- Cox proportional hazards, with unanswered threads right-censored. This is the correct model, and it was run fourth.
- LightGBM on 400 engineered features, predicting a reply within 4 h.
- Bayesian hierarchical model with partial pooling by department. Partial pooling shrinks noisy groups toward the mean, the way the organisation does with its staff.
- IV using
cake_in_breakroom as an instrument for Friday. First-stage F = 3.1, below the usual threshold of 10. Cake also delays replies directly, so the exclusion restriction fails. It is a confounder with frosting.
Results
| Model |
AUC (95% CI) |
| Logistic baseline |
0.7121 (0.7043–0.7199) |
| LightGBM |
0.7124 (0.7046–0.7202) |
| Bayesian hierarchical |
0.7119 (0.7041–0.7197) |
LightGBM wins by 0.0003.¹ It took 41 GPU-hours to tie a regression.
¹ Difference 0.0003, 95% CI −0.0011 to 0.0017.
Feature importance
Mean |SHAP| ranks hours_until_monday first. Feature 312 is is_tuesday_and_raining_and_susan_in_office. The top driver of slow Friday replies is the approach of the weekend, and this is reported here as a discovery.
Significance
After adjusting for weekend_in_reply_window, the Friday coefficient on log latency is 0.041, SE 0.021, z = 1.95, 95% CI −0.0002 to 0.0822, p = 0.051. That is marginally significant, trending, approaching significance. Adjusting for the mechanism removed the effect, which is what adjusting for a mediator does.
For threads first opened on a Tuesday, β = 0.112, SE 0.0545, z = 2.06, 95% CI 0.0052 to 0.2188, p = 0.040. That was 1 of 48 subgroups tested; Bonferroni would require p < 0.00104. It was not applied. The Tuesday result stands, unsupervised.
Caveats
- Unanswered emails are censored, and some are censored forever.
- Remote work introduced covariate shift in 2025.
- The direction reverses within finance (Simpson's paradox). Finance replies on Friday to avoid Monday.
- Reply latency measures the timestamp, not the reading.
- "Read, will reply Monday" is a reply, technically.
- Sender fixed effects absorb rudeness, which is not stationary.
- Thursday afternoon is already partially Friday.
- Daylight saving time moved Friday twice a year.
- The
final_v2_FIXED file has never been fixed.
- The presence of humans.
The residuals are you.
You filed this ticket at 16:47 on a Friday, so it has been added to the treatment arm.
Recommendation
Further study, more data, fewer humans in the loop. A/B test: randomise delivery of non-urgent email to Friday PM or Tuesday PM.
σ = 1.9 (log h), δ = 0.041, α = 0.05 two-sided, power = 0.80:
n per arm = 2σ²(1.96 + 0.84)² / δ² = 2 × 3.61 × 7.84 / 0.001681 = 33,674
The team mailbox produces 12 eligible emails per Friday afternoon, so 33,674 / 12 = 2,807 Fridays, or 53.8 years. Expected completion is 2080. We recommend starting immediately.
Dashboard
<dashboard link>: twelve tiles, hourly refresh, zero viewers. Its usage analytics are on another dashboard, which also has zero viewers. Both refresh on Fridays without anyone noticing.
Deliverable: analysis_FINAL_final_v7_USE_THIS.ipynb, 340 cells. Cell 1 is Susan's answer.
Acknowledgements
Thanks to Susan for the original hypothesis, which has now been made less certain.