For effective incident response, you need logs to be queryable within seconds of the request. If your data pipeline has a delay of several minutes, you will likely find out about outages from your users before your monitoring system alerts you.