As engineers, we are usually "trained" no to loss any data because "we might need it in the future", but is that true for all cases?
In Outbrain, as part of the data democratisation methodology, a developer is free to send (almost) any kind of log/message that he wants/needs.
Therefore, we had to impose mechanisms to potentially drop data base on various dimensions of the sent message (and the sending rate/volume).
In this session I will present the idea behind the system and how it works.