Binary activation functions (BAFs) constitute as a unique and intriguing class within the realm of machine learning. These activations possess the distinctive characteristic of outputting either a 0 or a 1, representing an on/off state. This minimalism makes them particularly interesting for applications where binary classification is the primary g