I don’t believe this to be the case at all. Mathematics is (at the end of the day) only adding and subtracting, nothing more. There are no starting or ending points in mathematics only a description of the differences between things. For instance it’s not possible to say that one and one equals two (this is mathematically incorrect) as this is the middle of an undefined equation, as where did the first object added to the second object and so on come from? Everyone knows that the answer is two but they don’t understand the reason why. Nor can this logic ever prove that 1 + 1 = 2.
If you can add-up and subtract you already know all there is to know about mathematics, but like time itself and It’s misconceptions it’s only a man made ruler with lots of short cuts (like logarithms, tangents etc) that enable us to define, not what is, but what is missing. Like a perfect circle (can’t exist in reality or defined using maths) it’s a bit of a blind ally.
There are of course many types of adding and subtraction (or positive and negative) systems like binary, but none of them are actually of any use if you are trying to find out (for instance) how to define an object like a universe in any sort of logical way, as there is no defined starting point and no defined ending point. In other word they are all different comparisons (differentials) between two unknown states. At least that’s my idea of maths. However until someone comes up with a better solution (algebra would be a good staring point as at least you would be aware of the missing bits) we are stuck with it.